[2025-10-08T17:00:01.672204] [INFO ] [MAIN ] Using last completed trading day: 2025-10-08 [2025-10-08T17:00:01.910373] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-08T17:00:01.910690] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-08T17:00:02.111151] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-08T17:00:02.111738] [WARN ] [STATE ] State set to: RUNNING [2025-10-08T17:00:02.111820] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-08T17:00:02.111868] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-08T17:00:02.111954] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-08T17:00:02.111990] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-08T17:00:03.782328] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-08T17:00:03.782504] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-08T17:00:03.782746] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-08T17:00:03.783419] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-08T17:00:03.783481] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-08T17:00:03.783513] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-08T17:00:03.783572] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-08T17:00:03.783606] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-08T17:00:03.783661] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-08T17:00:03.784098] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-08T17:00:03.784142] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-08T17:00:03.784298] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-08T17:00:03.784330] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-08T17:00:03.784360] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-08T17:00:03.784390] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-08T17:00:03.806474] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-08T17:00:03.828098] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-08T17:00:03.828183] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-08T17:00:03.828220] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-08T17:00:03.828248] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-08T17:00:03.828308] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-08T17:00:03.828741] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-08T17:00:03.828795] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-08T17:00:03.828829] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-10-08T17:00:03.828857] [INFO ] [MAIN ] Running in parallel mode [2025-10-08T17:00:03.829058] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-10-08T17:00:04.479808] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:04.504756] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:04.562294] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-08T17:00:04.588420] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-08T17:00:04.593247] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:04.589160] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-08T17:00:04.566122] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:04.595371] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-08T17:00:04.596885] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-08T17:00:04.595313] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-08T17:00:04.597034] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-08T17:00:04.597169] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-08T17:00:04.603031] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-08T17:00:04.610405] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-08T17:00:04.650108] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-08T17:00:04.667819] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-08T17:00:05.204705] [DEBUG] [LOCAL ] AA: Loaded 53620 existing records from primary storage. [2025-10-08T17:00:05.255514] [INFO ] [MAIN ] AA: Loaded 53620 existing records. [2025-10-08T17:00:05.262315] [DEBUG] [LOCAL ] A: Loaded 50745 existing records from primary storage. [2025-10-08T17:00:05.346872] [INFO ] [MAIN ] A: Loaded 50745 existing records. [2025-10-08T17:00:05.544800] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:05.617418] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-08T17:00:05.712872] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:05.755606] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-08T17:00:05.841122] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:05.862364] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-08T17:00:05.862484] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-08T17:00:05.881130] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-08T17:00:05.890701] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-08T17:00:05.993002] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:06.016797] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-08T17:00:06.019070] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-08T17:00:06.025777] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-08T17:00:06.046303] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-08T17:00:06.250808] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T17:00:06.289201] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-08T17:00:06.451953] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:00:06.504850] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-08T17:00:06.525569] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:00:06.581954] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-08T17:00:06.628879] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:06.649672] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:00:06.667537] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-08T17:00:06.667638] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-08T17:00:06.685429] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-08T17:00:06.719993] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:06.720953] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-08T17:00:06.721265] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-08T17:00:06.722211] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-08T17:00:06.722334] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.8s. Estimated remaining: 1h 54m 17s. Rate: 20.7 symbols/min [2025-10-08T17:00:06.790863] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T17:00:06.810016] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-08T17:00:06.927704] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:07.014961] [DEBUG] [LOCAL ] AAP: Loaded 51875 existing records from primary storage. [2025-10-08T17:00:07.015394] [INFO ] [MAIN ] AAP: Loaded 51875 existing records. [2025-10-08T17:00:07.207735] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T17:00:07.216264] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-08T17:00:07.261994] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:07.262274] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-08T17:00:07.262352] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-08T17:00:07.263851] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-08T17:00:07.263937] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-08T17:00:07.634975] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:07.635329] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-08T17:00:07.678213] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T17:00:07.679259] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-08T17:00:07.959433] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-08T17:00:07.960478] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-08T17:00:08.195259] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-08T17:00:08.196291] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-08T17:00:08.465305] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T17:00:08.466509] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-08T17:00:08.515299] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T17:00:08.526776] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-08T17:00:08.601238] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T17:00:08.612022] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-08T17:00:08.813491] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T17:00:08.814467] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-08T17:00:09.226018] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-08T17:00:09.228955] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-08T17:00:09.227408] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:00:09.240439] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-08T17:00:09.787552] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T17:00:09.788627] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-08T17:00:10.083047] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T17:00:10.093411] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-08T17:00:10.154037] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T17:00:10.154747] [INFO ] [REMOTE ] AAM: Full fetch complete (937 records). [2025-10-08T17:00:10.154824] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-08T17:00:10.155197] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:00:10.155283] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:00:10.155333] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:00:10.155399] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-08T17:00:10.155466] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-08T17:00:10.155502] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-08T17:00:10.155541] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-08T17:00:10.155596] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.3s. Estimated remaining: 2h 4m 54s. Rate: 19.0 symbols/min [2025-10-08T17:00:10.332420] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:10.363505] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T17:00:10.374346] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-08T17:00:10.402054] [DEBUG] [LOCAL ] AAT: Loaded 30309 existing records from primary storage. [2025-10-08T17:00:10.402364] [INFO ] [MAIN ] AAT: Loaded 30309 existing records. [2025-10-08T17:00:10.586772] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:10.587005] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-08T17:00:10.587054] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-08T17:00:10.587926] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-08T17:00:10.587988] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-08T17:00:10.950500] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:10.950898] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-08T17:00:10.977816] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T17:00:10.987800] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-08T17:00:11.871951] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T17:00:11.878176] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-08T17:00:12.112920] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-08T17:00:12.124947] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-08T17:00:12.368479] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-08T17:00:12.383811] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-08T17:00:12.467329] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T17:00:12.477550] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-08T17:00:12.732161] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T17:00:12.737843] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-08T17:00:13.737409] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:00:13.743594] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-08T17:00:13.919382] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:00:13.931935] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-08T17:00:14.036378] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T17:00:14.048304] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-08T17:00:14.090221] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T17:00:14.102504] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-08T17:00:14.848199] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:00:14.855399] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-08T17:00:15.828123] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T17:00:15.840364] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-08T17:00:16.017562] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:00:16.025941] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-08T17:00:16.121744] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T17:00:16.135376] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-08T17:00:16.198240] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T17:00:16.211021] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-08T17:00:16.923202] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T17:00:16.932142] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-08T17:00:17.904383] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T17:00:17.945021] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-08T17:00:17.948263] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:00:17.962486] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-08T17:00:18.014305] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T17:00:18.044756] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-08T17:00:18.047225] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T17:00:18.054105] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-08T17:00:18.998343] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T17:00:19.007396] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-08T17:00:19.665345] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T17:00:19.676451] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-08T17:00:19.754804] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:00:19.765392] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-08T17:00:19.845961] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T17:00:19.856970] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-08T17:00:20.622423] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-08T17:00:20.635400] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-08T17:00:21.104438] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T17:00:21.115977] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-08T17:00:21.307984] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T17:00:21.320573] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-08T17:00:21.559570] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:00:21.572929] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-08T17:00:22.261430] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T17:00:22.274922] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-08T17:00:22.320748] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T17:00:22.323328] [INFO ] [REMOTE ] AAT: Full fetch complete (42716 records). [2025-10-08T17:00:22.323471] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-08T17:00:22.734310] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-08T17:00:22.734526] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-08T17:00:22.735090] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-08T17:00:22.735206] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-08T17:00:22.736765] [DEBUG] [LOCAL ] AAT: Trimmed 42716 records to 30285 (keeping 200 days of data) [2025-10-08T17:00:22.912705] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:00:22.977896] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-08T17:00:22.997774] [DEBUG] [LOCAL ] AAT: Primary data saved (30285 records). [2025-10-08T17:00:22.998167] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-08T17:00:22.998378] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 12.8s. Estimated remaining: 4h 12m 11s. Rate: 9.4 symbols/min [2025-10-08T17:00:23.211685] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:23.207836] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T17:00:23.221625] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-08T17:00:23.221750] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-08T17:00:23.221988] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-08T17:00:23.222252] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-08T17:00:23.222417] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-08T17:00:23.222510] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-08T17:00:23.267704] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-08T17:00:23.590525] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:23.590925] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-08T17:00:23.790188] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:00:23.790544] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-08T17:00:23.790672] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:00:23.790761] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-08T17:00:23.790845] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:00:23.790939] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-08T17:00:23.791053] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-08T17:00:23.791135] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-08T17:00:23.791232] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-08T17:00:23.791328] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAUC took 0.8s. Estimated remaining: 3h 16m 53s. Rate: 12.0 symbols/min [2025-10-08T17:00:23.989415] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:24.022096] [DEBUG] [LOCAL ] AB: Loaded 26634 existing records from primary storage. [2025-10-08T17:00:24.022564] [INFO ] [MAIN ] AB: Loaded 26634 existing records. [2025-10-08T17:00:24.270588] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T17:00:24.275629] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:24.290687] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-08T17:00:24.290843] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-08T17:00:24.292215] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-08T17:00:24.292277] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-08T17:00:24.293880] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-08T17:00:24.701106] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:24.701770] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-08T17:00:24.756467] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T17:00:24.770308] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-08T17:00:24.998501] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:00:25.020156] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-08T17:00:25.735904] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:00:25.743699] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-08T17:00:26.335594] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T17:00:26.356241] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-08T17:00:26.357142] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T17:00:26.362204] [INFO ] [REMOTE ] AAP: Full fetch complete (75021 records). [2025-10-08T17:00:26.362335] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-08T17:00:26.809485] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-08T17:00:26.809872] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-08T17:00:26.811328] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-08T17:00:26.811758] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-08T17:00:26.816007] [DEBUG] [LOCAL ] AAP: Trimmed 75021 records to 51882 (keeping 200 days of data) [2025-10-08T17:00:26.985679] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T17:00:26.996178] [INFO ] [REMOTE ] A: Full fetch complete (73119 records). [2025-10-08T17:00:27.009539] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-08T17:00:27.430141] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:00:27.517162] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-08T17:00:27.928086] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-08T17:00:27.928576] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-08T17:00:27.932608] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-08T17:00:27.932835] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-08T17:00:27.997676] [DEBUG] [LOCAL ] A: Trimmed 73119 records to 50744 (keeping 200 days of data) [2025-10-08T17:00:28.124009] [DEBUG] [LOCAL ] AAP: Primary data saved (51882 records). [2025-10-08T17:00:28.124499] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-08T17:00:28.125477] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAP took 21.4s. Estimated remaining: 3h 11m 37s. Rate: 12.3 symbols/min [2025-10-08T17:00:28.327684] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:28.455481] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-08T17:00:28.476599] [INFO ] [REMOTE ] AA: Full fetch complete (77541 records). [2025-10-08T17:00:28.477229] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-08T17:00:28.634411] [DEBUG] [LOCAL ] ABBV: Loaded 53685 existing records from primary storage. [2025-10-08T17:00:28.641171] [INFO ] [MAIN ] ABBV: Loaded 53685 existing records. [2025-10-08T17:00:29.179021] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:29.189303] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-08T17:00:29.194557] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-08T17:00:29.202955] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-08T17:00:29.203354] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-08T17:00:29.373359] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-08T17:00:29.378619] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-08T17:00:29.390117] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-08T17:00:29.395416] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-08T17:00:29.416614] [DEBUG] [LOCAL ] A: Primary data saved (50744 records). [2025-10-08T17:00:29.445034] [INFO ] [MAIN ] A: Full history saved. [2025-10-08T17:00:29.465940] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. A took 25.6s. Estimated remaining: 2h 48m 25s. Rate: 14.0 symbols/min [2025-10-08T17:00:29.464878] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T17:00:29.471895] [DEBUG] [LOCAL ] AA: Trimmed 77541 records to 53620 (keeping 200 days of data) [2025-10-08T17:00:29.812353] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-08T17:00:30.004675] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:30.010565] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-08T17:00:30.016302] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-08T17:00:30.016820] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-08T17:00:30.016902] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-08T17:00:30.023109] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-08T17:00:30.042394] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-08T17:00:30.098560] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:30.104687] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-08T17:00:30.502340] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:30.504061] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-08T17:00:30.745980] [DEBUG] [LOCAL ] AA: Primary data saved (53620 records). [2025-10-08T17:00:30.746160] [INFO ] [MAIN ] AA: Full history saved. [2025-10-08T17:00:30.746594] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AA took 26.9s. Estimated remaining: 2h 31m 30s. Rate: 15.6 symbols/min [2025-10-08T17:00:30.928073] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:30.984300] [DEBUG] [LOCAL ] ABEV: Loaded 53279 existing records from primary storage. [2025-10-08T17:00:30.984776] [INFO ] [MAIN ] ABEV: Loaded 53279 existing records. [2025-10-08T17:00:31.174247] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:31.174851] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-08T17:00:31.175024] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-08T17:00:31.176983] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-08T17:00:31.177047] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-08T17:00:31.571661] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:31.572626] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-08T17:00:31.601211] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:00:31.613359] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-08T17:00:31.903952] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T17:00:31.911567] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-08T17:00:32.173744] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-08T17:00:32.184954] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-08T17:00:33.096688] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T17:00:33.105959] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-08T17:00:33.168528] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:00:33.175950] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-08T17:00:33.262906] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:00:33.274122] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-08T17:00:34.211282] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-08T17:00:34.223991] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-08T17:00:34.278144] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T17:00:34.285141] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-08T17:00:34.425575] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T17:00:34.431921] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-08T17:00:34.943740] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T17:00:34.956195] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-08T17:00:35.081912] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:00:35.087400] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-08T17:00:35.708684] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T17:00:35.719935] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-08T17:00:35.926740] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T17:00:35.935948] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-08T17:00:36.075778] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T17:00:36.081977] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-08T17:00:36.407787] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T17:00:36.422916] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-08T17:00:37.121016] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T17:00:37.127167] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-08T17:00:37.426068] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T17:00:37.435234] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-08T17:00:37.544694] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:00:37.563611] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-08T17:00:38.200207] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:00:38.206004] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-08T17:00:38.303547] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:00:38.314847] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-08T17:00:38.353731] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T17:00:38.360237] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-08T17:00:39.025046] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T17:00:39.027661] [INFO ] [REMOTE ] AB: Full fetch complete (45028 records). [2025-10-08T17:00:39.027803] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-08T17:00:39.028841] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:00:39.028941] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:00:39.028986] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:00:39.029027] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-08T17:00:39.029145] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-08T17:00:39.029216] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-08T17:00:39.029507] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-08T17:00:39.029638] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 15.2s. Estimated remaining: 2h 53m 17s. Rate: 13.6 symbols/min [2025-10-08T17:00:39.211557] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:39.232735] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T17:00:39.240570] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-08T17:00:39.257769] [DEBUG] [LOCAL ] ABG: Loaded 18537 existing records from primary storage. [2025-10-08T17:00:39.258453] [INFO ] [MAIN ] ABG: Loaded 18537 existing records. [2025-10-08T17:00:39.449740] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:39.450192] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-08T17:00:39.450286] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-08T17:00:39.451110] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-08T17:00:39.451175] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-08T17:00:39.597862] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-08T17:00:39.626546] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-08T17:00:39.873293] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:39.873681] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-08T17:00:40.087244] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T17:00:40.098705] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-08T17:00:40.299762] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T17:00:40.309843] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-08T17:00:40.926066] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T17:00:40.929984] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-08T17:00:41.269902] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T17:00:41.277277] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-08T17:00:41.582881] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T17:00:41.594977] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-08T17:00:41.737911] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T17:00:41.751514] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-08T17:00:41.765615] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:00:41.771048] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-08T17:00:42.322938] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T17:00:42.331223] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-08T17:00:42.783607] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T17:00:42.787900] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-08T17:00:43.294290] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T17:00:43.314810] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:00:43.319983] [INFO ] [REMOTE ] ABCB: Full fetch complete (44383 records). [2025-10-08T17:00:43.320482] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-08T17:00:43.320959] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-08T17:00:43.323324] [FATAL] [VALIDATOR ] ABCB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:00:43.323548] [FATAL] [MAIN ] ABCB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:00:43.323628] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:00:43.323744] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-08T17:00:43.323872] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-08T17:00:43.323950] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-10-08T17:00:43.324049] [DEBUG] [LOCAL ] ABCB: No derivative data file found to delete. [2025-10-08T17:00:43.324174] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 13.8s. Estimated remaining: 2h 52m 45s. Rate: 13.7 symbols/min [2025-10-08T17:00:43.549224] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:43.567370] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T17:00:43.573868] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-08T17:00:43.631706] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T17:00:43.643279] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-08T17:00:43.657086] [DEBUG] [LOCAL ] ABM: Loaded 32062 existing records from primary storage. [2025-10-08T17:00:43.657482] [INFO ] [MAIN ] ABM: Loaded 32062 existing records. [2025-10-08T17:00:43.866439] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:43.866777] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-08T17:00:43.866832] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-08T17:00:43.867276] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-08T17:00:43.867336] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-08T17:00:44.285457] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:44.285901] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-08T17:00:44.479087] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T17:00:44.485708] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-08T17:00:44.786874] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:00:44.798579] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-08T17:00:45.067589] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T17:00:45.071286] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-08T17:00:45.409460] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T17:00:45.424099] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-08T17:00:45.727170] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:00:45.733402] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-08T17:00:46.041449] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T17:00:46.046088] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-08T17:00:46.246702] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T17:00:46.258058] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-08T17:00:46.791826] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T17:00:46.798269] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-08T17:00:47.074284] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T17:00:47.105825] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T17:00:47.113522] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-08T17:00:47.112857] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-08T17:00:47.704397] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:00:47.710902] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-08T17:00:47.817721] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T17:00:47.843269] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-08T17:00:47.845918] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T17:00:47.851072] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-08T17:00:48.487386] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T17:00:48.491480] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-08T17:00:48.758929] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T17:00:48.770942] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-08T17:00:49.064557] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:00:49.071761] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-08T17:00:49.154451] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T17:00:49.161109] [INFO ] [REMOTE ] ABBV: Full fetch complete (77719 records). [2025-10-08T17:00:49.161308] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-08T17:00:49.408039] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T17:00:49.452944] [INFO ] [REMOTE ] ABEV: Full fetch complete (77220 records). [2025-10-08T17:00:49.480321] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T17:00:49.490420] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-08T17:00:49.544219] [INFO ] [REMOTE ] ABG: Full fetch complete (26605 records). [2025-10-08T17:00:49.622624] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-08T17:00:49.882978] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-08T17:00:49.983158] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-08T17:00:50.076892] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-08T17:00:50.168308] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-08T17:00:50.282112] [DEBUG] [LOCAL ] ABBV: Trimmed 77719 records to 53686 (keeping 200 days of data) [2025-10-08T17:00:50.535213] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-08T17:00:50.565901] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-08T17:00:50.566501] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-08T17:00:50.567124] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-08T17:00:50.568130] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-08T17:00:50.569087] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-08T17:00:50.569593] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-08T17:00:50.570496] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-08T17:00:50.572365] [DEBUG] [LOCAL ] ABG: Trimmed 26605 records to 18494 (keeping 200 days of data) [2025-10-08T17:00:50.576676] [DEBUG] [LOCAL ] ABEV: Trimmed 77220 records to 53281 (keeping 200 days of data) [2025-10-08T17:00:50.807901] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:00:50.820711] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-08T17:00:50.958450] [DEBUG] [LOCAL ] ABG: Primary data saved (18494 records). [2025-10-08T17:00:50.961718] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-08T17:00:50.967115] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABG took 11.9s. Estimated remaining: 3h 5m 29s. Rate: 12.7 symbols/min [2025-10-08T17:00:51.269202] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:51.487278] [DEBUG] [LOCAL ] ABR: Loaded 51989 existing records from primary storage. [2025-10-08T17:00:51.494022] [INFO ] [MAIN ] ABR: Loaded 51989 existing records. [2025-10-08T17:00:51.581881] [DEBUG] [LOCAL ] ABEV: Primary data saved (53281 records). [2025-10-08T17:00:51.587737] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-08T17:00:51.594804] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 20.8s. Estimated remaining: 2h 50m 48s. Rate: 13.8 symbols/min [2025-10-08T17:00:51.788717] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:51.821347] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-08T17:00:51.837971] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-08T17:00:51.856179] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-08T17:00:51.857424] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-08T17:00:51.859502] [DEBUG] [LOCAL ] ABBV: Primary data saved (53686 records). [2025-10-08T17:00:51.909619] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-08T17:00:51.909429] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:51.925784] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABBV took 23.8s. Estimated remaining: 2h 37m 35s. Rate: 15.0 symbols/min [2025-10-08T17:00:52.316269] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:52.333171] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:00:52.434916] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-08T17:00:52.488869] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-08T17:00:52.516429] [INFO ] [MAIN ] ABT: Loaded 53623 existing records. [2025-10-08T17:00:52.589894] [DEBUG] [LOCAL ] ACA: Loaded 23241 existing records from primary storage. [2025-10-08T17:00:52.647516] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:52.643191] [INFO ] [MAIN ] ACA: Loaded 23241 existing records. [2025-10-08T17:00:52.659741] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-08T17:00:52.924458] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:52.935421] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-08T17:00:52.939295] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-08T17:00:52.939611] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-08T17:00:52.945127] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-08T17:00:53.140966] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:53.141553] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-08T17:00:53.147022] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-08T17:00:53.162813] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-08T17:00:53.180678] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-08T17:00:53.630569] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:53.673261] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-08T17:00:53.895795] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:53.915789] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-08T17:00:53.918382] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T17:00:53.926911] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-08T17:00:54.723457] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-08T17:00:54.736120] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-08T17:00:55.054373] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T17:00:55.061766] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-08T17:00:55.088938] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:00:55.093385] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-08T17:00:55.225463] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:00:55.238227] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-08T17:00:55.944246] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T17:00:55.950243] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-08T17:00:56.144267] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T17:00:56.152526] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-08T17:00:56.429888] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:00:56.440392] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-08T17:00:56.764259] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:00:56.777100] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-08T17:00:56.803270] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T17:00:56.809436] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-08T17:00:57.339270] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T17:00:57.348161] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-08T17:00:57.938611] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:00:57.952026] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-08T17:00:58.108812] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:00:58.115415] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-08T17:00:58.551739] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T17:00:58.563356] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-08T17:00:58.590806] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:00:58.594875] [INFO ] [REMOTE ] ABM: Full fetch complete (44900 records). [2025-10-08T17:00:58.595026] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-08T17:00:59.008203] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-08T17:00:59.008312] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-08T17:00:59.008911] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-08T17:00:59.008981] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-08T17:00:59.010303] [DEBUG] [LOCAL ] ABM: Trimmed 44900 records to 31947 (keeping 200 days of data) [2025-10-08T17:00:59.205066] [DEBUG] [LOCAL ] ABM: Primary data saved (31947 records). [2025-10-08T17:00:59.205243] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-08T17:00:59.207003] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 15.9s. Estimated remaining: 2h 47m 25s. Rate: 14.1 symbols/min [2025-10-08T17:00:59.380583] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:59.380798] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-08T17:00:59.380871] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-08T17:00:59.381022] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-08T17:00:59.381081] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-08T17:00:59.381159] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-08T17:00:59.381314] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-08T17:00:59.517943] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:00:59.578795] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-08T17:00:59.829239] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:59.829820] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-08T17:00:59.859901] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T17:00:59.871415] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-08T17:01:00.380799] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:01:00.391919] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-08T17:01:00.934990] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T17:01:00.940708] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-08T17:01:01.098816] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:01:01.108500] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-08T17:01:01.638152] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T17:01:01.649853] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-08T17:01:01.684109] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T17:01:01.689167] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-08T17:01:02.487632] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:01:02.495403] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-08T17:01:02.605116] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-08T17:01:02.616454] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-08T17:01:02.993637] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T17:01:03.217557] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-08T17:01:03.268370] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:01:03.866339] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T17:01:04.017528] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-08T17:01:04.329370] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T17:01:04.358035] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T17:01:04.817618] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-08T17:01:05.341172] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T17:01:05.617583] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-08T17:01:05.885400] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:01:06.417581] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-08T17:01:07.217550] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-08T17:01:07.604884] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-08T17:01:08.017535] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-08T17:01:08.161563] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T17:01:08.163556] [INFO ] [REMOTE ] ACA: Full fetch complete (34166 records). [2025-10-08T17:01:08.163716] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-08T17:01:08.164395] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:01:08.164493] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:01:08.164541] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:01:08.164594] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-08T17:01:08.164698] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-08T17:01:08.164757] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-08T17:01:08.165001] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-08T17:01:08.165109] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 16.2s. Estimated remaining: 3h 0m 31s. Rate: 13.1 symbols/min [2025-10-08T17:01:08.345825] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:08.374419] [DEBUG] [LOCAL ] ACEL: Loaded 26706 existing records from primary storage. [2025-10-08T17:01:08.374771] [INFO ] [MAIN ] ACEL: Loaded 26706 existing records. [2025-10-08T17:01:08.583394] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:01:08.583821] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-08T17:01:08.583944] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-08T17:01:08.593970] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-08T17:01:08.608143] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-08T17:01:08.689288] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-08T17:01:08.824225] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-08T17:01:08.989236] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:09.617598] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-08T17:01:09.690031] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T17:01:10.417589] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-08T17:01:10.743503] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T17:01:11.083317] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-08T17:01:11.217596] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-08T17:01:11.309409] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T17:01:12.017593] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-08T17:01:12.779625] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T17:01:12.817525] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-08T17:01:13.207913] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T17:01:13.617577] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-08T17:01:14.417562] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-08T17:01:14.653664] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T17:01:14.701873] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:01:15.217577] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-08T17:01:16.017526] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-08T17:01:16.341159] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T17:01:16.597718] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T17:01:16.823310] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-08T17:01:16.828211] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T17:01:17.335786] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T17:01:17.339856] [INFO ] [REMOTE ] ABT: Full fetch complete (77596 records). [2025-10-08T17:01:17.340055] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-08T17:01:17.622835] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-08T17:01:17.741472] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-08T17:01:17.741603] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-08T17:01:17.742458] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-08T17:01:17.742528] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-08T17:01:17.744264] [DEBUG] [LOCAL ] ABT: Trimmed 77596 records to 53623 (keeping 200 days of data) [2025-10-08T17:01:18.082309] [DEBUG] [LOCAL ] ABT: Primary data saved (53623 records). [2025-10-08T17:01:18.082471] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-08T17:01:18.082563] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABT took 26.5s. Estimated remaining: 3h 14m 23s. Rate: 12.1 symbols/min [2025-10-08T17:01:18.253344] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:18.304612] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-08T17:01:18.305030] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-08T17:01:18.422779] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-08T17:01:18.488134] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:01:18.491969] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-08T17:01:18.492057] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-08T17:01:18.492502] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-08T17:01:18.492562] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-08T17:01:18.868168] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:19.168857] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:01:19.217617] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-08T17:01:19.368473] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T17:01:20.017620] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-08T17:01:20.413320] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T17:01:20.817583] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-08T17:01:21.617568] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-08T17:01:21.847078] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T17:01:22.417580] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-08T17:01:23.021308] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:01:23.217508] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-08T17:01:23.289866] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T17:01:24.017537] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-08T17:01:24.201562] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-08T17:01:24.205989] [INFO ] [REMOTE ] ABR: Full fetch complete (75244 records). [2025-10-08T17:01:24.206145] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-08T17:01:24.505598] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T17:01:24.638951] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-08T17:01:24.639045] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-08T17:01:24.639819] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-08T17:01:24.639892] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-08T17:01:24.641521] [DEBUG] [LOCAL ] ABR: Trimmed 75244 records to 51958 (keeping 200 days of data) [2025-10-08T17:01:24.827459] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-08T17:01:24.972565] [DEBUG] [LOCAL ] ABR: Primary data saved (51958 records). [2025-10-08T17:01:24.972763] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-08T17:01:24.975800] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABR took 34.0s. Estimated remaining: 3h 19m 4s. Rate: 11.8 symbols/min [2025-10-08T17:01:25.146810] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:25.147014] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-08T17:01:25.147052] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-08T17:01:25.147201] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-08T17:01:25.147244] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-08T17:01:25.147289] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-08T17:01:25.147323] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-08T17:01:25.503767] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:25.617538] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-08T17:01:26.323900] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T17:01:26.417606] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-08T17:01:26.474061] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-08T17:01:27.123754] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:01:27.217734] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-08T17:01:27.271362] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:01:28.017576] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-08T17:01:28.433128] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:01:28.436696] [INFO ] [REMOTE ] ACCO: Full fetch complete (53967 records). [2025-10-08T17:01:28.436805] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-08T17:01:28.820992] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-08T17:01:28.820542] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-08T17:01:28.822067] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-08T17:01:28.822629] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-08T17:01:28.822710] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-08T17:01:28.826082] [DEBUG] [LOCAL ] ACCO: Trimmed 53967 records to 37076 (keeping 200 days of data) [2025-10-08T17:01:29.051091] [DEBUG] [LOCAL ] ACCO: Primary data saved (37076 records). [2025-10-08T17:01:29.051307] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-08T17:01:29.051433] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 29.8s. Estimated remaining: 3h 16m 41s. Rate: 12.0 symbols/min [2025-10-08T17:01:29.274311] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:29.326443] [DEBUG] [LOCAL ] ACM: Loaded 43061 existing records from primary storage. [2025-10-08T17:01:29.327058] [INFO ] [MAIN ] ACM: Loaded 43061 existing records. [2025-10-08T17:01:29.515546] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:01:29.515907] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-08T17:01:29.516076] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-08T17:01:29.516508] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-08T17:01:29.516571] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-08T17:01:29.619676] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-08T17:01:29.940174] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:29.934226] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T17:01:29.965584] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:01:30.417620] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-08T17:01:31.217677] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-08T17:01:32.011204] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-08T17:01:32.021826] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-08T17:01:32.113287] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:01:32.526155] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T17:01:32.817568] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-08T17:01:33.233271] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T17:01:33.617686] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-08T17:01:34.368977] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T17:01:34.417540] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-08T17:01:34.697760] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T17:01:35.217610] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-08T17:01:35.990590] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:01:36.017520] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-08T17:01:36.817578] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-08T17:01:37.555179] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T17:01:37.617497] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-08T17:01:37.785555] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-08T17:01:38.373117] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T17:01:38.417562] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-08T17:01:38.834868] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T17:01:39.217612] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-08T17:01:39.616920] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T17:01:40.017534] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-08T17:01:40.197269] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:01:40.199332] [INFO ] [REMOTE ] ACEL: Full fetch complete (38527 records). [2025-10-08T17:01:40.199463] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-08T17:01:40.200280] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:01:40.200371] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:01:40.200415] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:01:40.200484] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-08T17:01:40.200564] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-08T17:01:40.200629] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-08T17:01:40.200918] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-10-08T17:01:40.201031] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 32.0s. Estimated remaining: 3h 29m 58s. Rate: 11.2 symbols/min [2025-10-08T17:01:40.400060] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:40.400280] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-10-08T17:01:40.400320] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-10-08T17:01:40.400440] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-08T17:01:40.400484] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-08T17:01:40.400535] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-08T17:01:40.400604] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-08T17:01:40.828098] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-08T17:01:40.833746] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:41.617561] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-08T17:01:41.771204] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T17:01:42.417587] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-08T17:01:43.190571] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-08T17:01:43.222716] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-08T17:01:43.238551] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:01:43.954693] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T17:01:44.017549] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-08T17:01:44.817580] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-08T17:01:45.097710] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T17:01:45.617556] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-08T17:01:46.347425] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T17:01:46.362834] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-08T17:01:46.417499] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-08T17:01:47.143126] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:01:47.217607] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-08T17:01:48.017613] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-08T17:01:48.736202] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T17:01:48.739866] [INFO ] [REMOTE ] ACI: Full fetch complete (76654 records). [2025-10-08T17:01:48.740050] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-08T17:01:48.741101] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:01:48.741236] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:01:48.741295] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:01:48.741353] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-08T17:01:48.741438] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-08T17:01:48.741476] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-10-08T17:01:48.741516] [DEBUG] [LOCAL ] ACI: No derivative data file found to delete. [2025-10-08T17:01:48.741614] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACI took 23.8s. Estimated remaining: 3h 36m 27s. Rate: 10.9 symbols/min [2025-10-08T17:01:48.819527] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-08T17:01:48.924633] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:48.924840] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-08T17:01:48.925036] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-08T17:01:48.925215] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-08T17:01:48.925425] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-08T17:01:48.925487] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-08T17:01:48.925555] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-08T17:01:49.026445] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-08T17:01:49.335024] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:49.617582] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-08T17:01:49.843070] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T17:01:50.417526] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-08T17:01:50.596318] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T17:01:51.217636] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-08T17:01:52.017581] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-08T17:01:52.240012] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-08T17:01:52.325931] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T17:01:52.708252] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T17:01:52.817564] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-08T17:01:53.236036] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T17:01:53.617555] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-08T17:01:54.406619] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T17:01:54.417509] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-08T17:01:55.226774] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-08T17:01:55.232631] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T17:01:56.017521] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-08T17:01:56.126401] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:01:56.817625] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-08T17:01:56.952520] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T17:01:57.617536] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-08T17:01:58.085984] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T17:01:58.354315] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-08T17:01:58.417567] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-08T17:01:59.217543] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-08T17:01:59.413540] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T17:02:00.017611] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-08T17:02:00.205490] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T17:02:00.817575] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-08T17:02:01.432717] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.02 seconds). [2025-10-08T17:02:01.531687] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:02:01.617568] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-08T17:02:01.740347] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T17:02:02.417561] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-08T17:02:02.939866] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T17:02:03.217596] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-08T17:02:03.847329] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T17:02:04.017572] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-08T17:02:04.817523] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-08T17:02:05.077967] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T17:02:05.079603] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T17:02:05.617607] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-08T17:02:06.287314] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T17:02:06.417562] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-08T17:02:06.969417] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T17:02:07.217618] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-08T17:02:07.657598] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:02:07.662178] [INFO ] [REMOTE ] ACM: Full fetch complete (62495 records). [2025-10-08T17:02:07.662363] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-08T17:02:07.663632] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:02:07.663779] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:02:07.663869] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:02:07.663986] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-08T17:02:07.664101] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-08T17:02:07.664180] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-08T17:02:07.664485] [DEBUG] [LOCAL ] ACM: Deleted derivative data file. [2025-10-08T17:02:07.664617] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACM took 38.6s. Estimated remaining: 4h 2m 37s. Rate: 9.7 symbols/min [2025-10-08T17:02:07.839536] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:07.848535] [DEBUG] [LOCAL ] ACR: Loaded 5692 existing records from primary storage. [2025-10-08T17:02:07.848786] [INFO ] [MAIN ] ACR: Loaded 5692 existing records. [2025-10-08T17:02:08.031898] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-08T17:02:08.038219] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:02:08.039162] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-08T17:02:08.039231] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-08T17:02:08.039495] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-08T17:02:08.039563] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-08T17:02:08.400564] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:08.817593] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-08T17:02:09.418260] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:02:09.574547] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T17:02:09.592426] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-08T17:02:09.596366] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-08T17:02:09.596496] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-08T17:02:09.626690] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-08T17:02:09.998191] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-08T17:02:09.998386] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-08T17:02:09.999126] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-08T17:02:09.999199] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-08T17:02:10.000805] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-08T17:02:10.318392] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-08T17:02:10.318762] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-08T17:02:10.318856] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 52.2s. Estimated remaining: 3h 55m 55s. Rate: 10.0 symbols/min [2025-10-08T17:02:10.419173] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-08T17:02:10.496958] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:10.497162] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-08T17:02:10.497216] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-08T17:02:10.497348] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-08T17:02:10.497399] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-08T17:02:10.497466] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-08T17:02:10.497500] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-08T17:02:10.854465] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:10.870685] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T17:02:11.066712] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T17:02:11.217522] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-08T17:02:12.017597] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-08T17:02:12.817587] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-08T17:02:13.099469] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T17:02:13.272191] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T17:02:13.274872] [INFO ] [REMOTE ] ACP: Full fetch complete (46853 records). [2025-10-08T17:02:13.274988] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-08T17:02:13.624548] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-08T17:02:13.661031] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-08T17:02:13.661133] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-08T17:02:13.661626] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-08T17:02:13.661719] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-08T17:02:13.662952] [DEBUG] [LOCAL ] ACP: Trimmed 46853 records to 31022 (keeping 200 days of data) [2025-10-08T17:02:13.854104] [DEBUG] [LOCAL ] ACP: Primary data saved (31022 records). [2025-10-08T17:02:13.854331] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-08T17:02:13.854457] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACP took 25.1s. Estimated remaining: 3h 51m 23s. Rate: 10.2 symbols/min [2025-10-08T17:02:14.032269] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:14.043915] [DEBUG] [LOCAL ] ACV: Loaded 7506 existing records from primary storage. [2025-10-08T17:02:14.044166] [INFO ] [MAIN ] ACV: Loaded 7506 existing records. [2025-10-08T17:02:14.214595] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T17:02:14.235069] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:02:14.238386] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-08T17:02:14.238580] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-08T17:02:14.238877] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-08T17:02:14.246612] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-08T17:02:14.293978] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T17:02:14.425288] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-08T17:02:14.644038] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:15.217562] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-08T17:02:16.017534] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-08T17:02:16.510665] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-08T17:02:16.637913] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:02:16.732299] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T17:02:16.817821] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-08T17:02:17.548298] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T17:02:17.617559] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-08T17:02:18.417562] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-08T17:02:18.967898] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T17:02:19.217567] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-08T17:02:19.681436] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-08T17:02:19.686552] [INFO ] [REMOTE ] ACN: Full fetch complete (77152 records). [2025-10-08T17:02:19.686994] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-08T17:02:20.022758] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-08T17:02:20.187921] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-08T17:02:20.188053] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-08T17:02:20.188971] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-08T17:02:20.189062] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-08T17:02:20.192039] [DEBUG] [LOCAL ] ACN: Trimmed 77152 records to 53428 (keeping 200 days of data) [2025-10-08T17:02:20.560541] [DEBUG] [LOCAL ] ACN: Primary data saved (53428 records). [2025-10-08T17:02:20.560733] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-08T17:02:20.560840] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACN took 40.4s. Estimated remaining: 3h 52m 39s. Rate: 10.1 symbols/min [2025-10-08T17:02:20.738118] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T17:02:20.777460] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:20.789780] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T17:02:20.794844] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-10-08T17:02:20.795839] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-10-08T17:02:20.796040] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-08T17:02:20.796102] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-08T17:02:20.796153] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-08T17:02:20.796206] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-08T17:02:20.827936] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-08T17:02:21.184973] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:21.486889] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T17:02:21.617567] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-08T17:02:22.144857] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T17:02:22.417606] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-08T17:02:22.866556] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T17:02:23.217562] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-08T17:02:23.635907] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T17:02:24.017585] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-08T17:02:24.621061] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T17:02:24.817625] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-08T17:02:25.617570] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-08T17:02:26.256478] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T17:02:26.417533] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-08T17:02:26.603394] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T17:02:27.217558] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-08T17:02:27.394629] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T17:02:27.787100] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T17:02:28.017606] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-08T17:02:28.578533] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T17:02:28.580082] [INFO ] [REMOTE ] ACR: Full fetch complete (8584 records). [2025-10-08T17:02:28.580203] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-08T17:02:28.827622] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-08T17:02:29.085429] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-08T17:02:29.085542] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-08T17:02:29.085801] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-08T17:02:29.085870] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-08T17:02:29.086575] [DEBUG] [LOCAL ] ACR: Trimmed 8584 records to 5619 (keeping 200 days of data) [2025-10-08T17:02:29.128186] [DEBUG] [LOCAL ] ACR: Primary data saved (5619 records). [2025-10-08T17:02:29.128381] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-08T17:02:29.128489] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 21.5s. Estimated remaining: 3h 56m 49s. Rate: 9.9 symbols/min [2025-10-08T17:02:29.343459] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:29.343740] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-08T17:02:29.343799] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-08T17:02:29.343929] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-08T17:02:29.343973] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-08T17:02:29.344017] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-08T17:02:29.344052] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-08T17:02:29.622724] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-08T17:02:29.758535] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:29.759028] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T17:02:30.417577] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-08T17:02:30.952227] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T17:02:31.191511] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T17:02:31.217509] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-08T17:02:31.927070] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T17:02:32.017615] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-08T17:02:32.469824] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T17:02:32.817606] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-08T17:02:33.617601] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-08T17:02:34.370088] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:02:34.417610] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-08T17:02:35.029420] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:02:35.150297] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:02:35.217601] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-08T17:02:36.017694] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-08T17:02:36.206794] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:02:36.207120] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-08T17:02:36.207208] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:02:36.207254] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-08T17:02:36.207314] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:02:36.207386] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-08T17:02:36.207450] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-08T17:02:36.207487] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-08T17:02:36.207543] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-08T17:02:36.207612] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 7.1s. Estimated remaining: 3h 58m 19s. Rate: 9.8 symbols/min [2025-10-08T17:02:36.388924] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:36.389152] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-08T17:02:36.389208] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-08T17:02:36.389319] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-08T17:02:36.389362] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-08T17:02:36.389404] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-08T17:02:36.389441] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-08T17:02:36.773804] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:36.817579] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-08T17:02:37.093391] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:02:37.617579] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-08T17:02:38.426289] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-08T17:02:38.433137] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:02:39.217582] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-08T17:02:39.237105] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T17:02:39.316375] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:02:40.017595] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-08T17:02:40.434424] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T17:02:40.656433] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T17:02:40.657852] [INFO ] [REMOTE ] ACV: Full fetch complete (10105 records). [2025-10-08T17:02:40.657931] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-08T17:02:40.658515] [FATAL] [VALIDATOR ] ACV: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:02:40.658603] [FATAL] [MAIN ] ACV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:02:40.658666] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:02:40.658750] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-08T17:02:40.658855] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-08T17:02:40.658928] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-10-08T17:02:40.659374] [DEBUG] [LOCAL ] ACV: Deleted derivative data file. [2025-10-08T17:02:40.659513] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACV took 26.8s. Estimated remaining: 3h 55m 45s. Rate: 9.9 symbols/min [2025-10-08T17:02:40.819414] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-08T17:02:40.841417] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:40.842333] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-08T17:02:40.842395] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-08T17:02:40.842510] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-08T17:02:40.842554] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-08T17:02:40.842595] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-08T17:02:40.842626] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-08T17:02:41.214747] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:41.617637] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-08T17:02:42.417595] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-08T17:02:42.505316] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:02:43.217512] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-08T17:02:43.356678] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:02:43.419678] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T17:02:44.017574] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-08T17:02:44.789330] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T17:02:44.817531] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-08T17:02:45.001582] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T17:02:45.617609] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-08T17:02:46.417609] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-08T17:02:46.609985] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:02:47.180624] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:02:47.217551] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-08T17:02:47.439111] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:02:48.017571] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-08T17:02:48.817543] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-08T17:02:48.954582] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:02:49.387905] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T17:02:49.617599] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-08T17:02:50.145662] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T17:02:50.417560] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-08T17:02:50.721889] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:02:51.217549] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-08T17:02:51.815833] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T17:02:52.017620] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-08T17:02:52.458996] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:02:52.463142] [INFO ] [REMOTE ] ACRE: Full fetch complete (50356 records). [2025-10-08T17:02:52.463359] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-08T17:02:52.822673] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-08T17:02:52.915000] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-08T17:02:52.915103] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-08T17:02:52.915624] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-08T17:02:52.915699] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-08T17:02:52.916979] [DEBUG] [LOCAL ] ACRE: Trimmed 50356 records to 33676 (keeping 200 days of data) [2025-10-08T17:02:53.120004] [DEBUG] [LOCAL ] ACRE: Primary data saved (33676 records). [2025-10-08T17:02:53.120189] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-08T17:02:53.120274] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACRE took 42.8s. Estimated remaining: 4h 4m 57s. Rate: 9.6 symbols/min [2025-10-08T17:02:53.294192] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:53.348201] [DEBUG] [LOCAL ] ADM: Loaded 53390 existing records from primary storage. [2025-10-08T17:02:53.348704] [INFO ] [MAIN ] ADM: Loaded 53390 existing records. [2025-10-08T17:02:53.533025] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:02:53.533264] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-08T17:02:53.533319] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-08T17:02:53.533891] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-08T17:02:53.533952] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-08T17:02:53.631175] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-08T17:02:53.898297] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:02:53.942461] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:53.965736] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T17:02:54.417597] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-08T17:02:55.217526] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-08T17:02:55.380852] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T17:02:55.408822] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T17:02:56.017610] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-08T17:02:56.709583] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T17:02:56.817621] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-08T17:02:57.583484] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:02:57.617599] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-08T17:02:57.909678] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:02:58.417690] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-08T17:02:59.133426] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T17:02:59.217638] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-08T17:03:00.017530] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-08T17:03:00.133519] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T17:03:00.817539] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-08T17:03:00.902383] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:03:00.905870] [INFO ] [REMOTE ] ACVA: Full fetch complete (70176 records). [2025-10-08T17:03:00.906016] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-08T17:03:00.906792] [FATAL] [VALIDATOR ] ACVA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:03:00.906887] [FATAL] [MAIN ] ACVA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:03:00.906929] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:03:00.906967] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-08T17:03:00.907052] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-08T17:03:00.907106] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-10-08T17:03:00.907149] [DEBUG] [LOCAL ] ACVA: No derivative data file found to delete. [2025-10-08T17:03:00.907207] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 40.3s. Estimated remaining: 4h 6m 58s. Rate: 9.5 symbols/min [2025-10-08T17:03:01.080227] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:01.128969] [DEBUG] [LOCAL ] ADNT: Loaded 47253 existing records from primary storage. [2025-10-08T17:03:01.129333] [INFO ] [MAIN ] ADNT: Loaded 47253 existing records. [2025-10-08T17:03:01.307404] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:01.307678] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-08T17:03:01.307736] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-08T17:03:01.308117] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-08T17:03:01.308185] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-08T17:03:01.624474] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-08T17:03:01.666102] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:02.315613] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T17:03:02.417535] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-08T17:03:02.555508] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-08T17:03:03.217602] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-08T17:03:03.653621] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T17:03:03.737504] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-08T17:03:04.017600] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-08T17:03:04.781690] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T17:03:04.817632] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-08T17:03:05.617575] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-08T17:03:06.182458] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-08T17:03:06.224973] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:03:06.417569] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-08T17:03:07.217576] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-08T17:03:07.295438] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T17:03:08.017630] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-08T17:03:08.612013] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-08T17:03:08.791521] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T17:03:08.817581] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-08T17:03:09.244600] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:03:09.249761] [INFO ] [REMOTE ] ADC: Full fetch complete (66246 records). [2025-10-08T17:03:09.249985] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-08T17:03:09.625007] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-08T17:03:09.668697] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-08T17:03:09.668817] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-08T17:03:09.669491] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-08T17:03:09.669555] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-08T17:03:09.671069] [DEBUG] [LOCAL ] ADC: Trimmed 66246 records to 46168 (keeping 200 days of data) [2025-10-08T17:03:09.967878] [DEBUG] [LOCAL ] ADC: Primary data saved (46168 records). [2025-10-08T17:03:09.968043] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-08T17:03:09.968122] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 33.8s. Estimated remaining: 4h 10m 32s. Rate: 9.3 symbols/min [2025-10-08T17:03:10.145109] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:10.145344] [DEBUG] [LOCAL ] ADT: No existing data file found in primary storage. [2025-10-08T17:03:10.145406] [WARN ] [MAIN ] ADT: No existing data found, performing full refresh instead. [2025-10-08T17:03:10.145701] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-08T17:03:10.145824] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-08T17:03:10.145985] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-08T17:03:10.146097] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-08T17:03:10.433980] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-08T17:03:10.449152] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:03:10.585681] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:11.126247] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T17:03:11.217566] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-08T17:03:12.020720] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-08T17:03:12.023759] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T17:03:12.780448] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:03:12.817516] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-08T17:03:13.617524] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-08T17:03:13.658818] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T17:03:14.283364] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T17:03:14.417588] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-08T17:03:15.217689] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-08T17:03:15.313350] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:03:15.858751] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T17:03:16.017604] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-08T17:03:16.786204] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T17:03:16.817538] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-08T17:03:17.617577] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-08T17:03:17.869615] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T17:03:18.319294] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:03:18.417611] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-08T17:03:18.768520] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:03:18.772493] [INFO ] [REMOTE ] ADCT: Full fetch complete (51456 records). [2025-10-08T17:03:18.772695] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-08T17:03:19.170538] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-08T17:03:19.170677] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-08T17:03:19.171218] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-08T17:03:19.171264] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-08T17:03:19.172572] [DEBUG] [LOCAL ] ADCT: Trimmed 51456 records to 35096 (keeping 200 days of data) [2025-10-08T17:03:19.223076] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-08T17:03:19.384466] [DEBUG] [LOCAL ] ADCT: Primary data saved (35096 records). [2025-10-08T17:03:19.384670] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-08T17:03:19.384788] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADCT took 38.7s. Estimated remaining: 4h 14m 20s. Rate: 9.2 symbols/min [2025-10-08T17:03:19.556946] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:19.583471] [DEBUG] [LOCAL ] ADX: Loaded 27503 existing records from primary storage. [2025-10-08T17:03:19.583792] [INFO ] [MAIN ] ADX: Loaded 27503 existing records. [2025-10-08T17:03:19.769978] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:19.770312] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-08T17:03:19.770373] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-08T17:03:19.770825] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-08T17:03:19.770883] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-08T17:03:20.028529] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-08T17:03:20.152610] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:20.546300] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-08T17:03:20.817616] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-08T17:03:21.206166] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T17:03:21.617751] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-08T17:03:22.006690] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T17:03:22.212676] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T17:03:22.417578] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-08T17:03:23.217570] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-08T17:03:23.505852] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:03:23.820600] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T17:03:24.017560] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-08T17:03:24.484364] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T17:03:24.817597] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-08T17:03:25.374169] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:03:25.617584] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-08T17:03:26.417621] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-08T17:03:26.501012] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T17:03:27.217532] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-08T17:03:27.274973] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T17:03:28.017637] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-08T17:03:28.486961] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T17:03:28.555919] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:03:28.817597] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-08T17:03:29.275292] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T17:03:29.617584] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-08T17:03:29.716590] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T17:03:30.417631] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-08T17:03:31.217624] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-08T17:03:31.623180] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-08T17:03:31.629147] [INFO ] [REMOTE ] ADM: Full fetch complete (77259 records). [2025-10-08T17:03:31.629351] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-08T17:03:32.026688] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-08T17:03:32.069590] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-08T17:03:32.069782] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-08T17:03:32.070600] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-08T17:03:32.070843] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-08T17:03:32.086564] [DEBUG] [LOCAL ] ADM: Trimmed 77259 records to 53388 (keeping 200 days of data) [2025-10-08T17:03:32.112299] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T17:03:32.454041] [DEBUG] [LOCAL ] ADM: Primary data saved (53388 records). [2025-10-08T17:03:32.454213] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-08T17:03:32.454302] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 39.3s. Estimated remaining: 4h 22m 28s. Rate: 8.9 symbols/min [2025-10-08T17:03:32.630318] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:32.667671] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T17:03:32.714012] [DEBUG] [LOCAL ] AEE: Loaded 50121 existing records from primary storage. [2025-10-08T17:03:32.714367] [INFO ] [MAIN ] AEE: Loaded 50121 existing records. [2025-10-08T17:03:32.818457] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-08T17:03:32.901415] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:32.901701] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-08T17:03:32.901760] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-08T17:03:32.902298] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-08T17:03:32.902357] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-08T17:03:33.265989] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:33.281962] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:03:33.617728] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-08T17:03:34.362295] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T17:03:34.366312] [INFO ] [REMOTE ] ADNT: Full fetch complete (67993 records). [2025-10-08T17:03:34.366474] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-08T17:03:34.423045] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-08T17:03:34.790346] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-08T17:03:34.790482] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-08T17:03:34.791207] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-08T17:03:34.791272] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-08T17:03:34.793186] [DEBUG] [LOCAL ] ADNT: Trimmed 67993 records to 47191 (keeping 200 days of data) [2025-10-08T17:03:35.091220] [DEBUG] [LOCAL ] ADNT: Primary data saved (47191 records). [2025-10-08T17:03:35.091584] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-08T17:03:35.091702] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 34.2s. Estimated remaining: 4h 17m 22s. Rate: 9.1 symbols/min [2025-10-08T17:03:35.217797] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-08T17:03:35.277068] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:35.288763] [DEBUG] [LOCAL ] AEFC: Loaded 8446 existing records from primary storage. [2025-10-08T17:03:35.289728] [INFO ] [MAIN ] AEFC: Loaded 8446 existing records. [2025-10-08T17:03:35.474682] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:35.475194] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-08T17:03:35.496838] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-08T17:03:35.520822] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-08T17:03:35.521068] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-08T17:03:35.548996] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T17:03:35.955929] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:36.005809] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:03:36.017500] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-08T17:03:36.544329] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T17:03:36.817566] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-08T17:03:37.423547] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:03:37.617528] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-08T17:03:37.756706] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T17:03:38.417570] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-08T17:03:39.223040] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-08T17:03:39.237768] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T17:03:39.967058] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T17:03:40.017564] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-08T17:03:40.113613] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T17:03:40.817558] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-08T17:03:41.617617] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-08T17:03:41.925707] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T17:03:42.244547] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:03:42.375365] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T17:03:42.417571] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-08T17:03:43.053135] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T17:03:43.217577] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-08T17:03:44.017596] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-08T17:03:44.634291] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T17:03:44.817577] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-08T17:03:44.902580] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T17:03:45.294771] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T17:03:45.617554] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-08T17:03:46.417573] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-08T17:03:46.841528] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:03:47.217577] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-08T17:03:47.930276] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T17:03:47.937777] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T17:03:48.017556] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-08T17:03:48.817624] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-08T17:03:49.301483] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T17:03:49.521076] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T17:03:49.617563] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-08T17:03:50.417680] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-08T17:03:50.815446] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T17:03:50.818108] [INFO ] [REMOTE ] ADX: Full fetch complete (41888 records). [2025-10-08T17:03:50.818248] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-08T17:03:51.228130] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-08T17:03:51.225557] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-08T17:03:51.228298] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-08T17:03:51.229875] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-08T17:03:51.229943] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-08T17:03:51.231114] [DEBUG] [LOCAL ] ADX: Trimmed 41888 records to 27572 (keeping 200 days of data) [2025-10-08T17:03:51.406187] [DEBUG] [LOCAL ] ADX: Primary data saved (27572 records). [2025-10-08T17:03:51.406342] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-08T17:03:51.406460] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 32.0s. Estimated remaining: 4h 28m 44s. Rate: 8.7 symbols/min [2025-10-08T17:03:51.585310] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:51.635130] [DEBUG] [LOCAL ] AEG: Loaded 49613 existing records from primary storage. [2025-10-08T17:03:51.635534] [INFO ] [MAIN ] AEG: Loaded 49613 existing records. [2025-10-08T17:03:51.828268] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:51.828570] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-08T17:03:51.828672] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-08T17:03:51.829044] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-08T17:03:51.829124] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-08T17:03:52.032691] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-08T17:03:52.065226] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T17:03:52.191780] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-08T17:03:52.241928] [INFO ] [REMOTE ] ADT: Full fetch complete (77186 records). [2025-10-08T17:03:52.264435] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-08T17:03:52.264325] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:52.685952] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-08T17:03:52.686058] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-08T17:03:52.686832] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-08T17:03:52.686904] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-08T17:03:52.688690] [DEBUG] [LOCAL ] ADT: Trimmed 77186 records to 53446 (keeping 200 days of data) [2025-10-08T17:03:52.817793] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-08T17:03:53.035541] [DEBUG] [LOCAL ] ADT: Primary data saved (53446 records). [2025-10-08T17:03:53.035756] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-08T17:03:53.035863] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADT took 43.1s. Estimated remaining: 4h 22m 35s. Rate: 8.9 symbols/min [2025-10-08T17:03:53.227620] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:53.288314] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-10-08T17:03:53.288760] [INFO ] [MAIN ] AEM: Loaded 53464 existing records. [2025-10-08T17:03:53.513888] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:53.514173] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-08T17:03:53.514222] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-08T17:03:53.514881] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-08T17:03:53.514938] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-08T17:03:53.619975] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-08T17:03:53.646265] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T17:03:53.973588] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:54.051738] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T17:03:54.417733] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-08T17:03:55.169053] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:03:55.217574] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-08T17:03:55.812249] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T17:03:55.813434] [INFO ] [REMOTE ] AEFC: Full fetch complete (11986 records). [2025-10-08T17:03:55.813506] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-08T17:03:56.018135] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-08T17:03:56.293311] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-08T17:03:56.293521] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-08T17:03:56.293817] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-08T17:03:56.293977] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-08T17:03:56.294724] [DEBUG] [LOCAL ] AEFC: Trimmed 11986 records to 8446 (keeping 200 days of data) [2025-10-08T17:03:56.368037] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T17:03:56.395204] [DEBUG] [LOCAL ] AEFC: Primary data saved (8446 records). [2025-10-08T17:03:56.395350] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-08T17:03:56.395472] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 21.3s. Estimated remaining: 4h 18m 42s. Rate: 9.0 symbols/min [2025-10-08T17:03:56.599670] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:56.663435] [DEBUG] [LOCAL ] AEO: Loaded 53560 existing records from primary storage. [2025-10-08T17:03:56.663844] [INFO ] [MAIN ] AEO: Loaded 53560 existing records. [2025-10-08T17:03:56.822766] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-08T17:03:56.901027] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:56.901289] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-08T17:03:56.901353] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-08T17:03:56.902322] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-08T17:03:56.902390] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-08T17:03:57.357863] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:57.596685] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T17:03:57.617532] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-08T17:03:58.211610] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T17:03:58.417624] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-08T17:03:59.156169] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:03:59.217543] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-08T17:04:00.017591] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-08T17:04:00.236831] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T17:04:00.817512] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-08T17:04:00.976303] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T17:04:01.424121] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:04:01.617604] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-08T17:04:02.417595] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-08T17:04:02.671760] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T17:04:03.217603] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-08T17:04:03.369799] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T17:04:04.017711] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-08T17:04:04.559764] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-08T17:04:04.817611] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-08T17:04:04.912002] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:04:05.417139] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T17:04:05.617538] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-08T17:04:06.184318] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T17:04:06.417559] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-08T17:04:07.217564] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-08T17:04:07.450965] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T17:04:08.017578] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-08T17:04:08.131057] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T17:04:08.675256] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T17:04:08.817590] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-08T17:04:09.617550] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-08T17:04:09.941856] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T17:04:10.314433] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T17:04:10.417575] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-08T17:04:10.878214] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T17:04:10.882375] [INFO ] [REMOTE ] AEE: Full fetch complete (72342 records). [2025-10-08T17:04:10.882537] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-08T17:04:10.883962] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:04:10.884103] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:04:10.884151] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:04:10.884249] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-08T17:04:10.884395] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-08T17:04:10.884453] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-08T17:04:10.884755] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-10-08T17:04:10.884859] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 38.4s. Estimated remaining: 4h 27m 4s. Rate: 8.7 symbols/min [2025-10-08T17:04:11.052743] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:11.106902] [DEBUG] [LOCAL ] AER: Loaded 48272 existing records from primary storage. [2025-10-08T17:04:11.107239] [INFO ] [MAIN ] AER: Loaded 48272 existing records. [2025-10-08T17:04:11.222730] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-08T17:04:11.293740] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:11.294360] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-08T17:04:11.294421] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-08T17:04:11.294753] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-08T17:04:11.294810] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-08T17:04:11.657781] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:11.993795] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T17:04:12.017496] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-08T17:04:12.817620] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-08T17:04:13.321071] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-08T17:04:13.617729] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-08T17:04:13.944738] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T17:04:14.417571] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-08T17:04:14.809747] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T17:04:15.047845] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T17:04:15.217567] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-08T17:04:15.895780] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T17:04:16.017573] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-08T17:04:16.817571] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-08T17:04:17.137314] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T17:04:17.617574] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-08T17:04:17.780137] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T17:04:18.027689] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T17:04:18.417575] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-08T17:04:19.217678] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-08T17:04:19.663087] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-08T17:04:20.017707] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-08T17:04:20.021351] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T17:04:20.818692] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-08T17:04:20.834412] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T17:04:21.617693] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-08T17:04:21.907553] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T17:04:22.417587] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-08T17:04:22.699625] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:04:23.167065] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T17:04:23.217621] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-08T17:04:23.745704] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:04:23.749576] [INFO ] [REMOTE ] AEG: Full fetch complete (69953 records). [2025-10-08T17:04:23.749758] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-08T17:04:23.751140] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:04:23.751232] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:04:23.751278] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:04:23.751322] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-08T17:04:23.751443] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-08T17:04:23.751502] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-10-08T17:04:23.751960] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-10-08T17:04:23.753450] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 32.3s. Estimated remaining: 4h 33m 16s. Rate: 8.5 symbols/min [2025-10-08T17:04:24.017631] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-08T17:04:24.817581] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-08T17:04:25.223614] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T17:04:25.617561] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-08T17:04:26.067611] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T17:04:26.417517] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-08T17:04:26.794011] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-08T17:04:26.797982] [INFO ] [REMOTE ] AEM: Full fetch complete (77193 records). [2025-10-08T17:04:26.798091] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-08T17:04:27.256295] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-08T17:04:27.256509] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-08T17:04:27.257622] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-08T17:04:27.257740] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-08T17:04:27.294184] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:04:27.292805] [DEBUG] [LOCAL ] AEM: Trimmed 77193 records to 53466 (keeping 200 days of data) [2025-10-08T17:04:27.308215] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-08T17:04:27.708798] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T17:04:27.732218] [DEBUG] [LOCAL ] AEM: Primary data saved (53466 records). [2025-10-08T17:04:27.732449] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-08T17:04:27.733945] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 34.7s. Estimated remaining: 4h 30m 2s. Rate: 8.6 symbols/min [2025-10-08T17:04:28.017572] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-08T17:04:29.279700] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T17:04:29.293081] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-08T17:04:29.579578] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:04:29.617567] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-08T17:04:31.083851] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:04:31.094764] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-08T17:04:31.483121] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-08T17:04:31.494740] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-08T17:04:32.350301] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T17:04:32.360542] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-08T17:04:33.596421] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T17:04:33.613303] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-08T17:04:34.068269] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T17:04:34.078381] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-08T17:04:35.389852] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:04:35.394054] [INFO ] [REMOTE ] AER: Full fetch complete (69583 records). [2025-10-08T17:04:35.394206] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-08T17:04:35.801952] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-08T17:04:35.811404] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-08T17:04:35.813180] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-08T17:04:35.812738] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-08T17:04:35.816555] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-08T17:04:35.817823] [INFO ] [REMOTE ] AEO: Full fetch complete (77446 records). [2025-10-08T17:04:35.818109] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-08T17:04:35.818231] [DEBUG] [LOCAL ] AER: Trimmed 69583 records to 48212 (keeping 200 days of data) [2025-10-08T17:04:36.336844] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-08T17:04:36.337548] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-08T17:04:36.338976] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-08T17:04:36.339088] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-08T17:04:36.343780] [DEBUG] [LOCAL ] AEO: Trimmed 77446 records to 53563 (keeping 200 days of data) [2025-10-08T17:04:36.877917] [DEBUG] [LOCAL ] AER: Primary data saved (48212 records). [2025-10-08T17:04:36.878120] [INFO ] [MAIN ] AER: Full history saved. [2025-10-08T17:04:36.878267] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 26.0s. Estimated remaining: 4h 32m 7s. Rate: 8.6 symbols/min [2025-10-08T17:04:36.931037] [DEBUG] [LOCAL ] AEO: Primary data saved (53563 records). [2025-10-08T17:04:36.931284] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-08T17:04:36.931405] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 40.5s. Estimated remaining: 4h 25m 15s. Rate: 8.8 symbols/min [2025-10-08T17:04:37.698398] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:37.616375] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:37.701815] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:37.726403] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:37.727631] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-08T17:04:37.727932] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-08T17:04:37.728502] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-08T17:04:37.728589] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-08T17:04:37.728671] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-08T17:04:37.728739] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-08T17:04:37.878488] [DEBUG] [LOCAL ] AFB: Loaded 11472 existing records from primary storage. [2025-10-08T17:04:37.890416] [INFO ] [MAIN ] AFB: Loaded 11472 existing records. [2025-10-08T17:04:38.299329] [DEBUG] [LOCAL ] AESI: Loaded 49549 existing records from primary storage. [2025-10-08T17:04:38.348548] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:38.342690] [INFO ] [MAIN ] AESI: Loaded 49549 existing records. [2025-10-08T17:04:38.342781] [DEBUG] [LOCAL ] AES: Loaded 53671 existing records from primary storage. [2025-10-08T17:04:38.359175] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-08T17:04:38.403622] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-08T17:04:38.403741] [INFO ] [MAIN ] AES: Loaded 53671 existing records. [2025-10-08T17:04:38.441430] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-08T17:04:38.478530] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:38.495468] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-08T17:04:38.495565] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-08T17:04:38.774990] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:04:38.867979] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:38.826781] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-08T17:04:38.925313] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:04:38.959146] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-08T17:04:38.959057] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:38.969759] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-08T17:04:38.925546] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-08T17:04:38.986581] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-08T17:04:39.026766] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:04:39.012309] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-08T17:04:39.026630] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-08T17:04:39.066193] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-08T17:04:39.071552] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-08T17:04:39.092564] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-08T17:04:39.111329] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-08T17:04:39.135956] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-08T17:04:39.132742] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-08T17:04:39.185464] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-08T17:04:39.242023] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.3s. Estimated remaining: 4h 20m 52s. Rate: 8.9 symbols/min [2025-10-08T17:04:39.471712] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:39.577999] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-08T17:04:39.760854] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:40.060359] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:40.118944] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-08T17:04:40.124177] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:40.125306] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-08T17:04:40.126243] [DEBUG] [LOCAL ] AFG: Loaded 32272 existing records from primary storage. [2025-10-08T17:04:40.127102] [INFO ] [MAIN ] AFG: Loaded 32272 existing records. [2025-10-08T17:04:40.311034] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:40.311240] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-08T17:04:40.311287] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-08T17:04:40.311669] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-08T17:04:40.311728] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-08T17:04:40.470246] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T17:04:40.507673] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-08T17:04:40.682798] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:40.683152] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-08T17:04:41.244321] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T17:04:41.247425] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-08T17:04:41.826372] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T17:04:41.829415] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-08T17:04:41.865853] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:04:41.875187] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-08T17:04:41.937612] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T17:04:41.943327] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-08T17:04:42.118493] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T17:04:42.417580] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-08T17:04:42.785180] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:04:42.785557] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T17:04:42.991779] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:04:43.217570] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-08T17:04:44.017511] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-08T17:04:44.131395] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:04:44.660408] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T17:04:44.817554] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-08T17:04:45.551035] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T17:04:45.617503] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-08T17:04:45.994875] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T17:04:46.417526] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-08T17:04:47.217507] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-08T17:04:47.252412] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:04:47.300418] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T17:04:48.017701] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-08T17:04:48.817586] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-08T17:04:49.296895] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-08T17:04:49.376030] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T17:04:49.617600] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-08T17:04:50.417577] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-08T17:04:50.510948] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:04:51.217540] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-08T17:04:51.352984] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T17:04:51.564840] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T17:04:52.017566] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-08T17:04:52.276952] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:04:52.817596] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-08T17:04:52.846892] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T17:04:53.617624] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-08T17:04:54.417600] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-08T17:04:54.646426] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T17:04:54.957948] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T17:04:55.217592] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-08T17:04:55.765905] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T17:04:56.017554] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-08T17:04:56.146734] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T17:04:56.817588] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-08T17:04:57.617525] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-08T17:04:57.652235] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:04:58.417583] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-08T17:04:58.703191] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T17:04:58.940333] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T17:04:59.217623] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-08T17:05:00.021063] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-08T17:05:00.024802] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T17:05:00.518970] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:05:00.817593] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-08T17:05:00.899322] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T17:05:01.617800] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-08T17:05:02.417530] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-08T17:05:02.535743] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T17:05:03.217701] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-08T17:05:03.745943] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-08T17:05:03.806084] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:05:03.810062] [INFO ] [REMOTE ] AFG: Full fetch complete (46217 records). [2025-10-08T17:05:03.810259] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-08T17:05:04.026281] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-08T17:05:04.257911] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-08T17:05:04.258209] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-08T17:05:04.258783] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-08T17:05:04.258851] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-08T17:05:04.260308] [DEBUG] [LOCAL ] AFG: Trimmed 46217 records to 32197 (keeping 200 days of data) [2025-10-08T17:05:04.468947] [DEBUG] [LOCAL ] AFG: Primary data saved (32197 records). [2025-10-08T17:05:04.469129] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-08T17:05:04.469220] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFG took 25.2s. Estimated remaining: 4h 37m 51s. Rate: 8.4 symbols/min [2025-10-08T17:05:04.653875] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:04.659227] [DEBUG] [LOCAL ] AFGB: Loaded 2311 existing records from primary storage. [2025-10-08T17:05:04.659584] [INFO ] [MAIN ] AFGB: Loaded 2311 existing records. [2025-10-08T17:05:04.821225] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-08T17:05:04.859117] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:04.860706] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-08T17:05:04.860819] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-08T17:05:04.861055] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-08T17:05:04.861512] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-08T17:05:05.001453] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T17:05:05.350187] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:05.617606] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-08T17:05:05.717275] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T17:05:06.221283] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-08T17:05:06.417593] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-08T17:05:07.217628] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-08T17:05:07.267511] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T17:05:07.272319] [INFO ] [REMOTE ] AESI: Full fetch complete (70668 records). [2025-10-08T17:05:07.272565] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-08T17:05:07.715089] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-08T17:05:07.715183] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-08T17:05:07.715887] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-08T17:05:07.715951] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-08T17:05:07.717509] [DEBUG] [LOCAL ] AESI: Trimmed 70668 records to 49557 (keeping 200 days of data) [2025-10-08T17:05:08.027113] [DEBUG] [LOCAL ] AESI: Primary data saved (49557 records). [2025-10-08T17:05:08.027310] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-08T17:05:08.023741] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-08T17:05:08.029413] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 31.1s. Estimated remaining: 4h 34m 29s. Rate: 8.5 symbols/min [2025-10-08T17:05:08.081366] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T17:05:08.225709] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:08.274474] [DEBUG] [LOCAL ] AFGC: Loaded 2546 existing records from primary storage. [2025-10-08T17:05:08.276201] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T17:05:08.287438] [INFO ] [MAIN ] AFGC: Loaded 2546 existing records. [2025-10-08T17:05:08.469239] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:08.469520] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-08T17:05:08.469575] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-08T17:05:08.469794] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-08T17:05:08.469855] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-08T17:05:08.832957] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:08.828143] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-08T17:05:09.074149] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T17:05:09.617895] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-08T17:05:10.238818] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T17:05:10.417584] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-08T17:05:10.670277] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:05:10.893246] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T17:05:11.217559] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-08T17:05:11.969592] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T17:05:11.971817] [INFO ] [REMOTE ] AFB: Full fetch complete (16570 records). [2025-10-08T17:05:11.971970] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-08T17:05:12.022705] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-08T17:05:12.397526] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-08T17:05:12.397623] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-08T17:05:12.397955] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-08T17:05:12.398039] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-08T17:05:12.398871] [DEBUG] [LOCAL ] AFB: Trimmed 16570 records to 11448 (keeping 200 days of data) [2025-10-08T17:05:12.481535] [DEBUG] [LOCAL ] AFB: Primary data saved (11448 records). [2025-10-08T17:05:12.481760] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-08T17:05:12.481889] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFB took 35.5s. Estimated remaining: 4h 32m 4s. Rate: 8.6 symbols/min [2025-10-08T17:05:12.695112] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:12.700135] [DEBUG] [LOCAL ] AFGD: Loaded 1808 existing records from primary storage. [2025-10-08T17:05:12.700409] [INFO ] [MAIN ] AFGD: Loaded 1808 existing records. [2025-10-08T17:05:12.823056] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-08T17:05:12.939529] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:12.939917] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-08T17:05:12.939979] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-08T17:05:12.940238] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-08T17:05:12.940297] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-08T17:05:13.375268] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T17:05:13.380959] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:13.617553] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-08T17:05:14.054526] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-08T17:05:14.058590] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-08T17:05:14.058734] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-08T17:05:14.161792] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T17:05:14.425949] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-08T17:05:14.488901] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-08T17:05:14.488989] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-08T17:05:14.489847] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-08T17:05:14.490224] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-08T17:05:14.492220] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53671 (keeping 200 days of data) [2025-10-08T17:05:14.813505] [DEBUG] [LOCAL ] AES: Primary data saved (53671 records). [2025-10-08T17:05:14.813670] [INFO ] [MAIN ] AES: Full history saved. [2025-10-08T17:05:14.813777] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AES took 37.9s. Estimated remaining: 4h 27m 54s. Rate: 8.7 symbols/min [2025-10-08T17:05:15.003785] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:15.008587] [DEBUG] [LOCAL ] AFGE: Loaded 2430 existing records from primary storage. [2025-10-08T17:05:15.008831] [INFO ] [MAIN ] AFGE: Loaded 2430 existing records. [2025-10-08T17:05:15.199748] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:15.200015] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-08T17:05:15.200063] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-08T17:05:15.200261] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-08T17:05:15.200317] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-08T17:05:15.222609] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-08T17:05:15.263044] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:05:15.582366] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:15.738293] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T17:05:16.017598] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-08T17:05:16.598839] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T17:05:16.817565] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-08T17:05:17.271785] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T17:05:17.617562] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-08T17:05:18.046152] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T17:05:18.417576] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-08T17:05:18.965621] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T17:05:19.217556] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-08T17:05:19.616374] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-08T17:05:20.017600] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-08T17:05:20.656569] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:05:20.817591] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-08T17:05:21.241252] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T17:05:21.617552] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-08T17:05:22.072240] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T17:05:22.417565] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-08T17:05:22.753209] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-08T17:05:23.217583] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-08T17:05:23.674086] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:05:24.017567] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-08T17:05:24.474270] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T17:05:24.817581] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-08T17:05:25.310612] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T17:05:25.617559] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-08T17:05:25.993346] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T17:05:26.417557] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-08T17:05:26.984284] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T17:05:27.217550] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-08T17:05:27.725317] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-08T17:05:28.017572] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-08T17:05:28.484086] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T17:05:28.817548] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-08T17:05:29.403895] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T17:05:29.617610] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-08T17:05:30.169917] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T17:05:30.417608] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-08T17:05:31.217554] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-08T17:05:31.308453] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T17:05:31.788819] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T17:05:32.017605] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-08T17:05:32.442531] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T17:05:32.817557] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-08T17:05:33.282846] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T17:05:33.617556] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-08T17:05:34.059393] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T17:05:34.417554] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-08T17:05:34.841933] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T17:05:35.217589] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-08T17:05:35.669120] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T17:05:36.017568] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-08T17:05:36.561481] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T17:05:36.562254] [INFO ] [REMOTE ] AFGC: Full fetch complete (3701 records). [2025-10-08T17:05:36.562323] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-08T17:05:36.823888] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-08T17:05:36.973829] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-08T17:05:36.973914] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-08T17:05:36.974064] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-08T17:05:36.974125] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-08T17:05:36.974474] [DEBUG] [LOCAL ] AFGC: Trimmed 3701 records to 2549 (keeping 200 days of data) [2025-10-08T17:05:36.990104] [DEBUG] [LOCAL ] AFGC: Primary data saved (2549 records). [2025-10-08T17:05:36.990176] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-08T17:05:36.990252] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGC took 29.0s. Estimated remaining: 4h 40m 39s. Rate: 8.3 symbols/min [2025-10-08T17:05:37.155963] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:37.156170] [DEBUG] [LOCAL ] AFL: No existing data file found in primary storage. [2025-10-08T17:05:37.156207] [WARN ] [MAIN ] AFL: No existing data found, performing full refresh instead. [2025-10-08T17:05:37.156357] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-08T17:05:37.156400] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-08T17:05:37.156457] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-08T17:05:37.156491] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-08T17:05:37.494564] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T17:05:37.615432] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:37.617495] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-08T17:05:38.417560] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-08T17:05:38.967156] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:05:39.193481] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:05:39.217500] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-08T17:05:40.017554] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-08T17:05:40.470383] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T17:05:40.817535] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-08T17:05:40.878781] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T17:05:41.183101] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T17:05:41.183860] [INFO ] [REMOTE ] AFGE: Full fetch complete (3460 records). [2025-10-08T17:05:41.183935] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-08T17:05:41.534863] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-08T17:05:41.534943] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-08T17:05:41.535060] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-08T17:05:41.535097] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-08T17:05:41.535434] [DEBUG] [LOCAL ] AFGE: Trimmed 3460 records to 2427 (keeping 200 days of data) [2025-10-08T17:05:41.550833] [DEBUG] [LOCAL ] AFGE: Primary data saved (2427 records). [2025-10-08T17:05:41.550902] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-08T17:05:41.550971] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGE took 26.7s. Estimated remaining: 4h 38m 19s. Rate: 8.4 symbols/min [2025-10-08T17:05:41.622783] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-08T17:05:41.722898] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:41.778519] [DEBUG] [LOCAL ] AG: Loaded 53642 existing records from primary storage. [2025-10-08T17:05:41.779104] [INFO ] [MAIN ] AG: Loaded 53642 existing records. [2025-10-08T17:05:41.962595] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:41.962932] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-08T17:05:41.963019] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-08T17:05:41.963696] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-08T17:05:41.963778] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-08T17:05:42.216374] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T17:05:42.327400] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:42.417520] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-08T17:05:43.217606] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-08T17:05:43.566107] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-08T17:05:44.017521] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-08T17:05:44.519971] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-08T17:05:44.817681] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-08T17:05:45.170103] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T17:05:45.375095] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:05:45.617563] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-08T17:05:45.995856] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T17:05:45.996611] [INFO ] [REMOTE ] AFGD: Full fetch complete (3077 records). [2025-10-08T17:05:45.996706] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-08T17:05:46.374391] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-08T17:05:46.374508] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-08T17:05:46.374672] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-08T17:05:46.374733] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-08T17:05:46.375105] [DEBUG] [LOCAL ] AFGD: Trimmed 3077 records to 1807 (keeping 200 days of data) [2025-10-08T17:05:46.386771] [DEBUG] [LOCAL ] AFGD: Primary data saved (1807 records). [2025-10-08T17:05:46.386867] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-08T17:05:46.386945] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGD took 33.9s. Estimated remaining: 4h 36m 18s. Rate: 8.4 symbols/min [2025-10-08T17:05:46.422632] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-08T17:05:46.589518] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:46.636383] [DEBUG] [LOCAL ] AGCO: Loaded 42359 existing records from primary storage. [2025-10-08T17:05:46.636796] [INFO ] [MAIN ] AGCO: Loaded 42359 existing records. [2025-10-08T17:05:46.851892] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:46.852186] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-08T17:05:46.852248] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-08T17:05:46.852490] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-08T17:05:46.852547] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-08T17:05:47.034173] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:05:47.220302] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-08T17:05:47.220235] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:48.017556] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-08T17:05:48.453530] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T17:05:48.654953] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:05:48.817606] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-08T17:05:49.260290] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T17:05:49.261077] [INFO ] [REMOTE ] AFGB: Full fetch complete (3627 records). [2025-10-08T17:05:49.261146] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-08T17:05:49.613303] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-08T17:05:49.613382] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-08T17:05:49.613498] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-08T17:05:49.613587] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-08T17:05:49.613997] [DEBUG] [LOCAL ] AFGB: Trimmed 3627 records to 2309 (keeping 200 days of data) [2025-10-08T17:05:49.621801] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-08T17:05:49.629843] [DEBUG] [LOCAL ] AFGB: Primary data saved (2309 records). [2025-10-08T17:05:49.629913] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-08T17:05:49.630008] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGB took 45.2s. Estimated remaining: 4h 33m 7s. Rate: 8.5 symbols/min [2025-10-08T17:05:49.801079] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:49.819935] [DEBUG] [LOCAL ] AGD: Loaded 18378 existing records from primary storage. [2025-10-08T17:05:49.820205] [INFO ] [MAIN ] AGD: Loaded 18378 existing records. [2025-10-08T17:05:50.000990] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:50.001238] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-08T17:05:50.001300] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-08T17:05:50.001458] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-08T17:05:50.001502] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-08T17:05:50.358797] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:50.417622] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-08T17:05:51.208424] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:05:51.217737] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-08T17:05:51.421044] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T17:05:52.017584] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-08T17:05:52.493858] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:05:52.817592] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-08T17:05:53.617577] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-08T17:05:53.754297] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:05:53.800746] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T17:05:54.417600] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-08T17:05:55.106173] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T17:05:55.217594] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-08T17:05:56.017606] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-08T17:05:56.498114] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-08T17:05:56.817566] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-08T17:05:56.918463] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T17:05:56.959456] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:05:57.617587] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-08T17:05:58.386251] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T17:05:58.420052] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-08T17:05:58.428835] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T17:05:59.217578] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-08T17:06:00.017568] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-08T17:06:00.097178] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T17:06:00.643287] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T17:06:00.676414] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T17:06:00.817603] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-08T17:06:01.617570] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-08T17:06:02.417563] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-08T17:06:02.635267] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T17:06:03.217547] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-08T17:06:03.450926] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T17:06:03.622445] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T17:06:04.017611] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-08T17:06:04.817519] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-08T17:06:05.227612] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T17:06:05.486230] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T17:06:05.617564] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-08T17:06:06.417593] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-08T17:06:07.007196] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-08T17:06:07.227951] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-08T17:06:07.234561] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:06:08.003243] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T17:06:08.017509] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-08T17:06:08.817635] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-08T17:06:08.987744] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T17:06:09.617590] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-08T17:06:09.676906] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T17:06:09.682803] [INFO ] [REMOTE ] AFL: Full fetch complete (76909 records). [2025-10-08T17:06:09.683042] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-08T17:06:10.097334] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-08T17:06:10.097440] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-08T17:06:10.098296] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-08T17:06:10.098405] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-08T17:06:10.100121] [DEBUG] [LOCAL ] AFL: Trimmed 76909 records to 53161 (keeping 200 days of data) [2025-10-08T17:06:10.361703] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T17:06:10.437853] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-08T17:06:10.489180] [DEBUG] [LOCAL ] AFL: Primary data saved (53161 records). [2025-10-08T17:06:10.489379] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-08T17:06:10.489484] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 33.5s. Estimated remaining: 4h 43m 40s. Rate: 8.2 symbols/min [2025-10-08T17:06:10.657498] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:10.709560] [DEBUG] [LOCAL ] AGI: Loaded 53421 existing records from primary storage. [2025-10-08T17:06:10.709940] [INFO ] [MAIN ] AGI: Loaded 53421 existing records. [2025-10-08T17:06:10.893134] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:10.893433] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-08T17:06:10.893489] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-08T17:06:10.893792] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-08T17:06:10.893851] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-08T17:06:11.218166] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-08T17:06:11.378328] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:11.446090] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T17:06:11.594991] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:06:12.017704] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-08T17:06:12.827192] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-08T17:06:12.835998] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T17:06:13.617519] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-08T17:06:13.843103] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T17:06:14.000248] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T17:06:14.417696] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-08T17:06:14.806245] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T17:06:15.217637] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-08T17:06:16.017520] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-08T17:06:16.254900] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T17:06:16.817516] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-08T17:06:16.909889] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T17:06:17.028271] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T17:06:17.617602] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-08T17:06:18.417559] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-08T17:06:18.759240] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T17:06:18.784310] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T17:06:18.793456] [INFO ] [REMOTE ] AGCO: Full fetch complete (61795 records). [2025-10-08T17:06:18.793747] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-08T17:06:19.217266] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-08T17:06:19.217387] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-08T17:06:19.218038] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-08T17:06:19.218435] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-08T17:06:19.218195] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-08T17:06:19.221039] [DEBUG] [LOCAL ] AGCO: Trimmed 61795 records to 42343 (keeping 200 days of data) [2025-10-08T17:06:19.499508] [DEBUG] [LOCAL ] AGCO: Primary data saved (42343 records). [2025-10-08T17:06:19.499684] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-08T17:06:19.499792] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGCO took 33.1s. Estimated remaining: 4h 44m 49s. Rate: 8.1 symbols/min [2025-10-08T17:06:19.678455] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:19.733207] [DEBUG] [LOCAL ] AGL: Loaded 52486 existing records from primary storage. [2025-10-08T17:06:19.733802] [INFO ] [MAIN ] AGL: Loaded 52486 existing records. [2025-10-08T17:06:19.913956] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:19.914501] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-08T17:06:19.914567] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-08T17:06:19.915083] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-08T17:06:19.915187] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-08T17:06:20.017925] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-08T17:06:20.317778] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:20.357406] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T17:06:20.372510] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T17:06:20.817572] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-08T17:06:21.617559] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-08T17:06:21.782848] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T17:06:21.785817] [INFO ] [REMOTE ] AGD: Full fetch complete (25884 records). [2025-10-08T17:06:21.785951] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-08T17:06:22.214530] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-08T17:06:22.214719] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-08T17:06:22.215472] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-08T17:06:22.227753] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-08T17:06:22.250120] [DEBUG] [LOCAL ] AGD: Trimmed 25884 records to 18490 (keeping 200 days of data) [2025-10-08T17:06:22.252864] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-08T17:06:22.383340] [DEBUG] [LOCAL ] AGD: Primary data saved (18490 records). [2025-10-08T17:06:22.383540] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-08T17:06:22.383681] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 32.8s. Estimated remaining: 4h 41m 22s. Rate: 8.2 symbols/min [2025-10-08T17:06:22.427437] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-08T17:06:22.563811] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:22.577251] [DEBUG] [LOCAL ] AGM: Loaded 10397 existing records from primary storage. [2025-10-08T17:06:22.577513] [INFO ] [MAIN ] AGM: Loaded 10397 existing records. [2025-10-08T17:06:22.763877] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:22.764166] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-08T17:06:22.764348] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-08T17:06:22.764555] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-08T17:06:22.764614] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-08T17:06:23.176147] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:23.170558] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:06:23.217546] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-08T17:06:24.017517] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-08T17:06:24.354162] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T17:06:24.824573] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-08T17:06:24.844226] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:06:24.869884] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T17:06:25.617608] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-08T17:06:26.417615] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-08T17:06:26.793076] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T17:06:26.797359] [INFO ] [REMOTE ] AG: Full fetch complete (77613 records). [2025-10-08T17:06:26.797578] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-08T17:06:27.227887] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-08T17:06:27.235609] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T17:06:27.261542] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-08T17:06:27.262119] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-08T17:06:27.265446] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-08T17:06:27.267698] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-08T17:06:27.295962] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T17:06:27.296133] [DEBUG] [LOCAL ] AG: Trimmed 77613 records to 53642 (keeping 200 days of data) [2025-10-08T17:06:27.628169] [DEBUG] [LOCAL ] AG: Primary data saved (53642 records). [2025-10-08T17:06:27.628319] [INFO ] [MAIN ] AG: Full history saved. [2025-10-08T17:06:27.629187] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AG took 46.1s. Estimated remaining: 4h 39m 46s. Rate: 8.3 symbols/min [2025-10-08T17:06:27.800234] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:27.832746] [DEBUG] [LOCAL ] AGO: Loaded 28004 existing records from primary storage. [2025-10-08T17:06:27.833035] [INFO ] [MAIN ] AGO: Loaded 28004 existing records. [2025-10-08T17:06:28.006371] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:28.006632] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-08T17:06:28.006723] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-08T17:06:28.006981] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-08T17:06:28.007037] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-08T17:06:28.027139] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-08T17:06:28.355443] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:28.817554] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-08T17:06:29.054282] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:06:29.258148] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T17:06:29.440551] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T17:06:29.617576] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-08T17:06:30.417579] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-08T17:06:30.798303] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T17:06:31.217583] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-08T17:06:32.017509] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-08T17:06:32.049467] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T17:06:32.444358] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T17:06:32.457514] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T17:06:32.817636] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-08T17:06:33.617580] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-08T17:06:33.660168] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T17:06:34.417590] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-08T17:06:35.217596] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-08T17:06:35.367225] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:06:35.427136] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T17:06:35.871578] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T17:06:36.017571] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-08T17:06:36.817568] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-08T17:06:37.617544] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-08T17:06:37.885243] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:06:38.325978] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T17:06:38.417549] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-08T17:06:38.672755] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T17:06:39.050386] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T17:06:39.217593] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-08T17:06:39.906326] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T17:06:40.017562] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-08T17:06:40.817570] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-08T17:06:41.617521] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-08T17:06:41.856332] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T17:06:42.417537] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-08T17:06:42.472148] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T17:06:42.515359] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T17:06:43.217618] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-08T17:06:44.017532] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-08T17:06:44.328936] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T17:06:44.804116] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T17:06:44.805577] [INFO ] [REMOTE ] AGM: Full fetch complete (13026 records). [2025-10-08T17:06:44.805679] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-08T17:06:44.826597] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-08T17:06:45.224253] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-08T17:06:45.224479] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-08T17:06:45.225409] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-08T17:06:45.235984] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-08T17:06:45.257039] [DEBUG] [LOCAL ] AGM: Trimmed 13026 records to 10458 (keeping 200 days of data) [2025-10-08T17:06:45.259178] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T17:06:45.346277] [DEBUG] [LOCAL ] AGM: Primary data saved (10458 records). [2025-10-08T17:06:45.346452] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-08T17:06:45.346592] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 23.0s. Estimated remaining: 4h 47m 8s. Rate: 8.1 symbols/min [2025-10-08T17:06:45.533636] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:45.570255] [DEBUG] [LOCAL ] AGRO: Loaded 33319 existing records from primary storage. [2025-10-08T17:06:45.570748] [INFO ] [MAIN ] AGRO: Loaded 33319 existing records. [2025-10-08T17:06:45.624678] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-08T17:06:45.756978] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:45.757217] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-08T17:06:45.757284] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-08T17:06:45.757504] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-08T17:06:45.757563] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-08T17:06:46.142220] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:46.417560] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-08T17:06:46.733038] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T17:06:46.811708] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T17:06:47.217588] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-08T17:06:48.017601] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-08T17:06:48.275426] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T17:06:48.817624] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-08T17:06:49.116903] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T17:06:49.175953] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T17:06:49.617601] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-08T17:06:49.989691] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:06:50.417554] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-08T17:06:51.027696] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:06:51.217531] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-08T17:06:51.677486] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:06:52.017558] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-08T17:06:52.817511] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-08T17:06:52.964397] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T17:06:53.065306] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T17:06:53.617694] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-08T17:06:53.924195] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:06:54.417569] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-08T17:06:54.523595] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T17:06:55.217602] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-08T17:06:55.789528] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:06:56.017603] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-08T17:06:56.671096] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:06:56.675198] [INFO ] [REMOTE ] AGL: Full fetch complete (75588 records). [2025-10-08T17:06:56.675331] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-08T17:06:56.822676] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-08T17:06:57.078022] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-08T17:06:57.078109] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-08T17:06:57.078880] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-08T17:06:57.078946] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-08T17:06:57.080429] [DEBUG] [LOCAL ] AGL: Trimmed 75588 records to 52495 (keeping 200 days of data) [2025-10-08T17:06:57.382926] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T17:06:57.400048] [DEBUG] [LOCAL ] AGL: Primary data saved (52495 records). [2025-10-08T17:06:57.400184] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-08T17:06:57.400280] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGL took 37.9s. Estimated remaining: 4h 50m 15s. Rate: 8.0 symbols/min [2025-10-08T17:06:57.577547] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:57.610625] [DEBUG] [LOCAL ] AGX: Loaded 33141 existing records from primary storage. [2025-10-08T17:06:57.610947] [INFO ] [MAIN ] AGX: Loaded 33141 existing records. [2025-10-08T17:06:57.623477] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-08T17:06:57.792236] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:57.792468] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-08T17:06:57.792514] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-08T17:06:57.792746] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-08T17:06:57.792803] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-08T17:06:58.150209] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:58.418114] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-08T17:06:58.572939] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T17:06:58.578881] [INFO ] [REMOTE ] AGI: Full fetch complete (76899 records). [2025-10-08T17:06:58.579066] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-08T17:06:59.022234] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T17:06:59.028779] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-08T17:06:59.029263] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-08T17:06:59.030287] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-08T17:06:59.030378] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-08T17:06:59.032581] [DEBUG] [LOCAL ] AGI: Trimmed 76899 records to 53420 (keeping 200 days of data) [2025-10-08T17:06:59.225456] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-08T17:06:59.375716] [DEBUG] [LOCAL ] AGI: Primary data saved (53420 records). [2025-10-08T17:06:59.375946] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-08T17:06:59.376084] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGI took 48.9s. Estimated remaining: 4h 46m 18s. Rate: 8.1 symbols/min [2025-10-08T17:06:59.550757] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:59.588751] [DEBUG] [LOCAL ] AHH: Loaded 40837 existing records from primary storage. [2025-10-08T17:06:59.589081] [INFO ] [MAIN ] AHH: Loaded 40837 existing records. [2025-10-08T17:06:59.763857] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:59.764077] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-08T17:06:59.764124] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-08T17:06:59.764392] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-08T17:06:59.764451] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-08T17:07:00.030060] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-08T17:07:00.123697] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:00.160990] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:07:00.409436] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:07:00.411892] [INFO ] [REMOTE ] AGO: Full fetch complete (39427 records). [2025-10-08T17:07:00.411971] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-08T17:07:00.818331] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-08T17:07:00.828964] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-08T17:07:00.829029] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-08T17:07:00.829468] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-08T17:07:00.829530] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-08T17:07:00.830592] [DEBUG] [LOCAL ] AGO: Trimmed 39427 records to 27924 (keeping 200 days of data) [2025-10-08T17:07:01.000424] [DEBUG] [LOCAL ] AGO: Primary data saved (27924 records). [2025-10-08T17:07:01.000564] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-08T17:07:01.001435] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 33.4s. Estimated remaining: 4h 42m 16s. Rate: 8.2 symbols/min [2025-10-08T17:07:01.168005] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:01.168219] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-08T17:07:01.168262] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-08T17:07:01.168401] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-08T17:07:01.168454] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-08T17:07:01.168497] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-08T17:07:01.168529] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-08T17:07:01.534537] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:01.607392] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:07:01.617497] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-08T17:07:02.331937] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:07:02.417566] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-08T17:07:02.621046] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:07:02.621397] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-08T17:07:02.621493] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:07:02.621540] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-08T17:07:02.621611] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:07:02.621721] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-08T17:07:02.621818] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-08T17:07:02.621874] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-08T17:07:02.621944] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-08T17:07:02.622016] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 1.6s. Estimated remaining: 4h 38m 21s. Rate: 8.3 symbols/min [2025-10-08T17:07:02.815031] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:02.866505] [DEBUG] [LOCAL ] AHR: Loaded 49135 existing records from primary storage. [2025-10-08T17:07:02.867162] [INFO ] [MAIN ] AHR: Loaded 49135 existing records. [2025-10-08T17:07:03.050540] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:07:03.050858] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-08T17:07:03.051015] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-08T17:07:03.051523] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-08T17:07:03.051585] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-08T17:07:03.227927] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-08T17:07:03.450680] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:03.473491] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T17:07:04.017585] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-08T17:07:04.428557] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:07:04.817560] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-08T17:07:05.617577] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-08T17:07:05.765743] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T17:07:05.943139] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T17:07:06.417621] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-08T17:07:07.026254] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:07:07.217704] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-08T17:07:07.851821] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T17:07:08.017619] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-08T17:07:08.563614] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:07:08.817620] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-08T17:07:09.531831] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T17:07:09.617687] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-08T17:07:09.898851] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:07:10.417626] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-08T17:07:11.111629] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T17:07:11.217598] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-08T17:07:11.706998] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T17:07:12.017600] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-08T17:07:12.646175] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:07:12.817579] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-08T17:07:13.562938] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:07:13.617571] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-08T17:07:13.996928] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T17:07:14.417588] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-08T17:07:15.118498] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:07:15.217561] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-08T17:07:15.908287] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T17:07:16.017544] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-08T17:07:16.817548] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-08T17:07:16.897520] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:07:17.513313] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T17:07:17.617569] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-08T17:07:18.417526] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-08T17:07:18.514719] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:07:19.217571] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-08T17:07:19.308204] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:07:19.709621] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:07:20.017608] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-08T17:07:20.817535] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-08T17:07:20.925710] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T17:07:21.333084] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T17:07:21.617564] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-08T17:07:22.417624] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-08T17:07:22.450435] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:07:22.453769] [INFO ] [REMOTE ] AGRO: Full fetch complete (49136 records). [2025-10-08T17:07:22.454046] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-08T17:07:22.474370] [FATAL] [VALIDATOR ] AGRO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:07:22.477197] [FATAL] [MAIN ] AGRO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:07:22.477787] [WARN ] [MAIN ] AGRO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:07:22.479356] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T17:07:22.479434] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-08T17:07:22.487528] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-08T17:07:22.487635] [INFO ] [LOCAL ] AGRO: Starting deletion of derivative data. [2025-10-08T17:07:22.488287] [DEBUG] [LOCAL ] AGRO: Deleted derivative data file. [2025-10-08T17:07:22.488420] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 37.1s. Estimated remaining: 4h 46m 30s. Rate: 8.1 symbols/min [2025-10-08T17:07:22.708523] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:22.708860] [DEBUG] [LOCAL ] AHT: No existing data file found in primary storage. [2025-10-08T17:07:22.708919] [WARN ] [MAIN ] AHT: No existing data found, performing full refresh instead. [2025-10-08T17:07:22.709051] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-08T17:07:22.709094] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-08T17:07:22.709137] [DEBUG] [LOCAL ] AHT: No primary data file found to delete. [2025-10-08T17:07:22.709173] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-08T17:07:23.137906] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:23.217562] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-08T17:07:23.734689] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:07:24.017600] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-08T17:07:24.817547] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-08T17:07:24.872251] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T17:07:25.376800] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T17:07:25.562769] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T17:07:25.617589] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-08T17:07:26.417627] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-08T17:07:27.158035] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:07:27.217625] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-08T17:07:27.564736] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:07:28.017595] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-08T17:07:28.257396] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T17:07:28.259764] [INFO ] [REMOTE ] AGX: Full fetch complete (48639 records). [2025-10-08T17:07:28.259853] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-08T17:07:28.653081] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-08T17:07:28.653186] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-08T17:07:28.653893] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-08T17:07:28.653993] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-08T17:07:28.655339] [DEBUG] [LOCAL ] AGX: Trimmed 48639 records to 33176 (keeping 200 days of data) [2025-10-08T17:07:28.844500] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-08T17:07:28.903531] [DEBUG] [LOCAL ] AGX: Primary data saved (33176 records). [2025-10-08T17:07:28.903745] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-08T17:07:28.903887] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 31.5s. Estimated remaining: 4h 45m 43s. Rate: 8.1 symbols/min [2025-10-08T17:07:29.117013] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:29.117219] [DEBUG] [LOCAL ] AI: No existing data file found in primary storage. [2025-10-08T17:07:29.117273] [WARN ] [MAIN ] AI: No existing data found, performing full refresh instead. [2025-10-08T17:07:29.117399] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-08T17:07:29.117440] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-08T17:07:29.117481] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-08T17:07:29.117512] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-08T17:07:29.573855] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:29.598079] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T17:07:29.617495] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-08T17:07:30.323278] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:07:30.417575] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-08T17:07:31.037527] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T17:07:31.217559] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-08T17:07:32.017528] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-08T17:07:32.198303] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T17:07:32.202846] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T17:07:32.217361] [INFO ] [REMOTE ] AHH: Full fetch complete (60018 records). [2025-10-08T17:07:32.217539] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-08T17:07:32.607446] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-08T17:07:32.607566] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-08T17:07:32.608209] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-08T17:07:32.608273] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-08T17:07:32.609619] [DEBUG] [LOCAL ] AHH: Trimmed 60018 records to 40772 (keeping 200 days of data) [2025-10-08T17:07:32.700074] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T17:07:32.818023] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-08T17:07:32.860154] [DEBUG] [LOCAL ] AHH: Primary data saved (40772 records). [2025-10-08T17:07:32.860300] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-08T17:07:32.861430] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHH took 33.5s. Estimated remaining: 4h 43m 24s. Rate: 8.2 symbols/min [2025-10-08T17:07:33.030483] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:33.092112] [DEBUG] [LOCAL ] AIG: Loaded 53474 existing records from primary storage. [2025-10-08T17:07:33.092495] [INFO ] [MAIN ] AIG: Loaded 53474 existing records. [2025-10-08T17:07:33.277620] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:07:33.277872] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-08T17:07:33.277919] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-08T17:07:33.278346] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-08T17:07:33.278425] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-08T17:07:33.618749] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-08T17:07:33.648665] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:34.332908] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T17:07:34.336712] [INFO ] [REMOTE ] AHR: Full fetch complete (70776 records). [2025-10-08T17:07:34.336835] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-08T17:07:34.425616] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-08T17:07:34.730671] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-08T17:07:34.730837] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-08T17:07:34.731534] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-08T17:07:34.731578] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-08T17:07:34.734709] [DEBUG] [LOCAL ] AHR: Trimmed 70776 records to 49109 (keeping 200 days of data) [2025-10-08T17:07:35.040926] [DEBUG] [LOCAL ] AHR: Primary data saved (49109 records). [2025-10-08T17:07:35.041081] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-08T17:07:35.041169] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHR took 32.4s. Estimated remaining: 4h 40m 4s. Rate: 8.2 symbols/min [2025-10-08T17:07:35.157628] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T17:07:35.224001] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-08T17:07:35.223917] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:35.224355] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-08T17:07:35.225023] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-08T17:07:35.225183] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-08T17:07:35.225228] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-08T17:07:35.225268] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-08T17:07:35.225301] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-08T17:07:35.595032] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:35.958417] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T17:07:36.017620] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-08T17:07:36.295185] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-08T17:07:36.817623] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-08T17:07:37.455999] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T17:07:37.622693] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-08T17:07:37.639982] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:07:38.260159] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:07:38.417614] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-08T17:07:39.138707] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T17:07:39.217556] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-08T17:07:40.017580] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-08T17:07:40.817622] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-08T17:07:41.008289] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:07:41.008698] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-08T17:07:41.008817] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:07:41.008868] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-08T17:07:41.008926] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:07:41.009018] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-08T17:07:41.009119] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-08T17:07:41.009195] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-08T17:07:41.009276] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-08T17:07:41.009354] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 6.0s. Estimated remaining: 4h 39m 9s. Rate: 8.3 symbols/min [2025-10-08T17:07:41.196902] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:41.223192] [DEBUG] [LOCAL ] AIN: Loaded 24587 existing records from primary storage. [2025-10-08T17:07:41.223522] [INFO ] [MAIN ] AIN: Loaded 24587 existing records. [2025-10-08T17:07:41.449746] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:07:41.450883] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-08T17:07:41.451146] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-08T17:07:41.451658] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-08T17:07:41.451813] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-08T17:07:41.625186] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-08T17:07:41.747932] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-08T17:07:41.915735] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:41.955281] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T17:07:42.417562] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-08T17:07:42.508279] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T17:07:43.217578] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-08T17:07:44.017628] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-08T17:07:44.477013] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T17:07:44.496271] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T17:07:44.530600] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-08T17:07:44.817575] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-08T17:07:45.617591] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-08T17:07:45.888908] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:07:46.417577] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-08T17:07:47.217629] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-08T17:07:47.398439] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T17:07:47.800268] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-08T17:07:48.017607] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-08T17:07:48.677898] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:07:48.817572] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-08T17:07:49.148162] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:07:49.617630] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-08T17:07:50.394460] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T17:07:50.417513] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-08T17:07:50.649900] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:07:51.217543] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-08T17:07:52.017584] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-08T17:07:52.481755] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T17:07:52.643309] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-08T17:07:52.817567] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-08T17:07:53.578468] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T17:07:53.617532] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-08T17:07:54.417571] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-08T17:07:54.836923] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T17:07:55.031679] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T17:07:55.049889] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T17:07:55.051294] [INFO ] [REMOTE ] AHT: Full fetch complete (9266 records). [2025-10-08T17:07:55.051387] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-08T17:07:55.218780] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-08T17:07:55.429624] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-08T17:07:55.429735] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-08T17:07:55.429930] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-08T17:07:55.429990] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-08T17:07:55.430405] [DEBUG] [LOCAL ] AHT: Trimmed 9266 records to 6227 (keeping 200 days of data) [2025-10-08T17:07:55.464839] [DEBUG] [LOCAL ] AHT: Primary data saved (6227 records). [2025-10-08T17:07:55.464928] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-08T17:07:55.464993] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AHT took 33.0s. Estimated remaining: 4h 43m 21s. Rate: 8.1 symbols/min [2025-10-08T17:07:55.650776] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:55.668564] [DEBUG] [LOCAL ] AIO: Loaded 13422 existing records from primary storage. [2025-10-08T17:07:55.668992] [INFO ] [MAIN ] AIO: Loaded 13422 existing records. [2025-10-08T17:07:55.862435] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:07:55.862746] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-08T17:07:55.862804] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-08T17:07:55.863167] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-08T17:07:55.863225] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-08T17:07:56.035397] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-08T17:07:56.217507] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:56.817524] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-08T17:07:57.096729] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T17:07:57.617532] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-08T17:07:57.855161] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T17:07:57.967693] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T17:07:58.417569] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-08T17:07:58.557747] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T17:07:59.217688] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-08T17:07:59.835638] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T17:08:00.017623] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-08T17:08:00.817569] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-08T17:08:01.159226] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T17:08:01.296384] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-08T17:08:01.617551] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-08T17:08:02.417576] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-08T17:08:02.610926] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T17:08:02.735507] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T17:08:03.022987] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T17:08:03.217566] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-08T17:08:04.017554] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-08T17:08:04.817512] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-08T17:08:05.047633] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T17:08:05.276410] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T17:08:05.617574] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-08T17:08:06.417563] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-08T17:08:07.207009] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T17:08:07.217581] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-08T17:08:07.373407] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-08T17:08:07.527718] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T17:08:07.954039] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T17:08:08.017505] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-08T17:08:08.817570] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-08T17:08:09.105402] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:08:09.107966] [INFO ] [REMOTE ] AIN: Full fetch complete (33541 records). [2025-10-08T17:08:09.108065] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-08T17:08:09.511879] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-08T17:08:09.512005] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-08T17:08:09.512404] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-08T17:08:09.512448] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-08T17:08:09.513472] [DEBUG] [LOCAL ] AIN: Trimmed 33541 records to 24522 (keeping 200 days of data) [2025-10-08T17:08:09.617775] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-08T17:08:09.668310] [DEBUG] [LOCAL ] AIN: Primary data saved (24522 records). [2025-10-08T17:08:09.668482] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-08T17:08:09.668577] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIN took 28.7s. Estimated remaining: 4h 47m 16s. Rate: 8.0 symbols/min [2025-10-08T17:08:09.835451] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:09.862827] [DEBUG] [LOCAL ] AIR: Loaded 28749 existing records from primary storage. [2025-10-08T17:08:09.863111] [INFO ] [MAIN ] AIR: Loaded 28749 existing records. [2025-10-08T17:08:10.054201] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:10.054528] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-08T17:08:10.054590] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-08T17:08:10.054874] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-08T17:08:10.054933] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-08T17:08:10.420912] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-08T17:08:10.424800] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:10.617372] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T17:08:10.623961] [INFO ] [REMOTE ] AIG: Full fetch complete (77384 records). [2025-10-08T17:08:10.624177] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-08T17:08:11.033449] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-08T17:08:11.033562] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-08T17:08:11.034365] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-08T17:08:11.034438] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-08T17:08:11.036387] [DEBUG] [LOCAL ] AIG: Trimmed 77384 records to 53474 (keeping 200 days of data) [2025-10-08T17:08:11.222395] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-08T17:08:11.384818] [DEBUG] [LOCAL ] AIG: Primary data saved (53474 records). [2025-10-08T17:08:11.384986] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-08T17:08:11.386028] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIG took 38.5s. Estimated remaining: 4h 43m 48s. Rate: 8.1 symbols/min [2025-10-08T17:08:11.569410] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:11.587161] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:08:11.628695] [DEBUG] [LOCAL ] AIT: Loaded 27197 existing records from primary storage. [2025-10-08T17:08:11.629328] [INFO ] [MAIN ] AIT: Loaded 27197 existing records. [2025-10-08T17:08:11.825142] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:11.825570] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-08T17:08:11.825714] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-08T17:08:11.826068] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-08T17:08:11.826223] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-08T17:08:12.043161] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-08T17:08:12.187412] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-08T17:08:12.315794] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:12.330011] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T17:08:12.817542] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-08T17:08:13.021341] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:08:13.617520] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-08T17:08:14.002510] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T17:08:14.417608] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-08T17:08:15.017242] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T17:08:15.217593] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-08T17:08:16.017536] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-08T17:08:16.062920] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T17:08:16.560360] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T17:08:16.817534] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-08T17:08:17.064883] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-08T17:08:17.069361] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-08T17:08:17.069587] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-08T17:08:17.483402] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-08T17:08:17.483491] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-08T17:08:17.484244] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-08T17:08:17.484364] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-08T17:08:17.488262] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53755 (keeping 200 days of data) [2025-10-08T17:08:17.617731] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-08T17:08:17.856622] [DEBUG] [LOCAL ] AI: Primary data saved (53755 records). [2025-10-08T17:08:17.856825] [INFO ] [MAIN ] AI: Full history saved. [2025-10-08T17:08:17.856934] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AI took 49.0s. Estimated remaining: 4h 43m 9s. Rate: 8.1 symbols/min [2025-10-08T17:08:18.028514] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:18.066493] [DEBUG] [LOCAL ] AIV: Loaded 40863 existing records from primary storage. [2025-10-08T17:08:18.066851] [INFO ] [MAIN ] AIV: Loaded 40863 existing records. [2025-10-08T17:08:18.199557] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T17:08:18.302819] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:18.303263] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-08T17:08:18.303382] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-08T17:08:18.311770] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-08T17:08:18.312498] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-08T17:08:18.312946] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T17:08:18.422696] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-08T17:08:18.705231] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:19.217606] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-08T17:08:19.759371] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T17:08:20.017603] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-08T17:08:20.756388] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:08:20.817511] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-08T17:08:20.885112] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:08:21.617593] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-08T17:08:22.374824] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T17:08:22.417501] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-08T17:08:22.439130] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T17:08:23.217620] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-08T17:08:23.347685] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T17:08:24.017563] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-08T17:08:24.502908] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T17:08:24.817512] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-08T17:08:24.908811] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T17:08:25.617562] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-08T17:08:26.211083] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T17:08:26.213424] [INFO ] [REMOTE ] AIO: Full fetch complete (20145 records). [2025-10-08T17:08:26.213561] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-08T17:08:26.368427] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T17:08:26.423251] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-08T17:08:26.662922] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-08T17:08:26.663033] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-08T17:08:26.663377] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-08T17:08:26.663424] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-08T17:08:26.664073] [DEBUG] [LOCAL ] AIO: Trimmed 20145 records to 13421 (keeping 200 days of data) [2025-10-08T17:08:26.752455] [DEBUG] [LOCAL ] AIO: Primary data saved (13421 records). [2025-10-08T17:08:26.752597] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-08T17:08:26.752705] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIO took 31.3s. Estimated remaining: 4h 43m 53s. Rate: 8.1 symbols/min [2025-10-08T17:08:26.920180] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:26.952118] [DEBUG] [LOCAL ] AIZ: Loaded 29798 existing records from primary storage. [2025-10-08T17:08:26.952410] [INFO ] [MAIN ] AIZ: Loaded 29798 existing records. [2025-10-08T17:08:27.126601] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:27.126860] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-08T17:08:27.126908] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-08T17:08:27.127196] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-08T17:08:27.127253] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-08T17:08:27.222957] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-08T17:08:27.483592] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:27.660409] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:08:28.017621] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-08T17:08:28.555731] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T17:08:28.817572] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-08T17:08:29.322205] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T17:08:29.540279] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T17:08:29.617581] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-08T17:08:30.417588] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-08T17:08:30.699304] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:08:31.217605] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-08T17:08:31.828857] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T17:08:32.017560] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-08T17:08:32.610815] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T17:08:32.817619] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-08T17:08:33.491679] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:08:33.617528] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-08T17:08:34.109784] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:08:34.417577] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-08T17:08:35.018969] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T17:08:35.217620] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-08T17:08:35.558848] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T17:08:36.017591] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-08T17:08:36.275890] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T17:08:36.817564] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-08T17:08:37.295866] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:08:37.617607] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-08T17:08:38.249382] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T17:08:38.417579] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-08T17:08:38.725671] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T17:08:39.217566] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-08T17:08:39.709318] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T17:08:39.712848] [INFO ] [REMOTE ] AIR: Full fetch complete (39700 records). [2025-10-08T17:08:39.713024] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-08T17:08:40.020507] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-08T17:08:40.117123] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-08T17:08:40.117227] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-08T17:08:40.117779] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-08T17:08:40.117845] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-08T17:08:40.119553] [DEBUG] [LOCAL ] AIR: Trimmed 39700 records to 28818 (keeping 200 days of data) [2025-10-08T17:08:40.302446] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T17:08:40.319146] [DEBUG] [LOCAL ] AIR: Primary data saved (28818 records). [2025-10-08T17:08:40.319319] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-08T17:08:40.319431] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIR took 30.7s. Estimated remaining: 4h 47m 11s. Rate: 8.0 symbols/min [2025-10-08T17:08:40.495074] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:40.502691] [DEBUG] [LOCAL ] AIZN: Loaded 4050 existing records from primary storage. [2025-10-08T17:08:40.502973] [INFO ] [MAIN ] AIZN: Loaded 4050 existing records. [2025-10-08T17:08:40.712320] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:40.712604] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-08T17:08:40.712691] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-08T17:08:40.712898] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-08T17:08:40.712961] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-08T17:08:40.817614] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-08T17:08:41.104831] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:41.617521] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-08T17:08:41.779031] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T17:08:41.833177] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T17:08:41.835207] [INFO ] [REMOTE ] AIT: Full fetch complete (39208 records). [2025-10-08T17:08:41.835293] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-08T17:08:42.205272] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-08T17:08:42.205353] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-08T17:08:42.205808] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-08T17:08:42.205869] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-08T17:08:42.206831] [DEBUG] [LOCAL ] AIT: Trimmed 39208 records to 27109 (keeping 200 days of data) [2025-10-08T17:08:42.377629] [DEBUG] [LOCAL ] AIT: Primary data saved (27109 records). [2025-10-08T17:08:42.377795] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-08T17:08:42.377893] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIT took 31.0s. Estimated remaining: 4h 44m 5s. Rate: 8.1 symbols/min [2025-10-08T17:08:42.422828] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-08T17:08:42.553190] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:42.603318] [DEBUG] [LOCAL ] AJG: Loaded 46742 existing records from primary storage. [2025-10-08T17:08:42.603703] [INFO ] [MAIN ] AJG: Loaded 46742 existing records. [2025-10-08T17:08:42.788080] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:42.788333] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-08T17:08:42.788442] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-08T17:08:42.788813] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-08T17:08:42.788874] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-08T17:08:43.159329] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:43.179223] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:08:43.217501] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-08T17:08:43.454376] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T17:08:44.017543] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-08T17:08:44.259845] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T17:08:44.817563] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-08T17:08:45.290009] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T17:08:45.525555] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:08:45.617583] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-08T17:08:46.417633] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-08T17:08:46.951378] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T17:08:47.124109] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:08:47.217605] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-08T17:08:48.017575] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-08T17:08:48.652422] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T17:08:48.817544] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-08T17:08:49.308243] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:08:49.617567] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-08T17:08:50.152238] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:08:50.417572] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-08T17:08:51.217604] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-08T17:08:51.597878] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-08T17:08:51.708916] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T17:08:52.019269] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-08T17:08:52.024128] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T17:08:52.817564] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-08T17:08:53.622753] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-08T17:08:53.643904] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T17:08:54.377620] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T17:08:54.381850] [INFO ] [REMOTE ] AIV: Full fetch complete (60121 records). [2025-10-08T17:08:54.382010] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-08T17:08:54.424975] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-08T17:08:54.858041] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-08T17:08:54.858212] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-08T17:08:54.859313] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-08T17:08:54.859548] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-08T17:08:54.867767] [DEBUG] [LOCAL ] AIV: Trimmed 60121 records to 40918 (keeping 200 days of data) [2025-10-08T17:08:54.880774] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T17:08:54.976961] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T17:08:55.124218] [DEBUG] [LOCAL ] AIV: Primary data saved (40918 records). [2025-10-08T17:08:55.124360] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-08T17:08:55.124453] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 37.3s. Estimated remaining: 4h 46m 51s. Rate: 8.0 symbols/min [2025-10-08T17:08:55.225474] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-08T17:08:55.301459] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:55.301685] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-08T17:08:55.301741] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-08T17:08:55.301859] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-08T17:08:55.301900] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-08T17:08:55.301941] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-08T17:08:55.301973] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-08T17:08:55.664456] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:56.017639] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-08T17:08:56.607507] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T17:08:56.607194] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T17:08:56.817587] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-08T17:08:57.324067] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-08T17:08:57.617618] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-08T17:08:58.238450] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T17:08:58.417563] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-08T17:08:59.217568] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-08T17:08:59.528029] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T17:08:59.744055] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T17:09:00.017576] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-08T17:09:00.511688] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T17:09:00.817553] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-08T17:09:01.617597] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-08T17:09:01.943275] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-08T17:09:02.165833] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T17:09:02.168195] [INFO ] [REMOTE ] AIZ: Full fetch complete (42857 records). [2025-10-08T17:09:02.168315] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-08T17:09:02.422775] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-08T17:09:02.556627] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-08T17:09:02.556784] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-08T17:09:02.557276] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-08T17:09:02.557320] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-08T17:09:02.558519] [DEBUG] [LOCAL ] AIZ: Trimmed 42857 records to 29684 (keeping 200 days of data) [2025-10-08T17:09:02.757428] [DEBUG] [LOCAL ] AIZ: Primary data saved (29684 records). [2025-10-08T17:09:02.757579] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-08T17:09:02.757695] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZ took 36.0s. Estimated remaining: 4h 46m 48s. Rate: 8.0 symbols/min [2025-10-08T17:09:02.926626] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:02.971120] [DEBUG] [LOCAL ] AKR: Loaded 45872 existing records from primary storage. [2025-10-08T17:09:02.971492] [INFO ] [MAIN ] AKR: Loaded 45872 existing records. [2025-10-08T17:09:03.137935] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T17:09:03.160394] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:03.161126] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-08T17:09:03.161223] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-08T17:09:03.161674] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-08T17:09:03.161736] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-08T17:09:03.228016] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-08T17:09:03.575517] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:04.017560] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-08T17:09:04.582212] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T17:09:04.817568] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-08T17:09:04.994782] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T17:09:05.617553] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-08T17:09:06.145100] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T17:09:06.417606] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-08T17:09:06.571866] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T17:09:07.217505] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-08T17:09:07.337032] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T17:09:07.338069] [INFO ] [REMOTE ] AIZN: Full fetch complete (5928 records). [2025-10-08T17:09:07.338138] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-08T17:09:07.707000] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-08T17:09:07.707103] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-08T17:09:07.707349] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-08T17:09:07.707391] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-08T17:09:07.707815] [DEBUG] [LOCAL ] AIZN: Trimmed 5928 records to 4106 (keeping 200 days of data) [2025-10-08T17:09:07.734241] [DEBUG] [LOCAL ] AIZN: Primary data saved (4106 records). [2025-10-08T17:09:07.734371] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-08T17:09:07.734456] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZN took 27.4s. Estimated remaining: 4h 45m 22s. Rate: 8.1 symbols/min [2025-10-08T17:09:07.906295] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:07.958866] [DEBUG] [LOCAL ] AL: Loaded 44440 existing records from primary storage. [2025-10-08T17:09:07.959282] [INFO ] [MAIN ] AL: Loaded 44440 existing records. [2025-10-08T17:09:08.022670] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-08T17:09:08.144845] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:08.145098] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-08T17:09:08.145153] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-08T17:09:08.145511] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-08T17:09:08.145569] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-08T17:09:08.522503] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:08.629854] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-08T17:09:08.629737] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:09:08.817547] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-08T17:09:09.360778] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T17:09:09.617555] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-08T17:09:10.417597] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-08T17:09:11.217558] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-08T17:09:11.292866] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T17:09:11.798294] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T17:09:11.994512] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T17:09:12.017509] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-08T17:09:12.817614] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-08T17:09:13.617531] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-08T17:09:13.803166] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:09:14.322905] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T17:09:14.346417] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T17:09:14.417517] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-08T17:09:15.217602] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-08T17:09:15.600028] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T17:09:15.847482] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:09:16.017556] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-08T17:09:16.817575] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-08T17:09:17.228942] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T17:09:17.330036] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T17:09:17.617612] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-08T17:09:18.417605] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-08T17:09:19.107358] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T17:09:19.217575] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-08T17:09:20.017530] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-08T17:09:20.051162] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T17:09:20.471401] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T17:09:20.588411] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:09:20.817559] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-08T17:09:21.617573] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-08T17:09:21.872082] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T17:09:22.417566] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-08T17:09:23.217572] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-08T17:09:23.378013] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T17:09:23.541269] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T17:09:24.017597] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-08T17:09:24.817605] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-08T17:09:24.966390] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:09:25.341760] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T17:09:25.617580] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-08T17:09:26.323335] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:09:26.417590] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-08T17:09:27.215175] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T17:09:27.224517] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-08T17:09:27.700312] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T17:09:27.701505] [INFO ] [REMOTE ] AKA: Full fetch complete (2417 records). [2025-10-08T17:09:27.701721] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-08T17:09:27.914913] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T17:09:27.915308] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:09:27.915534] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:09:27.915686] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-08T17:09:27.916011] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-08T17:09:27.916123] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-08T17:09:27.916314] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-08T17:09:27.916445] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 32.8s. Estimated remaining: 4h 51m 50s. Rate: 7.9 symbols/min [2025-10-08T17:09:28.022547] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-08T17:09:28.096833] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:28.127304] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T17:09:28.181001] [DEBUG] [LOCAL ] ALB: Loaded 53275 existing records from primary storage. [2025-10-08T17:09:28.181418] [INFO ] [MAIN ] ALB: Loaded 53275 existing records. [2025-10-08T17:09:28.358205] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:28.358471] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-08T17:09:28.358525] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-08T17:09:28.358784] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-08T17:09:28.358842] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-08T17:09:28.707213] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:28.817581] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-08T17:09:29.617540] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-08T17:09:29.754232] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:09:30.417564] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-08T17:09:30.814982] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T17:09:31.217563] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-08T17:09:31.406705] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T17:09:31.618214] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:09:32.017735] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-08T17:09:32.817526] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-08T17:09:33.165830] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T17:09:33.617522] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-08T17:09:33.706123] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:09:33.709516] [INFO ] [REMOTE ] AJG: Full fetch complete (69154 records). [2025-10-08T17:09:33.709630] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-08T17:09:34.091058] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-08T17:09:34.091141] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-08T17:09:34.091821] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-08T17:09:34.091888] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-08T17:09:34.093253] [DEBUG] [LOCAL ] AJG: Trimmed 69154 records to 46653 (keeping 200 days of data) [2025-10-08T17:09:34.409321] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T17:09:34.421584] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-08T17:09:34.427426] [DEBUG] [LOCAL ] AJG: Primary data saved (46653 records). [2025-10-08T17:09:34.427510] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-08T17:09:34.428431] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 52.1s. Estimated remaining: 4h 51m 8s. Rate: 7.9 symbols/min [2025-10-08T17:09:34.599147] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:34.649890] [DEBUG] [LOCAL ] ALC: Loaded 50987 existing records from primary storage. [2025-10-08T17:09:34.650211] [INFO ] [MAIN ] ALC: Loaded 50987 existing records. [2025-10-08T17:09:34.852073] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:34.852394] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-08T17:09:34.852489] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-08T17:09:34.852892] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-08T17:09:34.853000] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-08T17:09:35.222250] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-08T17:09:35.248798] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T17:09:35.302936] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:35.958926] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T17:09:36.017502] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-08T17:09:36.817538] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-08T17:09:36.926446] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T17:09:37.617601] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-08T17:09:38.022009] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T17:09:38.259487] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:09:38.417589] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-08T17:09:39.217574] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-08T17:09:39.316153] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T17:09:40.017518] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-08T17:09:40.462823] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T17:09:40.817567] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-08T17:09:40.854364] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T17:09:41.468729] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:09:41.472571] [INFO ] [REMOTE ] AL: Full fetch complete (62860 records). [2025-10-08T17:09:41.472775] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-08T17:09:41.622755] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-08T17:09:41.857154] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-08T17:09:41.857244] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-08T17:09:41.857889] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-08T17:09:41.857953] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-08T17:09:41.859314] [DEBUG] [LOCAL ] AL: Trimmed 62860 records to 44474 (keeping 200 days of data) [2025-10-08T17:09:42.130771] [DEBUG] [LOCAL ] AL: Primary data saved (44474 records). [2025-10-08T17:09:42.130915] [INFO ] [MAIN ] AL: Full history saved. [2025-10-08T17:09:42.131896] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 34.4s. Estimated remaining: 4h 51m 3s. Rate: 7.9 symbols/min [2025-10-08T17:09:42.297687] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:42.330872] [DEBUG] [LOCAL ] ALE: Loaded 31260 existing records from primary storage. [2025-10-08T17:09:42.331163] [INFO ] [MAIN ] ALE: Loaded 31260 existing records. [2025-10-08T17:09:42.428881] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-08T17:09:42.511993] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:42.512704] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-08T17:09:42.512760] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-08T17:09:42.513035] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-08T17:09:42.513091] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-08T17:09:42.891311] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:42.934492] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T17:09:43.217535] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-08T17:09:43.268395] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T17:09:43.272056] [INFO ] [REMOTE ] AKR: Full fetch complete (65340 records). [2025-10-08T17:09:43.272175] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-08T17:09:43.658716] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-08T17:09:43.658861] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-08T17:09:43.659585] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-08T17:09:43.659693] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-08T17:09:43.661427] [DEBUG] [LOCAL ] AKR: Trimmed 65340 records to 45857 (keeping 200 days of data) [2025-10-08T17:09:43.810882] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T17:09:43.986255] [DEBUG] [LOCAL ] AKR: Primary data saved (45857 records). [2025-10-08T17:09:43.986439] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-08T17:09:43.986543] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AKR took 41.2s. Estimated remaining: 4h 48m 4s. Rate: 8.0 symbols/min [2025-10-08T17:09:44.017545] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-08T17:09:44.226687] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T17:09:44.817550] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-08T17:09:45.516401] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:09:45.617554] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-08T17:09:46.402757] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:09:46.417502] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-08T17:09:47.217542] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-08T17:09:47.321366] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:09:48.017600] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-08T17:09:48.485188] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-08T17:09:48.541330] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:09:48.817565] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-08T17:09:49.588225] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T17:09:49.617492] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-08T17:09:50.417555] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-08T17:09:50.915281] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T17:09:51.217564] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-08T17:09:51.293352] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:09:51.342362] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:09:52.017563] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-08T17:09:52.817535] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-08T17:09:53.123548] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T17:09:53.547734] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T17:09:53.617612] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-08T17:09:54.258048] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:09:54.417555] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-08T17:09:55.217555] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-08T17:09:55.777468] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-08T17:09:55.781580] [INFO ] [REMOTE ] ALB: Full fetch complete (76890 records). [2025-10-08T17:09:55.781737] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-08T17:09:56.215496] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-08T17:09:56.215832] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-08T17:09:56.216579] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-08T17:09:56.216663] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-08T17:09:56.246861] [DEBUG] [LOCAL ] ALB: Trimmed 76890 records to 53288 (keeping 200 days of data) [2025-10-08T17:09:56.246718] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T17:09:56.258680] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-08T17:09:56.593558] [DEBUG] [LOCAL ] ALB: Primary data saved (53288 records). [2025-10-08T17:09:56.593726] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-08T17:09:56.593824] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALB took 28.7s. Estimated remaining: 4h 50m 26s. Rate: 7.9 symbols/min [2025-10-08T17:09:56.699790] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T17:09:56.817561] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-08T17:09:58.051064] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T17:09:58.057405] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-08T17:09:58.200039] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-08T17:09:58.417608] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-08T17:09:59.041928] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T17:09:59.217612] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-08T17:09:59.945000] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T17:09:59.950587] [INFO ] [REMOTE ] ALC: Full fetch complete (73160 records). [2025-10-08T17:09:59.950820] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-08T17:10:00.378285] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-08T17:10:00.378425] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-08T17:10:00.379309] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-08T17:10:00.379379] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-08T17:10:00.384161] [DEBUG] [LOCAL ] ALC: Trimmed 73160 records to 51032 (keeping 200 days of data) [2025-10-08T17:10:00.707498] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T17:10:00.723954] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-08T17:10:00.854446] [DEBUG] [LOCAL ] ALC: Primary data saved (51032 records). [2025-10-08T17:10:00.854627] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-08T17:10:00.856090] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 26.4s. Estimated remaining: 4h 48m 41s. Rate: 7.9 symbols/min [2025-10-08T17:10:02.113835] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:10:02.122231] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-08T17:10:03.232504] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T17:10:03.241276] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-08T17:10:04.362485] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T17:10:04.366943] [INFO ] [REMOTE ] ALE: Full fetch complete (43372 records). [2025-10-08T17:10:04.367082] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-08T17:10:04.798496] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-08T17:10:04.798586] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-08T17:10:04.799065] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-08T17:10:04.799127] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-08T17:10:04.800055] [DEBUG] [LOCAL ] ALE: Trimmed 43372 records to 31298 (keeping 200 days of data) [2025-10-08T17:10:04.983246] [DEBUG] [LOCAL ] ALE: Primary data saved (31298 records). [2025-10-08T17:10:04.983389] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-08T17:10:04.983472] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALE took 22.9s. Estimated remaining: 4h 46m 56s. Rate: 8.0 symbols/min [2025-10-08T17:10:05.759235] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:05.821174] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:05.834276] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:05.838693] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:05.867976] [DEBUG] [LOCAL ] ALG: Loaded 9968 existing records from primary storage. [2025-10-08T17:10:05.868334] [INFO ] [MAIN ] ALG: Loaded 9968 existing records. [2025-10-08T17:10:05.974200] [DEBUG] [LOCAL ] ALEX: Loaded 31218 existing records from primary storage. [2025-10-08T17:10:05.997922] [INFO ] [MAIN ] ALEX: Loaded 31218 existing records. [2025-10-08T17:10:06.212310] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:06.281314] [DEBUG] [LOCAL ] ALK: Loaded 53059 existing records from primary storage. [2025-10-08T17:10:06.282901] [DEBUG] [LOCAL ] ALIT: Loaded 52769 existing records from primary storage. [2025-10-08T17:10:06.294125] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-08T17:10:06.300267] [INFO ] [MAIN ] ALK: Loaded 53059 existing records. [2025-10-08T17:10:06.305756] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-08T17:10:06.300016] [INFO ] [MAIN ] ALIT: Loaded 52769 existing records. [2025-10-08T17:10:06.384617] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-08T17:10:06.414300] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-08T17:10:06.423130] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:06.562494] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-08T17:10:06.612774] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-08T17:10:06.653142] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-08T17:10:06.709366] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-08T17:10:06.921629] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:07.150333] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-08T17:10:07.213712] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:07.224786] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-08T17:10:07.279347] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-08T17:10:07.279252] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-08T17:10:07.289553] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-08T17:10:07.289697] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-08T17:10:07.325252] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-08T17:10:07.330484] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-08T17:10:07.527612] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:07.638279] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-08T17:10:07.899598] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:08.004157] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-08T17:10:08.302463] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:08.312587] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-08T17:10:08.327502] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:08.327822] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-08T17:10:09.212199] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:10:09.215049] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-08T17:10:09.612218] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:10:09.620507] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-08T17:10:10.012961] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:10:10.023681] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-08T17:10:10.055977] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:10:10.060311] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-08T17:10:10.408207] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-08T17:10:10.418772] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-08T17:10:10.719873] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:10:10.725853] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-08T17:10:10.985112] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:10:10.987987] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-08T17:10:11.494295] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T17:10:11.505384] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-08T17:10:11.838413] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:10:11.912040] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T17:10:12.017523] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-08T17:10:12.047179] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:10:12.817581] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-08T17:10:13.153972] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:10:13.212154] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T17:10:13.617593] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-08T17:10:14.148322] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T17:10:14.417555] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-08T17:10:15.040270] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T17:10:15.217584] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-08T17:10:16.003321] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T17:10:16.017509] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-08T17:10:16.817530] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-08T17:10:17.239148] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T17:10:17.431408] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-08T17:10:17.617535] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-08T17:10:18.417521] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-08T17:10:18.624827] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:10:19.184530] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:10:19.219256] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-08T17:10:19.221262] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:10:20.017617] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-08T17:10:20.817616] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-08T17:10:20.835256] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:10:21.017305] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T17:10:21.617610] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-08T17:10:21.901399] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T17:10:22.417561] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-08T17:10:23.217511] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-08T17:10:23.492286] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:10:23.519238] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T17:10:23.788162] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T17:10:24.017698] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-08T17:10:24.817576] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-08T17:10:25.297918] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T17:10:25.617559] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-08T17:10:26.293118] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T17:10:26.417589] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-08T17:10:27.056927] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:10:27.217556] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-08T17:10:27.767231] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T17:10:28.017557] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-08T17:10:28.657751] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T17:10:28.817555] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-08T17:10:29.354819] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T17:10:29.357566] [INFO ] [REMOTE ] ALEX: Full fetch complete (44791 records). [2025-10-08T17:10:29.357714] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-08T17:10:29.622750] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-08T17:10:29.774436] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-08T17:10:29.774546] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-08T17:10:29.775179] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-08T17:10:29.775256] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-08T17:10:29.776578] [DEBUG] [LOCAL ] ALEX: Trimmed 44791 records to 31184 (keeping 200 days of data) [2025-10-08T17:10:29.976835] [DEBUG] [LOCAL ] ALEX: Primary data saved (31184 records). [2025-10-08T17:10:29.977013] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-08T17:10:29.977123] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALEX took 25.0s. Estimated remaining: 4h 55m 2s. Rate: 7.8 symbols/min [2025-10-08T17:10:30.146581] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:30.196665] [DEBUG] [LOCAL ] ALL: Loaded 49915 existing records from primary storage. [2025-10-08T17:10:30.197075] [INFO ] [MAIN ] ALL: Loaded 49915 existing records. [2025-10-08T17:10:30.377854] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:30.378083] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-08T17:10:30.378132] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-08T17:10:30.378580] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-08T17:10:30.378639] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-08T17:10:30.422715] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-08T17:10:30.811585] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:30.822601] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:10:30.859487] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T17:10:31.217570] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-08T17:10:32.017581] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-08T17:10:32.585532] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-08T17:10:32.817506] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-08T17:10:33.137829] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T17:10:33.237819] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T17:10:33.617593] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-08T17:10:34.417604] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-08T17:10:35.046562] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-08T17:10:35.217557] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-08T17:10:35.682302] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-08T17:10:35.688847] [INFO ] [REMOTE ] ALIT: Full fetch complete (76440 records). [2025-10-08T17:10:35.689084] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-08T17:10:36.023744] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-08T17:10:36.135848] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-08T17:10:36.136084] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-08T17:10:36.136973] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-08T17:10:36.137142] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-08T17:10:36.139017] [DEBUG] [LOCAL ] ALIT: Trimmed 76440 records to 52779 (keeping 200 days of data) [2025-10-08T17:10:36.260904] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T17:10:36.501546] [DEBUG] [LOCAL ] ALIT: Primary data saved (52779 records). [2025-10-08T17:10:36.501745] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-08T17:10:36.503213] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALIT took 31.5s. Estimated remaining: 4h 54m 21s. Rate: 7.8 symbols/min [2025-10-08T17:10:36.684125] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:36.731526] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T17:10:36.783848] [DEBUG] [LOCAL ] ALLE: Loaded 44491 existing records from primary storage. [2025-10-08T17:10:36.784211] [INFO ] [MAIN ] ALLE: Loaded 44491 existing records. [2025-10-08T17:10:36.822757] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-08T17:10:36.905279] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T17:10:36.987431] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:36.987716] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-08T17:10:36.987785] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-08T17:10:36.988153] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-08T17:10:36.988212] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-08T17:10:37.336898] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:37.617577] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-08T17:10:38.417632] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-08T17:10:38.743062] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T17:10:38.749766] [INFO ] [REMOTE ] ALK: Full fetch complete (76837 records). [2025-10-08T17:10:38.749968] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-08T17:10:39.105828] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T17:10:39.193487] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-08T17:10:39.193633] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-08T17:10:39.194734] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-08T17:10:39.194819] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-08T17:10:39.196739] [DEBUG] [LOCAL ] ALK: Trimmed 76837 records to 53058 (keeping 200 days of data) [2025-10-08T17:10:39.250476] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-08T17:10:39.320834] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:10:39.554475] [DEBUG] [LOCAL ] ALK: Primary data saved (53058 records). [2025-10-08T17:10:39.554667] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-08T17:10:39.554791] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 34.6s. Estimated remaining: 4h 52m 5s. Rate: 7.8 symbols/min [2025-10-08T17:10:39.725831] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:39.777430] [DEBUG] [LOCAL ] ALLY: Loaded 53228 existing records from primary storage. [2025-10-08T17:10:39.777802] [INFO ] [MAIN ] ALLY: Loaded 53228 existing records. [2025-10-08T17:10:39.987325] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:39.987764] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-08T17:10:39.987835] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-08T17:10:39.988081] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-08T17:10:39.988140] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-08T17:10:40.022815] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-08T17:10:40.311108] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:10:40.333454] [INFO ] [REMOTE ] ALG: Full fetch complete (15672 records). [2025-10-08T17:10:40.353940] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-08T17:10:40.459825] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:40.773479] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-08T17:10:40.773586] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-08T17:10:40.774044] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-08T17:10:40.774101] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-08T17:10:40.774846] [DEBUG] [LOCAL ] ALG: Trimmed 15672 records to 9862 (keeping 200 days of data) [2025-10-08T17:10:40.825557] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-08T17:10:40.853548] [DEBUG] [LOCAL ] ALG: Primary data saved (9862 records). [2025-10-08T17:10:40.853815] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-08T17:10:40.853983] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALG took 35.9s. Estimated remaining: 4h 49m 4s. Rate: 7.9 symbols/min [2025-10-08T17:10:41.058664] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:41.119934] [DEBUG] [LOCAL ] ALSN: Loaded 43331 existing records from primary storage. [2025-10-08T17:10:41.120530] [INFO ] [MAIN ] ALSN: Loaded 43331 existing records. [2025-10-08T17:10:41.337730] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:41.338023] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-08T17:10:41.338077] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-08T17:10:41.338472] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-08T17:10:41.338532] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-08T17:10:41.622956] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-08T17:10:41.735816] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:41.851231] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:10:42.417597] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-08T17:10:42.505280] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T17:10:43.217575] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-08T17:10:43.838596] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-08T17:10:44.017549] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-08T17:10:44.110404] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:10:44.797250] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:10:44.817515] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-08T17:10:45.457148] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T17:10:45.617567] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-08T17:10:46.135250] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:10:46.417576] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-08T17:10:47.228873] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-08T17:10:47.252431] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:10:47.614811] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T17:10:48.017561] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-08T17:10:48.817538] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-08T17:10:48.984565] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T17:10:49.572255] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:10:49.617531] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-08T17:10:50.210021] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T17:10:50.417609] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-08T17:10:50.934275] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:10:51.217620] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-08T17:10:51.800717] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T17:10:52.017573] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-08T17:10:52.817541] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-08T17:10:53.037595] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:10:53.617634] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-08T17:10:53.763869] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:10:54.419557] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-08T17:10:54.425840] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T17:10:55.217540] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-08T17:10:55.323584] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T17:10:56.017561] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-08T17:10:56.155364] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:10:56.607571] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T17:10:56.817548] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-08T17:10:57.617599] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-08T17:10:57.704572] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T17:10:57.964366] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T17:10:58.417607] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-08T17:10:59.113085] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T17:10:59.217560] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-08T17:10:59.980626] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T17:11:00.017551] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-08T17:11:00.444618] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T17:11:00.817550] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-08T17:11:01.328490] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:11:01.332150] [INFO ] [REMOTE ] ALL: Full fetch complete (72401 records). [2025-10-08T17:11:01.332277] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-08T17:11:01.622630] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-08T17:11:01.726583] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-08T17:11:01.726723] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-08T17:11:01.727517] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-08T17:11:01.727583] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-08T17:11:01.729266] [DEBUG] [LOCAL ] ALL: Trimmed 72401 records to 49900 (keeping 200 days of data) [2025-10-08T17:11:02.091365] [DEBUG] [LOCAL ] ALL: Primary data saved (49900 records). [2025-10-08T17:11:02.091530] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-08T17:11:02.091630] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 32.1s. Estimated remaining: 4h 55m 3s. Rate: 7.7 symbols/min [2025-10-08T17:11:02.261919] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:02.285006] [DEBUG] [LOCAL ] ALTG: Loaded 23593 existing records from primary storage. [2025-10-08T17:11:02.285468] [INFO ] [MAIN ] ALTG: Loaded 23593 existing records. [2025-10-08T17:11:02.429018] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-08T17:11:02.466863] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:02.467360] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-08T17:11:02.467519] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-08T17:11:02.467869] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-08T17:11:02.467972] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-08T17:11:02.750074] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T17:11:02.869019] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:03.217565] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-08T17:11:03.515142] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T17:11:03.626129] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T17:11:04.017556] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-08T17:11:04.706163] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T17:11:04.817522] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-08T17:11:05.193518] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T17:11:05.617547] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-08T17:11:06.112416] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T17:11:06.417567] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-08T17:11:07.028082] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T17:11:07.217602] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-08T17:11:08.017567] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T17:11:08.017674] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-08T17:11:08.066423] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T17:11:08.817555] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-08T17:11:09.306317] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T17:11:09.310438] [INFO ] [REMOTE ] ALSN: Full fetch complete (62229 records). [2025-10-08T17:11:09.310682] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-08T17:11:09.626535] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-08T17:11:09.732120] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-08T17:11:09.732208] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-08T17:11:09.732910] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-08T17:11:09.732977] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-08T17:11:09.734321] [DEBUG] [LOCAL ] ALSN: Trimmed 62229 records to 43352 (keeping 200 days of data) [2025-10-08T17:11:10.011617] [DEBUG] [LOCAL ] ALSN: Primary data saved (43352 records). [2025-10-08T17:11:10.012212] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-08T17:11:10.012443] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALSN took 29.2s. Estimated remaining: 4h 55m 0s. Rate: 7.7 symbols/min [2025-10-08T17:11:10.186970] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:10.198754] [DEBUG] [LOCAL ] ALUR: Loaded 10741 existing records from primary storage. [2025-10-08T17:11:10.198971] [INFO ] [MAIN ] ALUR: Loaded 10741 existing records. [2025-10-08T17:11:10.376818] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:10.377136] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-08T17:11:10.377213] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-08T17:11:10.377709] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-08T17:11:10.377777] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-08T17:11:10.422660] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-08T17:11:10.770705] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:10.783893] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:11:11.093035] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-08T17:11:11.217574] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-08T17:11:11.642306] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:11:11.646624] [INFO ] [REMOTE ] ALLE: Full fetch complete (64541 records). [2025-10-08T17:11:11.646825] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-08T17:11:12.026211] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-08T17:11:12.081718] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-08T17:11:12.081810] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-08T17:11:12.082479] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-08T17:11:12.082538] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-08T17:11:12.083926] [DEBUG] [LOCAL ] ALLE: Trimmed 64541 records to 44372 (keeping 200 days of data) [2025-10-08T17:11:12.365590] [DEBUG] [LOCAL ] ALLE: Primary data saved (44372 records). [2025-10-08T17:11:12.365741] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-08T17:11:12.367358] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLE took 35.9s. Estimated remaining: 4h 52m 31s. Rate: 7.8 symbols/min [2025-10-08T17:11:12.536762] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:12.581916] [DEBUG] [LOCAL ] ALV: Loaded 42166 existing records from primary storage. [2025-10-08T17:11:12.582259] [INFO ] [MAIN ] ALV: Loaded 42166 existing records. [2025-10-08T17:11:12.765113] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:12.765349] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-08T17:11:12.765397] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-08T17:11:12.766635] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-08T17:11:12.766804] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-08T17:11:12.822782] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-08T17:11:12.899908] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:11:13.169483] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:13.492815] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T17:11:13.617546] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-08T17:11:14.126955] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:11:14.417549] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-08T17:11:15.130166] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:11:15.217604] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-08T17:11:15.482176] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:11:16.017552] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-08T17:11:16.571311] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T17:11:16.817552] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-08T17:11:17.182600] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T17:11:17.617597] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-08T17:11:18.417586] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-08T17:11:18.545490] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:11:18.574267] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:11:19.217586] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-08T17:11:19.940677] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:11:20.017554] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-08T17:11:20.817529] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-08T17:11:21.116207] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T17:11:21.120507] [INFO ] [REMOTE ] ALLY: Full fetch complete (76948 records). [2025-10-08T17:11:21.120636] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-08T17:11:21.257277] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:11:21.531229] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-08T17:11:21.531415] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-08T17:11:21.532211] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-08T17:11:21.532290] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-08T17:11:21.534109] [DEBUG] [LOCAL ] ALLY: Trimmed 76948 records to 53228 (keeping 200 days of data) [2025-10-08T17:11:21.635248] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-08T17:11:21.640196] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T17:11:21.870015] [DEBUG] [LOCAL ] ALLY: Primary data saved (53228 records). [2025-10-08T17:11:21.870174] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-08T17:11:21.871388] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALLY took 42.3s. Estimated remaining: 4h 53m 11s. Rate: 7.8 symbols/min [2025-10-08T17:11:22.041942] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:22.050805] [DEBUG] [LOCAL ] ALX: Loaded 6461 existing records from primary storage. [2025-10-08T17:11:22.051048] [INFO ] [MAIN ] ALX: Loaded 6461 existing records. [2025-10-08T17:11:22.225583] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:22.225833] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-08T17:11:22.225880] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-08T17:11:22.226227] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-08T17:11:22.226284] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-08T17:11:22.422704] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-08T17:11:22.585731] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:22.717964] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T17:11:23.217548] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-08T17:11:23.295298] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T17:11:24.017546] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-08T17:11:24.556816] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T17:11:24.817571] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-08T17:11:25.283891] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T17:11:25.617578] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-08T17:11:25.930677] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:11:26.417599] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-08T17:11:26.642524] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T17:11:26.938475] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T17:11:27.217579] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-08T17:11:28.017566] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-08T17:11:28.211937] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T17:11:28.764611] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:11:28.817538] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-08T17:11:29.586664] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T17:11:29.617497] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-08T17:11:30.032369] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T17:11:30.417587] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-08T17:11:31.217593] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-08T17:11:31.792388] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T17:11:32.017592] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-08T17:11:32.175695] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T17:11:32.710827] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T17:11:32.712194] [INFO ] [REMOTE ] ALUR: Full fetch complete (20009 records). [2025-10-08T17:11:32.712273] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-08T17:11:32.822632] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-08T17:11:33.105377] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-08T17:11:33.105469] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-08T17:11:33.105820] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-08T17:11:33.105888] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-08T17:11:33.106530] [DEBUG] [LOCAL ] ALUR: Trimmed 20009 records to 10405 (keeping 200 days of data) [2025-10-08T17:11:33.174614] [DEBUG] [LOCAL ] ALUR: Primary data saved (10405 records). [2025-10-08T17:11:33.174809] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-08T17:11:33.174901] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALUR took 23.2s. Estimated remaining: 4h 54m 35s. Rate: 7.7 symbols/min [2025-10-08T17:11:33.379636] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:33.436369] [DEBUG] [LOCAL ] AM: Loaded 52017 existing records from primary storage. [2025-10-08T17:11:33.436779] [INFO ] [MAIN ] AM: Loaded 52017 existing records. [2025-10-08T17:11:33.622743] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-08T17:11:33.661524] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:33.662032] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-08T17:11:33.662092] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-08T17:11:33.662449] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-08T17:11:33.662508] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-08T17:11:34.054629] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:34.072778] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T17:11:34.417585] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-08T17:11:35.217513] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-08T17:11:35.328332] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T17:11:35.567434] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T17:11:35.769638] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:11:36.017542] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-08T17:11:36.562191] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T17:11:36.817568] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-08T17:11:37.617560] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-08T17:11:37.961941] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-08T17:11:38.310514] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T17:11:38.417509] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-08T17:11:39.217537] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-08T17:11:39.921831] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T17:11:39.954850] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T17:11:40.017583] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-08T17:11:40.612375] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T17:11:40.817585] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-08T17:11:41.617564] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-08T17:11:42.417520] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-08T17:11:42.529860] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:11:42.894712] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:11:43.217537] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-08T17:11:43.397337] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:11:43.399419] [INFO ] [REMOTE ] ALTG: Full fetch complete (33636 records). [2025-10-08T17:11:43.399498] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-08T17:11:43.777016] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-08T17:11:43.777134] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-08T17:11:43.777529] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-08T17:11:43.777568] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-08T17:11:43.778361] [DEBUG] [LOCAL ] ALTG: Trimmed 33636 records to 23572 (keeping 200 days of data) [2025-10-08T17:11:43.906079] [DEBUG] [LOCAL ] ALTG: Primary data saved (23572 records). [2025-10-08T17:11:43.906214] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-08T17:11:43.906297] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALTG took 41.8s. Estimated remaining: 4h 55m 43s. Rate: 7.7 symbols/min [2025-10-08T17:11:44.022738] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-08T17:11:44.078210] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:44.112143] [DEBUG] [LOCAL ] AMBC: Loaded 36458 existing records from primary storage. [2025-10-08T17:11:44.112437] [INFO ] [MAIN ] AMBC: Loaded 36458 existing records. [2025-10-08T17:11:44.298870] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:44.299212] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-08T17:11:44.299293] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-08T17:11:44.300086] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-08T17:11:44.300165] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-08T17:11:44.685808] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:44.714923] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:11:44.817552] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-08T17:11:45.375814] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T17:11:45.617583] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-08T17:11:46.422741] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-08T17:11:46.446895] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:11:46.484291] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T17:11:47.217571] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-08T17:11:47.885990] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T17:11:48.017567] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-08T17:11:48.817568] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-08T17:11:49.048501] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T17:11:49.082747] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T17:11:49.284296] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T17:11:49.617556] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-08T17:11:50.417539] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-08T17:11:50.838619] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T17:11:51.217570] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-08T17:11:51.925239] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:11:52.017528] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-08T17:11:52.216893] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:11:52.817564] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-08T17:11:53.617525] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-08T17:11:53.705031] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:11:53.709047] [INFO ] [REMOTE ] ALV: Full fetch complete (61737 records). [2025-10-08T17:11:53.709254] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-08T17:11:54.141737] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-08T17:11:54.141998] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-08T17:11:54.142735] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-08T17:11:54.142825] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-08T17:11:54.174219] [DEBUG] [LOCAL ] ALV: Trimmed 61737 records to 42086 (keeping 200 days of data) [2025-10-08T17:11:54.174053] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T17:11:54.432279] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-08T17:11:54.485494] [DEBUG] [LOCAL ] ALV: Primary data saved (42086 records). [2025-10-08T17:11:54.485640] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-08T17:11:54.485766] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALV took 42.1s. Estimated remaining: 4h 56m 45s. Rate: 7.7 symbols/min [2025-10-08T17:11:54.651870] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:54.695191] [DEBUG] [LOCAL ] AMBP: Loaded 44811 existing records from primary storage. [2025-10-08T17:11:54.695565] [INFO ] [MAIN ] AMBP: Loaded 44811 existing records. [2025-10-08T17:11:54.886816] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:54.887088] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-08T17:11:54.887178] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-08T17:11:54.887857] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-08T17:11:54.887947] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-08T17:11:55.173706] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:11:55.219578] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-08T17:11:55.313484] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:55.858194] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T17:11:55.924031] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T17:11:56.017542] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-08T17:11:56.817558] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-08T17:11:57.151753] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T17:11:57.548879] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T17:11:57.617552] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-08T17:11:58.417583] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-08T17:11:59.041328] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T17:11:59.042925] [INFO ] [REMOTE ] ALX: Full fetch complete (7360 records). [2025-10-08T17:11:59.043059] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-08T17:11:59.222300] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-08T17:11:59.467462] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-08T17:11:59.477096] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-08T17:11:59.477365] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-08T17:11:59.482585] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-08T17:11:59.495192] [DEBUG] [LOCAL ] ALX: Trimmed 7360 records to 6520 (keeping 200 days of data) [2025-10-08T17:11:59.498487] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T17:11:59.550523] [DEBUG] [LOCAL ] ALX: Primary data saved (6520 records). [2025-10-08T17:11:59.550701] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-08T17:11:59.550805] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALX took 37.7s. Estimated remaining: 4h 55m 30s. Rate: 7.7 symbols/min [2025-10-08T17:11:59.725273] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:59.725450] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-08T17:11:59.725488] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-08T17:11:59.725622] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-08T17:11:59.725699] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-08T17:11:59.725756] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-08T17:11:59.725789] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-08T17:12:00.023088] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-08T17:12:00.111280] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:00.641943] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T17:12:00.817574] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-08T17:12:01.014173] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:12:01.014505] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-08T17:12:01.014607] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:12:01.014689] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-08T17:12:01.014740] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:12:01.014784] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-08T17:12:01.014878] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-08T17:12:01.014972] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-08T17:12:01.015058] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-08T17:12:01.015141] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 52m 47s. Rate: 7.8 symbols/min [2025-10-08T17:12:01.188493] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:01.222500] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T17:12:01.281859] [DEBUG] [LOCAL ] AMC: Loaded 53761 existing records from primary storage. [2025-10-08T17:12:01.282212] [INFO ] [MAIN ] AMC: Loaded 53761 existing records. [2025-10-08T17:12:01.456693] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:01.456905] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-08T17:12:01.456950] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-08T17:12:01.458252] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-08T17:12:01.458311] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-08T17:12:01.629191] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-08T17:12:01.822995] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:02.417580] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-08T17:12:03.217627] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-08T17:12:03.286200] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T17:12:04.017552] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-08T17:12:04.822715] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-08T17:12:04.846103] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-08T17:12:05.207296] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T17:12:05.258119] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T17:12:05.617569] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-08T17:12:06.315195] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T17:12:06.417586] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-08T17:12:07.217613] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-08T17:12:07.299776] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T17:12:07.487523] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T17:12:08.017626] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-08T17:12:08.817562] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-08T17:12:09.271387] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T17:12:09.435297] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-08T17:12:09.617586] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-08T17:12:10.144610] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T17:12:10.417598] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-08T17:12:10.801007] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:12:10.804403] [INFO ] [REMOTE ] AMBC: Full fetch complete (51478 records). [2025-10-08T17:12:10.804541] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-08T17:12:11.218639] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-08T17:12:11.218955] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-08T17:12:11.219829] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-08T17:12:11.220443] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-08T17:12:11.220507] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-08T17:12:11.221731] [DEBUG] [LOCAL ] AMBC: Trimmed 51478 records to 36338 (keeping 200 days of data) [2025-10-08T17:12:11.428966] [DEBUG] [LOCAL ] AMBC: Primary data saved (36338 records). [2025-10-08T17:12:11.429103] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-08T17:12:11.429187] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 27.5s. Estimated remaining: 4h 53m 45s. Rate: 7.8 symbols/min [2025-10-08T17:12:11.647715] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:11.699359] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-08T17:12:11.699762] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-08T17:12:11.892692] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:11.892965] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-08T17:12:11.893040] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-08T17:12:11.894330] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-08T17:12:11.894395] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-08T17:12:12.003506] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:12:12.031599] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-08T17:12:12.305545] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:12.723799] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T17:12:12.817557] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-08T17:12:13.617554] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-08T17:12:14.417584] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-08T17:12:14.530142] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-08T17:12:14.583504] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T17:12:14.790475] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T17:12:15.217574] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-08T17:12:16.017578] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-08T17:12:16.266187] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T17:12:16.674401] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T17:12:16.817597] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-08T17:12:17.617562] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-08T17:12:17.652818] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T17:12:18.417591] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-08T17:12:19.217595] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-08T17:12:19.295570] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T17:12:19.349380] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-08T17:12:19.650202] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:12:19.655159] [INFO ] [REMOTE ] AM: Full fetch complete (75578 records). [2025-10-08T17:12:19.655401] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-08T17:12:20.022785] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-08T17:12:20.099862] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-08T17:12:20.099972] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-08T17:12:20.100801] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-08T17:12:20.100868] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-08T17:12:20.102409] [DEBUG] [LOCAL ] AM: Trimmed 75578 records to 51994 (keeping 200 days of data) [2025-10-08T17:12:20.419338] [DEBUG] [LOCAL ] AM: Primary data saved (51994 records). [2025-10-08T17:12:20.419504] [INFO ] [MAIN ] AM: Full history saved. [2025-10-08T17:12:20.419594] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AM took 47.2s. Estimated remaining: 4h 54m 7s. Rate: 7.7 symbols/min [2025-10-08T17:12:20.591412] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:20.650741] [DEBUG] [LOCAL ] AME: Loaded 48666 existing records from primary storage. [2025-10-08T17:12:20.651625] [INFO ] [MAIN ] AME: Loaded 48666 existing records. [2025-10-08T17:12:20.843906] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-08T17:12:20.850367] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:20.852082] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-08T17:12:20.852164] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-08T17:12:20.852987] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-08T17:12:20.853054] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-08T17:12:21.066449] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T17:12:21.328668] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:21.622750] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-08T17:12:21.640527] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:12:22.417578] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-08T17:12:23.217533] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-08T17:12:23.316545] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:12:23.329780] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-08T17:12:23.922947] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T17:12:24.017552] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-08T17:12:24.371103] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:12:24.374368] [INFO ] [REMOTE ] AMBP: Full fetch complete (65455 records). [2025-10-08T17:12:24.374472] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-08T17:12:24.765875] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-08T17:12:24.765979] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-08T17:12:24.766736] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-08T17:12:24.766805] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-08T17:12:24.769231] [DEBUG] [LOCAL ] AMBP: Trimmed 65455 records to 44668 (keeping 200 days of data) [2025-10-08T17:12:24.821913] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-08T17:12:25.034291] [DEBUG] [LOCAL ] AMBP: Primary data saved (44668 records). [2025-10-08T17:12:25.034431] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-08T17:12:25.034539] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 30.5s. Estimated remaining: 4h 52m 45s. Rate: 7.8 symbols/min [2025-10-08T17:12:25.201452] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:25.224399] [DEBUG] [LOCAL ] AMG: Loaded 20226 existing records from primary storage. [2025-10-08T17:12:25.224716] [INFO ] [MAIN ] AMG: Loaded 20226 existing records. [2025-10-08T17:12:25.406047] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:25.406282] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-08T17:12:25.406328] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-08T17:12:25.406990] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-08T17:12:25.407049] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-08T17:12:25.623773] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-08T17:12:25.763920] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:26.079431] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T17:12:26.417583] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-08T17:12:26.510958] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:12:27.217730] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-08T17:12:27.320680] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T17:12:27.683971] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T17:12:28.017539] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-08T17:12:28.817522] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-08T17:12:28.904317] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T17:12:29.089899] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:12:29.617565] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-08T17:12:30.407629] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:12:30.417606] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-08T17:12:31.217621] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-08T17:12:31.741622] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-08T17:12:32.017515] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-08T17:12:32.146494] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T17:12:32.294451] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:12:32.817571] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-08T17:12:33.617570] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-08T17:12:34.135376] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T17:12:34.381426] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T17:12:34.417574] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-08T17:12:34.418581] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T17:12:35.217555] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-08T17:12:35.997000] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T17:12:36.017502] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-08T17:12:36.817608] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-08T17:12:37.533499] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T17:12:37.575213] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-08T17:12:37.617500] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-08T17:12:38.341756] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T17:12:38.417625] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-08T17:12:39.161418] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:12:39.217685] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-08T17:12:39.348831] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T17:12:40.017561] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-08T17:12:40.817552] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-08T17:12:41.417808] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-08T17:12:41.617528] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-08T17:12:41.714687] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T17:12:42.320415] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T17:12:42.324497] [INFO ] [REMOTE ] AMCR: Full fetch complete (77680 records). [2025-10-08T17:12:42.324697] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-08T17:12:42.422628] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-08T17:12:42.745975] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-08T17:12:42.746102] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-08T17:12:42.746936] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-08T17:12:42.747001] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-08T17:12:42.748570] [DEBUG] [LOCAL ] AMCR: Trimmed 77680 records to 53669 (keeping 200 days of data) [2025-10-08T17:12:43.088178] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-08T17:12:43.088322] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-08T17:12:43.088441] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMCR took 31.7s. Estimated remaining: 4h 56m 40s. Rate: 7.7 symbols/min [2025-10-08T17:12:43.224840] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-08T17:12:43.256899] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:43.304351] [DEBUG] [LOCAL ] AMH: Loaded 51759 existing records from primary storage. [2025-10-08T17:12:43.304703] [INFO ] [MAIN ] AMH: Loaded 51759 existing records. [2025-10-08T17:12:43.482864] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:43.483326] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-08T17:12:43.483396] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-08T17:12:43.489921] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-08T17:12:43.497195] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-08T17:12:43.548694] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T17:12:43.863934] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:44.017522] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-08T17:12:44.166069] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-08T17:12:44.171583] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-10-08T17:12:44.171753] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-08T17:12:44.557710] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-08T17:12:44.557813] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-08T17:12:44.558628] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-08T17:12:44.558738] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-08T17:12:44.560397] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53761 (keeping 200 days of data) [2025-10-08T17:12:44.823830] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-08T17:12:44.869341] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:12:44.892802] [DEBUG] [LOCAL ] AMC: Primary data saved (53761 records). [2025-10-08T17:12:44.892955] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-08T17:12:44.893042] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMC took 43.9s. Estimated remaining: 4h 54m 12s. Rate: 7.7 symbols/min [2025-10-08T17:12:45.072477] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:45.072754] [DEBUG] [LOCAL ] AMN: No existing data file found in primary storage. [2025-10-08T17:12:45.072897] [WARN ] [MAIN ] AMN: No existing data found, performing full refresh instead. [2025-10-08T17:12:45.073142] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-08T17:12:45.073214] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-08T17:12:45.073416] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-08T17:12:45.073513] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-08T17:12:45.289531] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T17:12:45.486197] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:45.617548] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-08T17:12:46.337146] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:12:46.417527] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-08T17:12:46.898700] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T17:12:47.217616] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-08T17:12:47.695176] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:12:48.017596] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-08T17:12:48.674374] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T17:12:48.817506] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-08T17:12:49.253096] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T17:12:49.617576] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-08T17:12:50.274834] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:12:50.417536] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-08T17:12:51.187735] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:12:51.217516] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-08T17:12:51.622522] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T17:12:52.017579] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-08T17:12:52.612863] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T17:12:52.817572] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-08T17:12:53.476941] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T17:12:53.480718] [INFO ] [REMOTE ] AME: Full fetch complete (69925 records). [2025-10-08T17:12:53.480845] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-08T17:12:53.623107] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-08T17:12:53.889948] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-08T17:12:53.890196] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-08T17:12:53.891251] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-08T17:12:53.891359] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-08T17:12:53.893515] [DEBUG] [LOCAL ] AME: Trimmed 69925 records to 48717 (keeping 200 days of data) [2025-10-08T17:12:54.023406] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T17:12:54.253310] [DEBUG] [LOCAL ] AME: Primary data saved (48717 records). [2025-10-08T17:12:54.253481] [INFO ] [MAIN ] AME: Full history saved. [2025-10-08T17:12:54.253569] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 33.8s. Estimated remaining: 4h 54m 41s. Rate: 7.7 symbols/min [2025-10-08T17:12:54.435274] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-08T17:12:54.455003] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:54.488504] [DEBUG] [LOCAL ] AMP: Loaded 32027 existing records from primary storage. [2025-10-08T17:12:54.488879] [INFO ] [MAIN ] AMP: Loaded 32027 existing records. [2025-10-08T17:12:54.628850] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T17:12:54.692290] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:54.692568] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-08T17:12:54.692673] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-08T17:12:54.693862] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-08T17:12:54.693937] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-08T17:12:55.052926] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:55.217552] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-08T17:12:55.667451] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:12:56.017565] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-08T17:12:56.722346] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T17:12:56.817624] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-08T17:12:57.261201] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:12:57.617614] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-08T17:12:57.811559] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:12:58.417569] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-08T17:12:59.009358] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T17:12:59.217563] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-08T17:12:59.385570] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T17:12:59.387405] [INFO ] [REMOTE ] AMG: Full fetch complete (29782 records). [2025-10-08T17:12:59.387492] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-08T17:12:59.787702] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-08T17:12:59.787816] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-08T17:12:59.788189] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-08T17:12:59.788232] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-08T17:12:59.789282] [DEBUG] [LOCAL ] AMG: Trimmed 29782 records to 20177 (keeping 200 days of data) [2025-10-08T17:12:59.920521] [DEBUG] [LOCAL ] AMG: Primary data saved (20177 records). [2025-10-08T17:12:59.920687] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-08T17:12:59.920800] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 34.9s. Estimated remaining: 4h 53m 45s. Rate: 7.7 symbols/min [2025-10-08T17:13:00.024729] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-08T17:13:00.123601] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:00.177523] [DEBUG] [LOCAL ] AMPX: Loaded 52317 existing records from primary storage. [2025-10-08T17:13:00.177966] [INFO ] [MAIN ] AMPX: Loaded 52317 existing records. [2025-10-08T17:13:00.415169] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:00.415555] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-08T17:13:00.415743] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-08T17:13:00.416261] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-08T17:13:00.416405] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-08T17:13:00.620510] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:13:00.822737] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-08T17:13:00.883254] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:01.566381] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:13:01.617630] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-08T17:13:02.417575] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-08T17:13:02.586678] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T17:13:02.661213] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T17:13:03.217580] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-08T17:13:03.744798] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T17:13:04.017551] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-08T17:13:04.817562] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-08T17:13:04.918202] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T17:13:05.384480] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T17:13:05.617559] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-08T17:13:06.417615] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-08T17:13:06.675121] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:13:06.990513] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T17:13:07.217606] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-08T17:13:07.888885] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T17:13:08.017580] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-08T17:13:08.817551] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-08T17:13:09.067073] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T17:13:09.319862] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:13:09.617586] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-08T17:13:10.417512] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-08T17:13:10.518499] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:13:11.051413] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:13:11.217592] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-08T17:13:12.017705] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-08T17:13:12.224954] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T17:13:12.604355] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T17:13:12.817596] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-08T17:13:13.324496] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-08T17:13:13.617576] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-08T17:13:14.061391] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:13:14.065025] [INFO ] [REMOTE ] AMN: Full fetch complete (60385 records). [2025-10-08T17:13:14.065191] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-08T17:13:14.423141] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-08T17:13:14.460500] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-08T17:13:14.460762] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-08T17:13:14.461451] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-08T17:13:14.461516] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-08T17:13:14.462970] [DEBUG] [LOCAL ] AMN: Trimmed 60385 records to 41756 (keeping 200 days of data) [2025-10-08T17:13:14.719398] [DEBUG] [LOCAL ] AMN: Primary data saved (41756 records). [2025-10-08T17:13:14.719543] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-08T17:13:14.719674] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMN took 29.8s. Estimated remaining: 4h 56m 15s. Rate: 7.7 symbols/min [2025-10-08T17:13:14.886090] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:14.923832] [DEBUG] [LOCAL ] AMPY: Loaded 38451 existing records from primary storage. [2025-10-08T17:13:14.924144] [INFO ] [MAIN ] AMPY: Loaded 38451 existing records. [2025-10-08T17:13:15.100005] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:15.100276] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-08T17:13:15.100347] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-08T17:13:15.100563] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-08T17:13:15.100622] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-08T17:13:15.217935] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-08T17:13:15.464800] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:15.507800] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T17:13:15.987100] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:13:16.017523] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-08T17:13:16.817520] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-08T17:13:16.932957] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T17:13:16.937006] [INFO ] [REMOTE ] AMH: Full fetch complete (74817 records). [2025-10-08T17:13:16.937192] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-08T17:13:17.328326] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-08T17:13:17.328493] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-08T17:13:17.329321] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-08T17:13:17.329398] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-08T17:13:17.331125] [DEBUG] [LOCAL ] AMH: Trimmed 74817 records to 51757 (keeping 200 days of data) [2025-10-08T17:13:17.465293] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T17:13:17.636101] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-08T17:13:17.680816] [DEBUG] [LOCAL ] AMH: Primary data saved (51757 records). [2025-10-08T17:13:17.680941] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-08T17:13:17.681023] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 34.6s. Estimated remaining: 4h 54m 19s. Rate: 7.7 symbols/min [2025-10-08T17:13:17.846807] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:17.876290] [DEBUG] [LOCAL ] AMR: Loaded 29108 existing records from primary storage. [2025-10-08T17:13:17.876628] [INFO ] [MAIN ] AMR: Loaded 29108 existing records. [2025-10-08T17:13:18.050966] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:18.051239] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-08T17:13:18.051293] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-08T17:13:18.051503] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-08T17:13:18.051560] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-08T17:13:18.425577] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:18.420803] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-08T17:13:18.456099] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T17:13:19.033107] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:13:19.217560] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-08T17:13:19.642164] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T17:13:20.017592] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-08T17:13:20.628906] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T17:13:20.817614] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-08T17:13:21.273483] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:13:21.617558] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-08T17:13:22.417521] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-08T17:13:22.448390] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:13:22.499829] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T17:13:23.217549] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-08T17:13:23.593114] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:13:23.877419] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T17:13:24.017558] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-08T17:13:24.817593] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-08T17:13:25.120283] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:13:25.617527] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-08T17:13:25.781737] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:13:26.417551] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-08T17:13:27.217555] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-08T17:13:27.424450] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T17:13:27.942692] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:13:28.017514] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-08T17:13:28.700200] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:13:28.817602] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-08T17:13:29.076319] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:13:29.617568] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-08T17:13:29.804460] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:13:30.417585] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-08T17:13:30.934202] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:13:31.217578] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-08T17:13:31.427680] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:13:32.017605] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-08T17:13:32.792488] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T17:13:32.817505] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-08T17:13:33.076396] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:13:33.079152] [INFO ] [REMOTE ] AMP: Full fetch complete (47485 records). [2025-10-08T17:13:33.079296] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-08T17:13:33.503420] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-08T17:13:33.503548] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-08T17:13:33.504257] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-08T17:13:33.504331] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-08T17:13:33.506036] [DEBUG] [LOCAL ] AMP: Trimmed 47485 records to 31938 (keeping 200 days of data) [2025-10-08T17:13:33.617638] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-08T17:13:33.729124] [DEBUG] [LOCAL ] AMP: Primary data saved (31938 records). [2025-10-08T17:13:33.729301] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-08T17:13:33.729393] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 39.5s. Estimated remaining: 4h 57m 14s. Rate: 7.6 symbols/min [2025-10-08T17:13:33.911137] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:33.955233] [DEBUG] [LOCAL ] AMRC: Loaded 38121 existing records from primary storage. [2025-10-08T17:13:33.955729] [INFO ] [MAIN ] AMRC: Loaded 38121 existing records. [2025-10-08T17:13:34.160685] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:34.181246] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-08T17:13:34.182060] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-08T17:13:34.182957] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T17:13:34.190502] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-08T17:13:34.191146] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-08T17:13:34.422758] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-08T17:13:34.617981] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:35.217608] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-08T17:13:35.796751] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-08T17:13:35.858994] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T17:13:36.017545] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-08T17:13:36.664284] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T17:13:36.817582] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-08T17:13:37.617562] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-08T17:13:37.988024] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T17:13:38.256853] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:13:38.260747] [INFO ] [REMOTE ] AMPY: Full fetch complete (52071 records). [2025-10-08T17:13:38.260881] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-08T17:13:38.422621] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-08T17:13:38.704073] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-08T17:13:38.704193] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-08T17:13:38.704877] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-08T17:13:38.704947] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-08T17:13:38.706902] [DEBUG] [LOCAL ] AMPY: Trimmed 52071 records to 38587 (keeping 200 days of data) [2025-10-08T17:13:38.964352] [DEBUG] [LOCAL ] AMPY: Primary data saved (38587 records). [2025-10-08T17:13:38.964596] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-08T17:13:38.966307] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPY took 24.2s. Estimated remaining: 4h 56m 8s. Rate: 7.7 symbols/min [2025-10-08T17:13:39.094906] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T17:13:39.194383] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:39.194889] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-08T17:13:39.195175] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-08T17:13:39.195356] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-08T17:13:39.195411] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-08T17:13:39.195459] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-08T17:13:39.195497] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-08T17:13:39.222719] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-08T17:13:39.617035] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:39.644053] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T17:13:40.017568] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-08T17:13:40.817568] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-08T17:13:41.241342] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T17:13:41.495945] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-08T17:13:41.500350] [INFO ] [REMOTE ] AMPX: Full fetch complete (74937 records). [2025-10-08T17:13:41.500509] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-08T17:13:41.620863] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-08T17:13:41.979334] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-08T17:13:41.979229] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T17:13:41.979489] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-08T17:13:41.987584] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-08T17:13:41.988052] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-08T17:13:41.989575] [DEBUG] [LOCAL ] AMPX: Trimmed 74937 records to 52318 (keeping 200 days of data) [2025-10-08T17:13:42.316600] [DEBUG] [LOCAL ] AMPX: Primary data saved (52318 records). [2025-10-08T17:13:42.316864] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-08T17:13:42.317014] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPX took 42.4s. Estimated remaining: 4h 54m 24s. Rate: 7.7 symbols/min [2025-10-08T17:13:42.422783] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-08T17:13:42.502785] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:42.559502] [DEBUG] [LOCAL ] AMT: Loaded 52437 existing records from primary storage. [2025-10-08T17:13:42.560049] [INFO ] [MAIN ] AMT: Loaded 52437 existing records. [2025-10-08T17:13:42.639682] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:13:42.664042] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-08T17:13:42.674728] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:13:42.679960] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-08T17:13:42.680059] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:13:42.685312] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-08T17:13:42.707349] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-08T17:13:42.745519] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-08T17:13:42.750503] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:42.751248] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-08T17:13:42.751333] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-08T17:13:42.751100] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-08T17:13:42.751601] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMRZ took 3.8s. Estimated remaining: 4h 51m 39s. Rate: 7.8 symbols/min [2025-10-08T17:13:42.757126] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-08T17:13:42.799629] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-08T17:13:43.135287] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:43.222881] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-08T17:13:43.397379] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:43.398488] [DEBUG] [LOCAL ] AMTB: Loaded 20513 existing records from primary storage. [2025-10-08T17:13:43.415822] [INFO ] [MAIN ] AMTB: Loaded 20513 existing records. [2025-10-08T17:13:43.504441] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:13:43.623786] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:43.624087] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-08T17:13:43.624138] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-08T17:13:43.625146] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-08T17:13:43.625211] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-08T17:13:44.013830] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:44.017498] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-08T17:13:44.633315] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T17:13:44.817552] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-08T17:13:45.170965] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T17:13:45.617579] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-08T17:13:46.417581] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-08T17:13:46.783788] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T17:13:46.969988] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:13:47.217634] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-08T17:13:47.511463] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T17:13:48.017581] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-08T17:13:48.472158] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T17:13:48.817577] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-08T17:13:49.297141] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T17:13:49.617585] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-08T17:13:49.997692] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T17:13:50.417586] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-08T17:13:50.925062] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T17:13:51.217571] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-08T17:13:51.367521] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T17:13:52.017541] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-08T17:13:52.058482] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T17:13:52.061048] [INFO ] [REMOTE ] AMR: Full fetch complete (40393 records). [2025-10-08T17:13:52.061147] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-08T17:13:52.447218] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-08T17:13:52.447330] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-08T17:13:52.447824] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-08T17:13:52.447891] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-08T17:13:52.449235] [DEBUG] [LOCAL ] AMR: Trimmed 40393 records to 29039 (keeping 200 days of data) [2025-10-08T17:13:52.624553] [DEBUG] [LOCAL ] AMR: Primary data saved (29039 records). [2025-10-08T17:13:52.624735] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-08T17:13:52.624835] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMR took 34.9s. Estimated remaining: 4h 52m 16s. Rate: 7.7 symbols/min [2025-10-08T17:13:52.789890] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:52.795054] [DEBUG] [LOCAL ] AMTD: Loaded 3692 existing records from primary storage. [2025-10-08T17:13:52.795230] [INFO ] [MAIN ] AMTD: Loaded 3692 existing records. [2025-10-08T17:13:52.824884] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-08T17:13:52.973018] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:52.973278] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-08T17:13:52.973327] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-08T17:13:52.973562] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-08T17:13:52.973622] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-08T17:13:53.322187] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:53.617616] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-08T17:13:53.766602] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T17:13:53.831110] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T17:13:54.417685] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-08T17:13:55.061212] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:13:55.217565] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-08T17:13:55.582234] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T17:13:56.017607] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-08T17:13:56.058869] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:13:56.817503] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-08T17:13:57.177359] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:13:57.239726] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-08T17:13:57.617548] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-08T17:13:58.417583] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-08T17:13:59.217617] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-08T17:13:59.592202] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-08T17:13:59.723344] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T17:13:59.884545] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T17:14:00.017561] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-08T17:14:00.817617] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-08T17:14:00.996904] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T17:14:01.617690] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-08T17:14:02.417636] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-08T17:14:02.605704] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:14:03.226297] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-08T17:14:03.234742] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T17:14:03.262583] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T17:14:04.017579] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-08T17:14:04.817571] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-08T17:14:04.939367] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T17:14:05.156863] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T17:14:05.454287] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:14:05.458613] [INFO ] [REMOTE ] AMRC: Full fetch complete (53492 records). [2025-10-08T17:14:05.458812] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-08T17:14:05.626224] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-08T17:14:05.899149] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-08T17:14:05.899286] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-08T17:14:05.900366] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-08T17:14:05.900688] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-08T17:14:05.902150] [DEBUG] [LOCAL ] AMRC: Trimmed 53492 records to 38091 (keeping 200 days of data) [2025-10-08T17:14:06.142813] [DEBUG] [LOCAL ] AMRC: Primary data saved (38091 records). [2025-10-08T17:14:06.142988] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-08T17:14:06.143076] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRC took 32.4s. Estimated remaining: 4h 54m 10s. Rate: 7.7 symbols/min [2025-10-08T17:14:06.311886] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:06.312077] [DEBUG] [LOCAL ] AMTM: No existing data file found in primary storage. [2025-10-08T17:14:06.312113] [WARN ] [MAIN ] AMTM: No existing data found, performing full refresh instead. [2025-10-08T17:14:06.312260] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-08T17:14:06.312301] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-08T17:14:06.312341] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-10-08T17:14:06.312373] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-08T17:14:06.422779] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-08T17:14:06.667735] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:07.124005] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T17:14:07.217554] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-08T17:14:07.363284] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:14:08.017591] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-08T17:14:08.583556] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T17:14:08.817628] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-08T17:14:08.851573] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T17:14:09.617586] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-08T17:14:10.417532] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-08T17:14:10.527607] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:14:10.705343] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-08T17:14:11.217531] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-08T17:14:11.361800] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T17:14:12.017542] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-08T17:14:12.817509] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-08T17:14:12.822604] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T17:14:13.001390] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T17:14:13.617581] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-08T17:14:14.417632] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-08T17:14:14.704489] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T17:14:15.217528] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-08T17:14:15.344777] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:14:15.416950] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:14:16.017585] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-08T17:14:16.817597] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-08T17:14:16.860221] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T17:14:16.862362] [INFO ] [REMOTE ] AMTB: Full fetch complete (29795 records). [2025-10-08T17:14:16.862449] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-08T17:14:17.230447] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T17:14:17.306082] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-08T17:14:17.306188] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-08T17:14:17.307110] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-08T17:14:17.307179] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-08T17:14:17.308098] [DEBUG] [LOCAL ] AMTB: Trimmed 29795 records to 20507 (keeping 200 days of data) [2025-10-08T17:14:17.441416] [DEBUG] [LOCAL ] AMTB: Primary data saved (20507 records). [2025-10-08T17:14:17.441874] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-08T17:14:17.441984] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 34.7s. Estimated remaining: 4h 55m 14s. Rate: 7.7 symbols/min [2025-10-08T17:14:17.628820] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:17.624826] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-08T17:14:17.640542] [DEBUG] [LOCAL ] AMWL: Loaded 9133 existing records from primary storage. [2025-10-08T17:14:17.640824] [INFO ] [MAIN ] AMWL: Loaded 9133 existing records. [2025-10-08T17:14:17.866907] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:14:17.867186] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-08T17:14:17.867235] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-08T17:14:17.867816] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-08T17:14:17.867882] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-08T17:14:18.251209] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:18.399945] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T17:14:18.417506] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-08T17:14:19.217612] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-08T17:14:19.554981] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T17:14:19.575266] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T17:14:20.017546] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-08T17:14:20.817702] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-08T17:14:20.902350] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:14:21.615099] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:14:21.617624] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-08T17:14:21.633218] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:14:21.638260] [INFO ] [REMOTE ] AMT: Full fetch complete (76029 records). [2025-10-08T17:14:21.638513] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-08T17:14:22.034945] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-08T17:14:22.035036] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-08T17:14:22.035788] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-08T17:14:22.035857] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-08T17:14:22.037403] [DEBUG] [LOCAL ] AMT: Trimmed 76029 records to 52439 (keeping 200 days of data) [2025-10-08T17:14:22.381720] [DEBUG] [LOCAL ] AMT: Primary data saved (52439 records). [2025-10-08T17:14:22.381890] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-08T17:14:22.383271] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMT took 40.1s. Estimated remaining: 4h 54m 7s. Rate: 7.7 symbols/min [2025-10-08T17:14:22.423633] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-08T17:14:22.507926] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T17:14:22.585973] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:22.586242] [DEBUG] [LOCAL ] AMX: No existing data file found in primary storage. [2025-10-08T17:14:22.586306] [WARN ] [MAIN ] AMX: No existing data found, performing full refresh instead. [2025-10-08T17:14:22.586448] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-08T17:14:22.586525] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-08T17:14:22.586611] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-08T17:14:22.586702] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-08T17:14:22.977071] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:23.079969] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T17:14:23.217574] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-08T17:14:23.994197] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T17:14:24.017496] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-08T17:14:24.746304] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T17:14:24.817566] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-08T17:14:25.617568] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-08T17:14:26.411775] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:14:26.421180] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-08T17:14:27.217513] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-08T17:14:27.330483] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:14:27.369152] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:14:28.017536] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-08T17:14:28.483284] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T17:14:28.817575] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-08T17:14:29.461149] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:14:29.617602] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-08T17:14:29.745899] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T17:14:30.417568] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-08T17:14:31.122125] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:14:31.217552] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-08T17:14:31.945712] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T17:14:32.017558] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-08T17:14:32.182462] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T17:14:32.632170] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T17:14:32.817529] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-08T17:14:33.430850] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:14:33.617580] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-08T17:14:34.406010] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T17:14:34.417492] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-08T17:14:35.217566] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-08T17:14:35.352806] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T17:14:35.354470] [INFO ] [REMOTE ] AMWL: Full fetch complete (14258 records). [2025-10-08T17:14:35.354560] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-08T17:14:35.716917] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-08T17:14:35.717001] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-08T17:14:35.717256] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-08T17:14:35.717294] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-08T17:14:35.717812] [DEBUG] [LOCAL ] AMWL: Trimmed 14258 records to 9214 (keeping 200 days of data) [2025-10-08T17:14:35.771511] [DEBUG] [LOCAL ] AMWL: Primary data saved (9214 records). [2025-10-08T17:14:35.771729] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-08T17:14:35.771852] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMWL took 18.3s. Estimated remaining: 4h 55m 53s. Rate: 7.6 symbols/min [2025-10-08T17:14:35.941776] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:35.973598] [DEBUG] [LOCAL ] AN: Loaded 31743 existing records from primary storage. [2025-10-08T17:14:35.973918] [INFO ] [MAIN ] AN: Loaded 31743 existing records. [2025-10-08T17:14:36.028511] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-08T17:14:36.155220] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:14:36.155446] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-08T17:14:36.155492] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-08T17:14:36.156323] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-08T17:14:36.156383] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-08T17:14:36.523913] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:36.763256] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T17:14:36.817553] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-08T17:14:36.850186] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T17:14:37.617545] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-08T17:14:38.417522] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-08T17:14:38.482915] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T17:14:38.971813] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:14:38.984478] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T17:14:39.217596] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-08T17:14:39.812632] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T17:14:39.823122] [INFO ] [REMOTE ] AMTD: Full fetch complete (5577 records). [2025-10-08T17:14:39.823348] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-08T17:14:40.022798] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-08T17:14:40.383938] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-08T17:14:40.384033] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-08T17:14:40.384204] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-08T17:14:40.384264] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-08T17:14:40.384708] [DEBUG] [LOCAL ] AMTD: Trimmed 5577 records to 3706 (keeping 200 days of data) [2025-10-08T17:14:40.406437] [DEBUG] [LOCAL ] AMTD: Primary data saved (3706 records). [2025-10-08T17:14:40.406601] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-08T17:14:40.406719] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMTD took 47.8s. Estimated remaining: 4h 54m 40s. Rate: 7.7 symbols/min [2025-10-08T17:14:40.578202] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:40.634928] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-08T17:14:40.635256] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-08T17:14:40.808679] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:14:40.808875] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-08T17:14:40.808921] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-08T17:14:40.809154] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-08T17:14:40.809211] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-08T17:14:40.822900] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-08T17:14:41.163406] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:41.617558] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-08T17:14:41.881675] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T17:14:42.241596] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:14:42.417606] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-08T17:14:43.217561] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-08T17:14:43.773863] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T17:14:43.945327] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T17:14:44.017548] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-08T17:14:44.280710] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T17:14:44.817568] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-08T17:14:45.452773] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T17:14:45.617556] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-08T17:14:46.417585] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-08T17:14:46.920491] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T17:14:47.217559] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-08T17:14:47.344733] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T17:14:47.787232] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T17:14:47.791222] [INFO ] [REMOTE ] AMTM: Full fetch complete (73931 records). [2025-10-08T17:14:47.791377] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-08T17:14:48.022843] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-08T17:14:48.192585] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-08T17:14:48.192832] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-08T17:14:48.193582] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-08T17:14:48.193661] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-08T17:14:48.195188] [DEBUG] [LOCAL ] AMTM: Trimmed 73931 records to 50653 (keeping 200 days of data) [2025-10-08T17:14:48.501181] [DEBUG] [LOCAL ] AMTM: Primary data saved (50653 records). [2025-10-08T17:14:48.501332] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-08T17:14:48.501443] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMTM took 42.4s. Estimated remaining: 4h 54m 38s. Rate: 7.7 symbols/min [2025-10-08T17:14:48.667329] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:48.716254] [DEBUG] [LOCAL ] ANF: Loaded 52101 existing records from primary storage. [2025-10-08T17:14:48.716678] [INFO ] [MAIN ] ANF: Loaded 52101 existing records. [2025-10-08T17:14:48.822781] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-08T17:14:48.895235] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:14:48.895438] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-08T17:14:48.895484] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-08T17:14:48.895707] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-08T17:14:48.895764] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-08T17:14:49.254927] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:49.452951] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:14:49.623092] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-08T17:14:49.628998] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-08T17:14:50.115927] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T17:14:50.417569] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-08T17:14:51.089227] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T17:14:51.217574] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-08T17:14:51.542629] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T17:14:52.017541] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-08T17:14:52.817530] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-08T17:14:52.947982] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T17:14:53.520039] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T17:14:53.523846] [INFO ] [REMOTE ] AMX: Full fetch complete (70731 records). [2025-10-08T17:14:53.524017] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-08T17:14:53.623015] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-08T17:14:53.937716] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-08T17:14:53.937849] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-08T17:14:53.938679] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-08T17:14:53.938761] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-08T17:14:53.940543] [DEBUG] [LOCAL ] AMX: Trimmed 70731 records to 49124 (keeping 200 days of data) [2025-10-08T17:14:54.058691] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:14:54.274933] [DEBUG] [LOCAL ] AMX: Primary data saved (49124 records). [2025-10-08T17:14:54.275108] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-08T17:14:54.275191] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 31.9s. Estimated remaining: 4h 53m 49s. Rate: 7.7 symbols/min [2025-10-08T17:14:54.428174] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-08T17:14:54.463102] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:54.463306] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-08T17:14:54.463364] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-08T17:14:54.463508] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-08T17:14:54.463574] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-08T17:14:54.463623] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-08T17:14:54.463700] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-08T17:14:54.830187] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:55.217562] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-08T17:14:55.572217] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T17:14:55.749216] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:14:56.017536] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-08T17:14:56.817585] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-08T17:14:57.009444] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:14:57.009822] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-08T17:14:57.009925] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:14:57.010011] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-08T17:14:57.010090] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:14:57.010179] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-08T17:14:57.010259] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-08T17:14:57.010298] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-08T17:14:57.010338] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-08T17:14:57.010386] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. ANGX took 2.7s. Estimated remaining: 4h 52m 2s. Rate: 7.7 symbols/min [2025-10-08T17:14:57.189428] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:57.189634] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-10-08T17:14:57.189711] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-10-08T17:14:57.189824] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-08T17:14:57.189868] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-08T17:14:57.189909] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-08T17:14:57.189941] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-08T17:14:57.575265] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:57.608295] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-08T17:14:57.618953] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-08T17:14:57.753878] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T17:14:58.417632] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-08T17:14:58.759068] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T17:14:59.217598] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-08T17:15:00.017707] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-08T17:15:00.819628] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-08T17:15:00.822126] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-08T17:15:01.010037] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T17:15:01.162405] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T17:15:01.617619] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-08T17:15:02.353820] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T17:15:02.417548] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-08T17:15:03.217692] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-08T17:15:03.339667] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T17:15:03.937485] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-08T17:15:04.017545] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-08T17:15:04.817511] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-08T17:15:05.276832] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T17:15:05.617511] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-08T17:15:05.771411] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T17:15:06.115284] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-08T17:15:06.417584] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-08T17:15:06.568728] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T17:15:07.217531] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-08T17:15:07.258579] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T17:15:07.261308] [INFO ] [REMOTE ] AN: Full fetch complete (47151 records). [2025-10-08T17:15:07.261741] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-08T17:15:07.263568] [FATAL] [VALIDATOR ] AN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:15:07.263718] [FATAL] [MAIN ] AN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:15:07.263776] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:15:07.263850] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-08T17:15:07.263922] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-08T17:15:07.263962] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-10-08T17:15:07.264245] [DEBUG] [LOCAL ] AN: Deleted derivative data file. [2025-10-08T17:15:07.264395] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. AN took 31.5s. Estimated remaining: 4h 52m 42s. Rate: 7.7 symbols/min [2025-10-08T17:15:07.434762] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:07.434989] [DEBUG] [LOCAL ] ANVS: No existing data file found in primary storage. [2025-10-08T17:15:07.435028] [WARN ] [MAIN ] ANVS: No existing data found, performing full refresh instead. [2025-10-08T17:15:07.435146] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-08T17:15:07.435186] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-08T17:15:07.435227] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-08T17:15:07.435260] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-08T17:15:07.798104] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:08.017543] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-08T17:15:08.817577] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-08T17:15:09.100433] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T17:15:09.533998] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:15:09.617557] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-08T17:15:09.817108] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T17:15:10.417719] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-08T17:15:10.966233] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T17:15:11.217586] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-08T17:15:12.017536] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-08T17:15:12.259589] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T17:15:12.536371] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T17:15:12.817564] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-08T17:15:13.540601] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T17:15:13.617554] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-08T17:15:14.264638] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T17:15:14.417560] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-08T17:15:15.217557] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-08T17:15:16.017533] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-08T17:15:16.078896] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-08T17:15:16.162800] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T17:15:16.472057] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T17:15:16.802093] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T17:15:16.817507] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-08T17:15:17.617565] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-08T17:15:18.417541] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-08T17:15:18.557000] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T17:15:18.720945] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:15:19.217508] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-08T17:15:19.307462] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:15:20.017541] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-08T17:15:20.817573] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-08T17:15:21.281738] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T17:15:21.307952] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T17:15:21.506522] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:15:21.617569] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-08T17:15:22.422080] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-08T17:15:22.426872] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T17:15:22.981043] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T17:15:23.217702] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-08T17:15:23.988835] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T17:15:24.017549] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-08T17:15:24.817561] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-08T17:15:24.980697] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T17:15:25.617609] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-08T17:15:26.417589] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-08T17:15:27.035148] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-08T17:15:27.040080] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-08T17:15:27.040300] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-08T17:15:27.225997] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-08T17:15:27.495407] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-08T17:15:27.496332] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-08T17:15:27.499060] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T17:15:27.498011] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-08T17:15:27.502154] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-08T17:15:27.502747] [INFO ] [REMOTE ] ANRO: Full fetch complete (29609 records). [2025-10-08T17:15:27.502884] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-08T17:15:27.611639] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 53766 (keeping 200 days of data) [2025-10-08T17:15:27.801246] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-08T17:15:27.840785] [INFO ] [REMOTE ] ANF: Full fetch complete (75610 records). [2025-10-08T17:15:27.871076] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-08T17:15:28.316085] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-08T17:15:28.317867] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-08T17:15:28.337469] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-08T17:15:28.388469] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-08T17:15:28.489989] [DEBUG] [LOCAL ] ANRO: Trimmed 29609 records to 19212 (keeping 200 days of data) [2025-10-08T17:15:28.704157] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T17:15:28.703457] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-08T17:15:28.754022] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-08T17:15:28.774971] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-08T17:15:28.775742] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-08T17:15:28.775630] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-08T17:15:28.788519] [DEBUG] [LOCAL ] ANF: Trimmed 75610 records to 52101 (keeping 200 days of data) [2025-10-08T17:15:28.958765] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-08T17:15:28.961558] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-08T17:15:28.967290] [DEBUG] [LOCAL ] ANRO: Primary data saved (19212 records). [2025-10-08T17:15:28.965302] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANET took 48.6s. Estimated remaining: 4h 57m 3s. Rate: 7.6 symbols/min [2025-10-08T17:15:28.967948] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-08T17:15:28.968141] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 32.0s. Estimated remaining: 4h 54m 24s. Rate: 7.7 symbols/min [2025-10-08T17:15:29.170442] [DEBUG] [LOCAL ] ANF: Primary data saved (52101 records). [2025-10-08T17:15:29.170617] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-08T17:15:29.170760] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANF took 40.7s. Estimated remaining: 4h 51m 52s. Rate: 7.7 symbols/min [2025-10-08T17:15:29.854630] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T17:15:29.859920] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-08T17:15:30.785197] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:15:30.789602] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-08T17:15:31.962545] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T17:15:31.965571] [INFO ] [REMOTE ] ANVS: Full fetch complete (35929 records). [2025-10-08T17:15:31.965801] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-08T17:15:31.966895] [FATAL] [VALIDATOR ] ANVS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:15:31.969572] [FATAL] [MAIN ] ANVS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:15:31.970590] [WARN ] [MAIN ] ANVS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:15:31.970777] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-08T17:15:31.970897] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-08T17:15:31.970951] [INFO ] [LOCAL ] ANVS: Starting deletion of derivative data. [2025-10-08T17:15:31.971021] [DEBUG] [LOCAL ] ANVS: No derivative data file found to delete. [2025-10-08T17:15:31.971163] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 24.7s. Estimated remaining: 4h 50m 10s. Rate: 7.8 symbols/min [2025-10-08T17:15:32.722802] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:32.828265] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:32.845406] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-08T17:15:32.875038] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-10-08T17:15:32.928511] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:32.933126] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-10-08T17:15:32.908871] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-08T17:15:32.932869] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:32.933468] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-08T17:15:32.934128] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-08T17:15:32.934000] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-08T17:15:32.934590] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-08T17:15:32.934502] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-08T17:15:32.935068] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-08T17:15:32.935170] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-08T17:15:32.935226] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-08T17:15:33.315874] [DEBUG] [LOCAL ] AOMR: Loaded 16462 existing records from primary storage. [2025-10-08T17:15:33.361924] [INFO ] [MAIN ] AOMR: Loaded 16462 existing records. [2025-10-08T17:15:33.617392] [DEBUG] [LOCAL ] AON: Loaded 45201 existing records from primary storage. [2025-10-08T17:15:33.665173] [INFO ] [MAIN ] AON: Loaded 45201 existing records. [2025-10-08T17:15:34.024733] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:15:34.029830] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:34.033276] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:34.033401] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-08T17:15:34.034497] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-08T17:15:34.034440] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-08T17:15:34.034233] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-08T17:15:34.058547] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-08T17:15:34.058805] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-08T17:15:34.184483] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:15:34.197313] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-08T17:15:34.197434] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-08T17:15:34.227861] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-08T17:15:34.230907] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-08T17:15:34.349377] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:15:34.384900] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-08T17:15:34.418875] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:15:34.444251] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-08T17:15:34.539987] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:15:34.595525] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-08T17:15:34.644986] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-08T17:15:34.683145] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-08T17:15:34.746247] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-08T17:15:34.789542] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:34.806473] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-08T17:15:34.789771] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.8s. Estimated remaining: 4h 48m 31s. Rate: 7.8 symbols/min [2025-10-08T17:15:34.960281] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:34.976702] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-08T17:15:35.073212] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:35.073469] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-08T17:15:35.073527] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-08T17:15:35.073661] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-08T17:15:35.073722] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-08T17:15:35.073768] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-08T17:15:35.073808] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-08T17:15:35.460875] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T17:15:35.489110] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-08T17:15:35.561582] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:35.562204] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-08T17:15:35.684322] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T17:15:35.687303] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-08T17:15:36.358518] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:15:36.367157] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-08T17:15:36.477914] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T17:15:36.706491] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T17:15:36.817533] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-08T17:15:36.873475] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:15:37.493204] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T17:15:37.617517] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-08T17:15:37.922101] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T17:15:38.417563] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-08T17:15:38.615825] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T17:15:39.217578] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-08T17:15:39.597927] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:15:39.856097] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T17:15:40.017567] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-08T17:15:40.817578] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-08T17:15:41.580536] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T17:15:41.617542] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-08T17:15:41.696966] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T17:15:42.417584] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-08T17:15:42.865316] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T17:15:43.217566] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-08T17:15:43.890676] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:15:43.911278] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T17:15:44.017552] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-08T17:15:44.817617] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-08T17:15:45.310717] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T17:15:45.617573] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-08T17:15:46.235904] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:15:46.417595] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-08T17:15:46.999870] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T17:15:47.217553] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-08T17:15:48.017587] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-08T17:15:48.322099] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T17:15:48.352362] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:15:48.817569] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-08T17:15:48.844879] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T17:15:49.617621] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-08T17:15:50.157776] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T17:15:50.417601] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-08T17:15:51.217575] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-08T17:15:51.297334] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:15:51.518867] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:15:52.017620] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-08T17:15:52.256860] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T17:15:52.817628] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-08T17:15:53.176080] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:15:53.617524] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-08T17:15:53.826335] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T17:15:54.417618] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-08T17:15:54.633103] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T17:15:55.217585] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-08T17:15:55.248848] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T17:15:56.017591] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-08T17:15:56.817587] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-08T17:15:56.904381] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:15:57.617518] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-08T17:15:57.667164] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T17:15:58.016023] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:15:58.417604] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-08T17:15:59.173025] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:15:59.217585] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-08T17:15:59.278321] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-08T17:16:00.017551] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-08T17:16:00.443753] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T17:16:00.817569] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-08T17:16:01.551573] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T17:16:01.617495] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-08T17:16:01.826247] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:16:01.827825] [INFO ] [REMOTE ] AOMR: Full fetch complete (23164 records). [2025-10-08T17:16:01.827935] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-08T17:16:02.289473] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-08T17:16:02.289598] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-08T17:16:02.290097] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-08T17:16:02.290171] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-08T17:16:02.290921] [DEBUG] [LOCAL ] AOMR: Trimmed 23164 records to 16437 (keeping 200 days of data) [2025-10-08T17:16:02.404592] [DEBUG] [LOCAL ] AOMR: Primary data saved (16437 records). [2025-10-08T17:16:02.404782] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-08T17:16:02.404888] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 30.4s. Estimated remaining: 4h 54m 31s. Rate: 7.6 symbols/min [2025-10-08T17:16:02.419142] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-08T17:16:02.605304] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:02.658180] [DEBUG] [LOCAL ] AOS: Loaded 48724 existing records from primary storage. [2025-10-08T17:16:02.673473] [INFO ] [MAIN ] AOS: Loaded 48724 existing records. [2025-10-08T17:16:02.708358] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:16:02.867972] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:02.868231] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-08T17:16:02.868322] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-08T17:16:02.868635] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-08T17:16:02.868732] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-08T17:16:03.216019] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:03.217499] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-08T17:16:03.701163] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:16:03.703493] [INFO ] [REMOTE ] AORT: Full fetch complete (42066 records). [2025-10-08T17:16:03.703591] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-08T17:16:04.023765] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-08T17:16:04.073829] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-08T17:16:04.073924] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-08T17:16:04.074421] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-08T17:16:04.074464] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-08T17:16:04.075511] [DEBUG] [LOCAL ] AORT: Trimmed 42066 records to 29234 (keeping 200 days of data) [2025-10-08T17:16:04.244970] [DEBUG] [LOCAL ] AORT: Primary data saved (29234 records). [2025-10-08T17:16:04.245123] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-08T17:16:04.245200] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AORT took 29.4s. Estimated remaining: 4h 52m 33s. Rate: 7.7 symbols/min [2025-10-08T17:16:04.410260] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:04.410481] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-10-08T17:16:04.410535] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-10-08T17:16:04.410680] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-08T17:16:04.410738] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-08T17:16:04.410782] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-08T17:16:04.410813] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-08T17:16:04.756490] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:04.817502] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-08T17:16:05.125415] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T17:16:05.472623] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T17:16:05.504964] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:16:05.617524] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-08T17:16:06.417581] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-08T17:16:07.078464] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T17:16:07.217522] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-08T17:16:07.257484] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:16:08.017568] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-08T17:16:08.563339] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T17:16:08.565891] [INFO ] [REMOTE ] AOD: Full fetch complete (44297 records). [2025-10-08T17:16:08.565985] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-08T17:16:08.566598] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:16:08.566718] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:16:08.566807] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:16:08.566879] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-08T17:16:08.566947] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-08T17:16:08.566982] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-10-08T17:16:08.567020] [DEBUG] [LOCAL ] AOD: No derivative data file found to delete. [2025-10-08T17:16:08.567076] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOD took 36.6s. Estimated remaining: 4h 51m 22s. Rate: 7.7 symbols/min [2025-10-08T17:16:08.731947] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:08.732116] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-08T17:16:08.732152] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-08T17:16:08.732261] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-08T17:16:08.732302] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-08T17:16:08.732342] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-08T17:16:08.732377] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-08T17:16:08.826770] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-08T17:16:09.164311] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:09.171309] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:16:09.174043] [INFO ] [REMOTE ] AON: Full fetch complete (64394 records). [2025-10-08T17:16:09.174128] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-08T17:16:09.174718] [FATAL] [VALIDATOR ] AON: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:16:09.174806] [FATAL] [MAIN ] AON: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:16:09.174848] [WARN ] [MAIN ] AON: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:16:09.174886] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-08T17:16:09.174965] [DEBUG] [LOCAL ] AON: No primary data file found to delete. [2025-10-08T17:16:09.175025] [INFO ] [LOCAL ] AON: Starting deletion of derivative data. [2025-10-08T17:16:09.175370] [DEBUG] [LOCAL ] AON: Deleted derivative data file. [2025-10-08T17:16:09.175476] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 37.2s. Estimated remaining: 4h 49m 5s. Rate: 7.8 symbols/min [2025-10-08T17:16:09.340824] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:09.340999] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-10-08T17:16:09.341036] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-10-08T17:16:09.341145] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-08T17:16:09.341185] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-08T17:16:09.341231] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-10-08T17:16:09.341297] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-08T17:16:09.622693] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-08T17:16:09.694821] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:10.368925] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:16:10.417522] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-08T17:16:11.017676] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T17:16:11.217704] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-08T17:16:12.017567] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-08T17:16:12.063755] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T17:16:12.394166] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:16:12.817558] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-08T17:16:12.929881] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:16:13.617502] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-08T17:16:14.099758] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:16:14.417573] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-08T17:16:15.217539] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-08T17:16:15.449960] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T17:16:15.833074] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T17:16:15.945232] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T17:16:16.017511] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-08T17:16:16.817556] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-08T17:16:17.311240] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T17:16:17.516494] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T17:16:17.617581] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-08T17:16:18.417573] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-08T17:16:19.133293] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T17:16:19.199256] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T17:16:19.217501] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-08T17:16:20.017578] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-08T17:16:20.155833] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T17:16:20.817625] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-08T17:16:21.617555] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-08T17:16:21.715856] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:16:22.277890] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:16:22.417550] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-08T17:16:23.217548] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-08T17:16:23.260798] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T17:16:23.883229] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:16:23.944256] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T17:16:24.017693] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-08T17:16:24.497626] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T17:16:24.817881] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-08T17:16:25.558278] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T17:16:25.617553] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-08T17:16:26.393952] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T17:16:26.394979] [INFO ] [REMOTE ] AP: Full fetch complete (8957 records). [2025-10-08T17:16:26.395071] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-08T17:16:26.425246] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-08T17:16:26.762219] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-08T17:16:26.762300] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-08T17:16:26.762518] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-08T17:16:26.762557] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-08T17:16:26.763016] [DEBUG] [LOCAL ] AP: Trimmed 8957 records to 7216 (keeping 200 days of data) [2025-10-08T17:16:26.803783] [DEBUG] [LOCAL ] AP: Primary data saved (7216 records). [2025-10-08T17:16:26.803908] [INFO ] [MAIN ] AP: Full history saved. [2025-10-08T17:16:26.803982] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 22.6s. Estimated remaining: 4h 51m 54s. Rate: 7.7 symbols/min [2025-10-08T17:16:26.977392] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:27.027783] [DEBUG] [LOCAL ] APG: Loaded 50426 existing records from primary storage. [2025-10-08T17:16:27.028160] [INFO ] [MAIN ] APG: Loaded 50426 existing records. [2025-10-08T17:16:27.224726] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-08T17:16:27.232401] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:27.232788] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-08T17:16:27.232895] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-08T17:16:27.233226] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-08T17:16:27.233287] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-08T17:16:27.593962] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:28.017520] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-08T17:16:28.314198] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T17:16:28.410749] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T17:16:28.817545] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-08T17:16:29.503883] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:16:29.617501] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-08T17:16:30.213812] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:16:30.417592] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-08T17:16:31.129492] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T17:16:31.217575] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-08T17:16:31.846966] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:16:32.017577] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-08T17:16:32.753720] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T17:16:32.817582] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-08T17:16:33.526634] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:16:33.617519] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-08T17:16:34.417519] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-08T17:16:34.467047] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T17:16:35.217558] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-08T17:16:35.567584] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T17:16:35.643477] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T17:16:36.017551] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-08T17:16:36.817531] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-08T17:16:36.910210] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:16:37.323937] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:16:37.327809] [INFO ] [REMOTE ] AOS: Full fetch complete (70320 records). [2025-10-08T17:16:37.327974] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-08T17:16:37.329106] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:16:37.329233] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:16:37.329277] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:16:37.329316] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-08T17:16:37.329376] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-08T17:16:37.329445] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-10-08T17:16:37.329754] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-10-08T17:16:37.329854] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 34.9s. Estimated remaining: 4h 52m 34s. Rate: 7.7 symbols/min [2025-10-08T17:16:37.527795] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:37.578053] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-08T17:16:37.578412] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-08T17:16:37.622715] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-08T17:16:37.770075] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:37.771178] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-08T17:16:37.771284] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-08T17:16:37.772021] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-08T17:16:37.772079] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-08T17:16:37.985511] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T17:16:38.180270] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:38.417548] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-08T17:16:39.217605] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-08T17:16:39.514000] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T17:16:40.017603] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-08T17:16:40.239250] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T17:16:40.386986] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T17:16:40.817617] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-08T17:16:41.286190] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T17:16:41.617561] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-08T17:16:41.978580] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T17:16:42.417591] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-08T17:16:43.217551] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-08T17:16:43.312099] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:16:44.017586] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-08T17:16:44.289465] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:16:44.809335] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T17:16:44.819718] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-08T17:16:45.617630] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-08T17:16:45.736685] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T17:16:46.417554] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-08T17:16:46.449179] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:16:47.217590] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-08T17:16:47.367940] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T17:16:48.017574] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-08T17:16:48.232252] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T17:16:48.344868] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T17:16:48.817591] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-08T17:16:49.617509] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-08T17:16:49.713057] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T17:16:50.417595] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-08T17:16:50.692358] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T17:16:51.217576] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-08T17:16:51.427486] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T17:16:51.562865] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:16:51.565938] [INFO ] [REMOTE ] APAM: Full fetch complete (51835 records). [2025-10-08T17:16:51.566087] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-08T17:16:52.024293] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-08T17:16:52.026267] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-08T17:16:52.026367] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-08T17:16:52.026960] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-08T17:16:52.027146] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-08T17:16:52.028521] [DEBUG] [LOCAL ] APAM: Trimmed 51835 records to 36012 (keeping 200 days of data) [2025-10-08T17:16:52.249406] [DEBUG] [LOCAL ] APAM: Primary data saved (36012 records). [2025-10-08T17:16:52.249572] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-08T17:16:52.249682] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 43.7s. Estimated remaining: 4h 54m 31s. Rate: 7.6 symbols/min [2025-10-08T17:16:52.415086] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:52.471426] [DEBUG] [LOCAL ] APLE: Loaded 51950 existing records from primary storage. [2025-10-08T17:16:52.471946] [INFO ] [MAIN ] APLE: Loaded 51950 existing records. [2025-10-08T17:16:52.536925] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:16:52.582809] [INFO ] [REMOTE ] APG: Full fetch complete (71791 records). [2025-10-08T17:16:52.593248] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-08T17:16:52.823287] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-08T17:16:52.936234] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:52.968365] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-08T17:16:53.021399] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-08T17:16:53.048443] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-08T17:16:53.048558] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-08T17:16:53.316724] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-08T17:16:53.414295] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-08T17:16:53.427130] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-08T17:16:53.443870] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-08T17:16:53.537911] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:53.539052] [DEBUG] [LOCAL ] APG: Trimmed 71791 records to 50463 (keeping 200 days of data) [2025-10-08T17:16:53.620997] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-08T17:16:53.664198] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T17:16:53.924294] [DEBUG] [LOCAL ] APG: Primary data saved (50463 records). [2025-10-08T17:16:53.924466] [INFO ] [MAIN ] APG: Full history saved. [2025-10-08T17:16:53.924582] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APG took 27.1s. Estimated remaining: 4h 52m 35s. Rate: 7.7 symbols/min [2025-10-08T17:16:54.130088] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:54.191105] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-08T17:16:54.191499] [INFO ] [MAIN ] APO: Loaded 53383 existing records. [2025-10-08T17:16:54.420348] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-08T17:16:54.424459] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:54.426216] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-08T17:16:54.426271] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-08T17:16:54.426593] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-08T17:16:54.426687] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-08T17:16:54.887561] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:54.925236] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T17:16:55.217545] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-08T17:16:55.496493] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T17:16:55.828264] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T17:16:56.017621] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-08T17:16:56.817524] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-08T17:16:56.913501] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:16:57.289221] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:16:57.292694] [INFO ] [REMOTE ] APD: Full fetch complete (66868 records). [2025-10-08T17:16:57.292841] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-08T17:16:57.630202] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-08T17:16:57.691444] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-08T17:16:57.691551] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-08T17:16:57.692320] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-08T17:16:57.692392] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-08T17:16:57.693922] [DEBUG] [LOCAL ] APD: Trimmed 66868 records to 45285 (keeping 200 days of data) [2025-10-08T17:16:57.998350] [DEBUG] [LOCAL ] APD: Primary data saved (45285 records). [2025-10-08T17:16:57.998531] [INFO ] [MAIN ] APD: Full history saved. [2025-10-08T17:16:57.998636] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APD took 48.8s. Estimated remaining: 4h 51m 23s. Rate: 7.7 symbols/min [2025-10-08T17:16:58.194069] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:58.194350] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-08T17:16:58.194460] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-08T17:16:58.194777] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-08T17:16:58.194917] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-08T17:16:58.195127] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-08T17:16:58.195204] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-08T17:16:58.426875] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-08T17:16:58.526119] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:16:58.620612] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:59.155896] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T17:16:59.217572] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-08T17:17:00.017617] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-08T17:17:00.114615] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T17:17:00.195040] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T17:17:00.817609] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-08T17:17:01.207504] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-08T17:17:01.617516] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-08T17:17:01.772935] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T17:17:02.096251] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T17:17:02.417573] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-08T17:17:02.952555] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T17:17:03.217608] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-08T17:17:04.017576] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-08T17:17:04.817613] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-08T17:17:04.834236] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:17:05.373741] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T17:17:05.617631] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-08T17:17:06.417523] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-08T17:17:06.609558] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:17:06.913332] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:17:07.196445] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T17:17:07.217536] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-08T17:17:08.019435] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-08T17:17:08.020462] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:17:08.817553] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-08T17:17:09.506381] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:17:09.617591] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-08T17:17:10.125781] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-08T17:17:10.417557] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-08T17:17:11.110340] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T17:17:11.217597] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-08T17:17:12.017634] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-08T17:17:12.420989] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T17:17:12.751356] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:17:12.817498] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-08T17:17:13.617525] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-08T17:17:14.098387] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T17:17:14.417545] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-08T17:17:14.710199] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T17:17:15.217555] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-08T17:17:15.795482] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-08T17:17:15.799450] [INFO ] [REMOTE ] APH: Full fetch complete (77691 records). [2025-10-08T17:17:15.799590] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-08T17:17:16.025041] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-08T17:17:16.194034] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-08T17:17:16.194131] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-08T17:17:16.194979] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-08T17:17:16.195049] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-08T17:17:16.196615] [DEBUG] [LOCAL ] APH: Trimmed 77691 records to 53691 (keeping 200 days of data) [2025-10-08T17:17:16.573793] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-08T17:17:16.595023] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-08T17:17:16.595177] [INFO ] [MAIN ] APH: Full history saved. [2025-10-08T17:17:16.595275] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 39.3s. Estimated remaining: 4h 54m 20s. Rate: 7.6 symbols/min [2025-10-08T17:17:16.771425] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:16.777222] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:17:16.824155] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-08T17:17:16.829271] [DEBUG] [LOCAL ] APTV: Loaded 52052 existing records from primary storage. [2025-10-08T17:17:16.829829] [INFO ] [MAIN ] APTV: Loaded 52052 existing records. [2025-10-08T17:17:17.011628] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:17:17.011949] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-08T17:17:17.012006] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-08T17:17:17.037593] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-08T17:17:17.037751] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-08T17:17:17.082675] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T17:17:17.431991] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:17.596690] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T17:17:17.617559] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-08T17:17:18.417604] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-08T17:17:19.144439] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T17:17:19.145455] [INFO ] [REMOTE ] APOS: Full fetch complete (10400 records). [2025-10-08T17:17:19.145546] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-08T17:17:19.222688] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-08T17:17:19.521753] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-08T17:17:19.521895] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-08T17:17:19.522247] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-08T17:17:19.522347] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-08T17:17:19.523220] [DEBUG] [LOCAL ] APOS: Trimmed 10400 records to 7519 (keeping 200 days of data) [2025-10-08T17:17:19.597038] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T17:17:19.599110] [DEBUG] [LOCAL ] APOS: Primary data saved (7519 records). [2025-10-08T17:17:19.609935] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-08T17:17:19.610557] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APOS took 21.6s. Estimated remaining: 4h 52m 49s. Rate: 7.6 symbols/min [2025-10-08T17:17:19.775909] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:19.776111] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-08T17:17:19.776147] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-08T17:17:19.776263] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-08T17:17:19.776304] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-08T17:17:19.776343] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-08T17:17:19.776374] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-08T17:17:20.022717] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-08T17:17:20.136493] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:20.817518] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-08T17:17:21.058060] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T17:17:21.617533] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-08T17:17:21.717550] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:17:22.343134] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:17:22.417501] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-08T17:17:23.217517] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-08T17:17:23.266938] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T17:17:23.995105] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T17:17:24.017516] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-08T17:17:24.689813] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:17:24.817504] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-08T17:17:25.617520] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-08T17:17:25.661956] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T17:17:26.417574] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-08T17:17:26.841070] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-08T17:17:27.043833] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:17:27.217569] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-08T17:17:27.964570] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T17:17:28.017516] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-08T17:17:28.817565] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-08T17:17:29.165096] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T17:17:29.315530] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T17:17:29.617590] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-08T17:17:30.250193] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T17:17:30.417532] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-08T17:17:30.967404] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T17:17:31.217556] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-08T17:17:31.674630] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T17:17:31.678695] [INFO ] [REMOTE ] APO: Full fetch complete (77290 records). [2025-10-08T17:17:31.678809] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-08T17:17:32.022701] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-08T17:17:32.082410] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-08T17:17:32.082513] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-08T17:17:32.083351] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-08T17:17:32.083420] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-08T17:17:32.085293] [DEBUG] [LOCAL ] APO: Trimmed 77290 records to 53383 (keeping 200 days of data) [2025-10-08T17:17:32.424194] [DEBUG] [LOCAL ] APO: Primary data saved (53383 records). [2025-10-08T17:17:32.424352] [INFO ] [MAIN ] APO: Full history saved. [2025-10-08T17:17:32.425323] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APO took 38.5s. Estimated remaining: 4h 54m 5s. Rate: 7.6 symbols/min [2025-10-08T17:17:32.599921] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:32.600164] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-10-08T17:17:32.600220] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-10-08T17:17:32.600401] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-08T17:17:32.600495] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-08T17:17:32.600584] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-10-08T17:17:32.600633] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-08T17:17:32.825491] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-08T17:17:32.964173] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:33.150941] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T17:17:33.617554] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-08T17:17:33.790573] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T17:17:34.339853] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T17:17:34.417589] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-08T17:17:34.439556] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:17:34.446062] [INFO ] [REMOTE ] APLE: Full fetch complete (74374 records). [2025-10-08T17:17:34.446511] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-08T17:17:34.822280] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-08T17:17:34.952113] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-08T17:17:34.952241] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-08T17:17:34.953168] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-08T17:17:34.953243] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-08T17:17:34.954938] [DEBUG] [LOCAL ] APLE: Trimmed 74374 records to 51926 (keeping 200 days of data) [2025-10-08T17:17:35.217553] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-08T17:17:35.312093] [DEBUG] [LOCAL ] APLE: Primary data saved (51926 records). [2025-10-08T17:17:35.312263] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-08T17:17:35.312376] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APLE took 43.1s. Estimated remaining: 4h 52m 33s. Rate: 7.6 symbols/min [2025-10-08T17:17:35.506926] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:35.565023] [DEBUG] [LOCAL ] AR: Loaded 53589 existing records from primary storage. [2025-10-08T17:17:35.565460] [INFO ] [MAIN ] AR: Loaded 53589 existing records. [2025-10-08T17:17:35.776432] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:17:35.776762] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-08T17:17:35.776844] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-08T17:17:35.777174] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-08T17:17:35.777243] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-08T17:17:36.022673] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-08T17:17:36.205565] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:36.817608] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-08T17:17:36.876798] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T17:17:37.281120] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T17:17:37.527599] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T17:17:37.617585] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-08T17:17:38.169540] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T17:17:38.417621] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-08T17:17:39.217617] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-08T17:17:40.017557] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-08T17:17:40.279071] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:17:40.614232] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T17:17:40.615686] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:17:40.817594] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-08T17:17:41.617595] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-08T17:17:42.417516] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-08T17:17:42.599914] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T17:17:43.045078] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T17:17:43.217546] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-08T17:17:43.326945] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:17:43.817011] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T17:17:44.017515] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-08T17:17:44.817593] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-08T17:17:45.617578] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-08T17:17:45.862269] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T17:17:46.324090] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T17:17:46.417532] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-08T17:17:47.217550] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-08T17:17:47.311032] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T17:17:47.659513] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-08T17:17:48.017583] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-08T17:17:48.220477] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:17:48.817558] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-08T17:17:49.617596] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-08T17:17:49.643729] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T17:17:49.648361] [INFO ] [REMOTE ] AQN: Full fetch complete (75259 records). [2025-10-08T17:17:49.648593] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-08T17:17:50.112705] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-08T17:17:50.112907] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-08T17:17:50.113757] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-08T17:17:50.113867] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-08T17:17:50.115754] [DEBUG] [LOCAL ] AQN: Trimmed 75259 records to 51841 (keeping 200 days of data) [2025-10-08T17:17:50.238343] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T17:17:50.426837] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-08T17:17:50.469992] [DEBUG] [LOCAL ] AQN: Primary data saved (51841 records). [2025-10-08T17:17:50.470266] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-08T17:17:50.470392] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQN took 30.9s. Estimated remaining: 4h 54m 27s. Rate: 7.6 symbols/min [2025-10-08T17:17:50.641847] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:50.684867] [DEBUG] [LOCAL ] ARCO: Loaded 44383 existing records from primary storage. [2025-10-08T17:17:50.685245] [INFO ] [MAIN ] ARCO: Loaded 44383 existing records. [2025-10-08T17:17:50.877502] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:17:50.877774] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-08T17:17:50.877826] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-08T17:17:50.878159] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-08T17:17:50.878218] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-08T17:17:51.225817] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-08T17:17:51.273068] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:51.605075] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T17:17:51.819082] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T17:17:51.870673] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:17:52.017600] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-08T17:17:52.817630] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-08T17:17:53.406467] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T17:17:53.435546] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T17:17:53.617612] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-08T17:17:54.098767] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T17:17:54.099623] [INFO ] [REMOTE ] AQNB: Full fetch complete (5612 records). [2025-10-08T17:17:54.099726] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-08T17:17:54.423403] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-08T17:17:54.459408] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-08T17:17:54.459532] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-08T17:17:54.459768] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-08T17:17:54.459830] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-08T17:17:54.460360] [DEBUG] [LOCAL ] AQNB: Trimmed 5612 records to 4147 (keeping 200 days of data) [2025-10-08T17:17:54.491578] [DEBUG] [LOCAL ] AQNB: Primary data saved (4147 records). [2025-10-08T17:17:54.491738] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-08T17:17:54.491836] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. AQNB took 22.1s. Estimated remaining: 4h 53m 15s. Rate: 7.6 symbols/min [2025-10-08T17:17:54.665152] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:54.687214] [DEBUG] [LOCAL ] ARDC: Loaded 15020 existing records from primary storage. [2025-10-08T17:17:54.687493] [INFO ] [MAIN ] ARDC: Loaded 15020 existing records. [2025-10-08T17:17:54.864804] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:17:54.865111] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-08T17:17:54.865164] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-08T17:17:54.865440] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-08T17:17:54.865499] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-08T17:17:55.219411] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-08T17:17:55.245032] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:56.017517] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-08T17:17:56.121416] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T17:17:56.817530] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-08T17:17:56.976102] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T17:17:57.552807] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:17:57.617520] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-08T17:17:58.417564] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-08T17:17:58.607824] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T17:17:58.608524] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T17:17:59.217576] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-08T17:17:59.441048] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:18:00.017616] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-08T17:18:00.817591] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-08T17:18:01.053301] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:18:01.603548] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T17:18:01.617501] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-08T17:18:02.417566] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-08T17:18:02.554860] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:18:03.217578] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-08T17:18:03.258725] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T17:18:03.308408] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T17:18:04.017604] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-08T17:18:04.817562] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-08T17:18:05.104969] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T17:18:05.443192] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T17:18:05.447210] [INFO ] [REMOTE ] APTV: Full fetch complete (75874 records). [2025-10-08T17:18:05.447347] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-08T17:18:05.622727] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-08T17:18:05.773750] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:18:05.858965] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-08T17:18:05.859054] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-08T17:18:05.859842] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-08T17:18:05.859908] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-08T17:18:05.861384] [DEBUG] [LOCAL ] APTV: Trimmed 75874 records to 52044 (keeping 200 days of data) [2025-10-08T17:18:06.173838] [DEBUG] [LOCAL ] APTV: Primary data saved (52044 records). [2025-10-08T17:18:06.174000] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-08T17:18:06.174089] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. APTV took 49.6s. Estimated remaining: 4h 54m 9s. Rate: 7.6 symbols/min [2025-10-08T17:18:06.341793] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:06.368111] [DEBUG] [LOCAL ] ARDT: Loaded 27787 existing records from primary storage. [2025-10-08T17:18:06.368369] [INFO ] [MAIN ] ARDT: Loaded 27787 existing records. [2025-10-08T17:18:06.430546] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-08T17:18:06.548915] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:18:06.549124] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-08T17:18:06.549198] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-08T17:18:06.549521] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-08T17:18:06.549595] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-08T17:18:06.905580] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:07.158290] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T17:18:07.217565] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-08T17:18:08.017522] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-08T17:18:08.295921] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T17:18:08.311837] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-08T17:18:08.316009] [INFO ] [REMOTE ] AR: Full fetch complete (77552 records). [2025-10-08T17:18:08.316170] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-08T17:18:08.708829] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-08T17:18:08.708919] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-08T17:18:08.709776] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-08T17:18:08.709845] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-08T17:18:08.711337] [DEBUG] [LOCAL ] AR: Trimmed 77552 records to 53590 (keeping 200 days of data) [2025-10-08T17:18:08.817802] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-08T17:18:09.031158] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:18:09.047987] [DEBUG] [LOCAL ] AR: Primary data saved (53590 records). [2025-10-08T17:18:09.048158] [INFO ] [MAIN ] AR: Full history saved. [2025-10-08T17:18:09.048249] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 33.7s. Estimated remaining: 4h 52m 40s. Rate: 7.6 symbols/min [2025-10-08T17:18:09.217319] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:09.266980] [DEBUG] [LOCAL ] ARE: Loaded 50729 existing records from primary storage. [2025-10-08T17:18:09.267322] [INFO ] [MAIN ] ARE: Loaded 50729 existing records. [2025-10-08T17:18:09.448056] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:18:09.448325] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-08T17:18:09.448373] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-08T17:18:09.452000] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-08T17:18:09.452082] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-08T17:18:09.625073] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-08T17:18:09.805073] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:10.288548] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T17:18:10.417571] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-08T17:18:10.663598] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T17:18:11.217556] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-08T17:18:12.017525] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-08T17:18:12.110485] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:18:12.121267] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T17:18:12.817592] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-08T17:18:13.097060] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:18:13.370178] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T17:18:13.617596] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-08T17:18:14.417583] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-08T17:18:14.640417] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T17:18:15.217570] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-08T17:18:15.894449] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T17:18:15.903527] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T17:18:16.017616] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-08T17:18:16.817573] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-08T17:18:17.581563] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:18:17.617514] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-08T17:18:18.417559] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-08T17:18:18.554751] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T17:18:19.217513] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-08T17:18:19.362395] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:18:19.449863] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T17:18:20.017576] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-08T17:18:20.459088] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:18:20.817566] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-08T17:18:21.617542] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-08T17:18:21.678507] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T17:18:21.681466] [INFO ] [REMOTE ] ARDC: Full fetch complete (21086 records). [2025-10-08T17:18:21.681587] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-08T17:18:21.837599] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T17:18:22.103525] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-08T17:18:22.103606] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-08T17:18:22.103929] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-08T17:18:22.103989] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-08T17:18:22.104579] [DEBUG] [LOCAL ] ARDC: Trimmed 21086 records to 15046 (keeping 200 days of data) [2025-10-08T17:18:22.198271] [DEBUG] [LOCAL ] ARDC: Primary data saved (15046 records). [2025-10-08T17:18:22.198419] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-08T17:18:22.198553] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 27.7s. Estimated remaining: 4h 53m 57s. Rate: 7.6 symbols/min [2025-10-08T17:18:22.369185] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:22.369384] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-08T17:18:22.369424] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-08T17:18:22.369538] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-08T17:18:22.369578] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-08T17:18:22.369620] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-08T17:18:22.369680] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-08T17:18:22.423086] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-08T17:18:22.724460] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:23.193282] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T17:18:23.217518] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-08T17:18:23.828439] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T17:18:24.017561] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-08T17:18:24.542669] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:18:24.545779] [INFO ] [REMOTE ] ARCO: Full fetch complete (64933 records). [2025-10-08T17:18:24.545898] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-08T17:18:24.546758] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:18:24.546885] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:18:24.546954] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:18:24.547024] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-08T17:18:24.547090] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-08T17:18:24.547126] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-08T17:18:24.547371] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-10-08T17:18:24.548127] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARCO took 34.1s. Estimated remaining: 4h 52m 21s. Rate: 7.6 symbols/min [2025-10-08T17:18:24.716298] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:24.716521] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-10-08T17:18:24.716582] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-10-08T17:18:24.716723] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-08T17:18:24.716772] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-08T17:18:24.716815] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-08T17:18:24.716846] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-08T17:18:24.822659] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-08T17:18:25.087476] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:25.566846] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:18:25.617501] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-08T17:18:26.214364] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T17:18:26.417632] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-08T17:18:27.217588] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-08T17:18:27.358886] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:18:27.580112] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:18:28.017553] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-08T17:18:28.797614] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T17:18:28.817499] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-08T17:18:29.617532] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-08T17:18:29.833723] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T17:18:30.417569] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-08T17:18:30.605514] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:18:31.217547] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-08T17:18:31.260320] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T17:18:32.017576] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-08T17:18:32.065437] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:18:32.416326] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T17:18:32.817613] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-08T17:18:33.617591] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-08T17:18:33.826325] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T17:18:34.322462] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:18:34.417552] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-08T17:18:34.903335] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T17:18:35.217600] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-08T17:18:35.538127] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T17:18:36.017579] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-08T17:18:36.808780] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T17:18:36.817670] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-08T17:18:37.617622] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-08T17:18:37.962160] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T17:18:38.121728] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T17:18:38.417560] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-08T17:18:38.826336] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T17:18:39.217585] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-08T17:18:40.017526] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-08T17:18:40.151151] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T17:18:40.817519] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-08T17:18:41.013329] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T17:18:41.041547] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T17:18:41.617564] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-08T17:18:42.378072] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:18:42.417577] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-08T17:18:42.721572] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:18:43.217560] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-08T17:18:43.780547] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T17:18:44.017614] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-08T17:18:44.817527] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-08T17:18:44.993045] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T17:18:45.097510] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T17:18:45.100344] [INFO ] [REMOTE ] ARDT: Full fetch complete (41588 records). [2025-10-08T17:18:45.100454] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-08T17:18:45.474532] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-08T17:18:45.474619] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-08T17:18:45.475144] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-08T17:18:45.475209] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-08T17:18:45.476192] [DEBUG] [LOCAL ] ARDT: Trimmed 41588 records to 27723 (keeping 200 days of data) [2025-10-08T17:18:45.624167] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-08T17:18:45.639101] [DEBUG] [LOCAL ] ARDT: Primary data saved (27723 records). [2025-10-08T17:18:45.639259] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-08T17:18:45.639349] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 39.5s. Estimated remaining: 4h 55m 42s. Rate: 7.5 symbols/min [2025-10-08T17:18:45.812297] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:45.852232] [DEBUG] [LOCAL ] ARIS: Loaded 42300 existing records from primary storage. [2025-10-08T17:18:45.852578] [INFO ] [MAIN ] ARIS: Loaded 42300 existing records. [2025-10-08T17:18:46.035514] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:18:46.035789] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-08T17:18:46.035842] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-08T17:18:46.036280] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-08T17:18:46.036342] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-08T17:18:46.421670] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-08T17:18:46.425219] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:46.599293] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:18:47.217539] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-08T17:18:47.352473] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:18:47.681519] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T17:18:48.017551] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-08T17:18:48.709299] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:18:48.817553] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-08T17:18:49.270541] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:18:49.617572] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-08T17:18:50.195435] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:18:50.417591] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-08T17:18:51.217518] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-08T17:18:51.437335] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T17:18:51.528821] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:18:52.017620] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-08T17:18:52.533501] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:18:52.537452] [INFO ] [REMOTE ] ARE: Full fetch complete (72716 records). [2025-10-08T17:18:52.537561] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-08T17:18:52.825348] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-08T17:18:52.931701] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-08T17:18:52.931789] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-08T17:18:52.932522] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-08T17:18:52.932585] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-08T17:18:52.933949] [DEBUG] [LOCAL ] ARE: Trimmed 72716 records to 50757 (keeping 200 days of data) [2025-10-08T17:18:53.205553] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T17:18:53.301884] [DEBUG] [LOCAL ] ARE: Primary data saved (50757 records). [2025-10-08T17:18:53.302043] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-08T17:18:53.302133] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARE took 44.3s. Estimated remaining: 4h 55m 30s. Rate: 7.5 symbols/min [2025-10-08T17:18:53.471809] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:53.472001] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-08T17:18:53.472040] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-08T17:18:53.472219] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-08T17:18:53.472281] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-08T17:18:53.472325] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-08T17:18:53.472358] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-08T17:18:53.622760] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-08T17:18:53.873890] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:54.417565] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-08T17:18:54.486119] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:18:54.996594] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T17:18:55.217604] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-08T17:18:55.983956] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:18:56.017517] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-08T17:18:56.817542] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-08T17:18:56.841118] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:18:57.617559] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-08T17:18:57.641821] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:18:57.645946] [INFO ] [REMOTE ] ARES: Full fetch complete (70908 records). [2025-10-08T17:18:57.646105] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-08T17:18:58.060762] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-08T17:18:58.060851] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-08T17:18:58.061620] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-08T17:18:58.061705] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-08T17:18:58.064996] [DEBUG] [LOCAL ] ARES: Trimmed 70908 records to 49647 (keeping 200 days of data) [2025-10-08T17:18:58.203096] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:18:58.207815] [INFO ] [REMOTE ] ARI: Full fetch complete (62633 records). [2025-10-08T17:18:58.208733] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-08T17:18:58.440345] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-08T17:18:58.735738] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-08T17:18:58.735848] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-08T17:18:58.738504] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-08T17:18:58.739310] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-08T17:18:58.754869] [DEBUG] [LOCAL ] ARI: Trimmed 62633 records to 43669 (keeping 200 days of data) [2025-10-08T17:18:58.922428] [DEBUG] [LOCAL ] ARES: Primary data saved (49647 records). [2025-10-08T17:18:58.923211] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-08T17:18:58.923666] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 36.7s. Estimated remaining: 4h 54m 45s. Rate: 7.6 symbols/min [2025-10-08T17:18:59.193723] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:59.276325] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T17:18:59.301342] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-08T17:18:59.345708] [DEBUG] [LOCAL ] ARI: Primary data saved (43669 records). [2025-10-08T17:18:59.346512] [DEBUG] [LOCAL ] ARMK: Loaded 50378 existing records from primary storage. [2025-10-08T17:18:59.346607] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-08T17:18:59.346917] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 34.8s. Estimated remaining: 4h 52m 41s. Rate: 7.6 symbols/min [2025-10-08T17:18:59.347099] [INFO ] [MAIN ] ARMK: Loaded 50378 existing records. [2025-10-08T17:18:59.734301] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:59.739554] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:18:59.740205] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-08T17:18:59.740424] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-08T17:18:59.740987] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-08T17:18:59.741050] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-08T17:19:00.130058] [DEBUG] [LOCAL ] AROC: Loaded 48944 existing records from primary storage. [2025-10-08T17:19:00.154611] [INFO ] [MAIN ] AROC: Loaded 48944 existing records. [2025-10-08T17:19:00.193638] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:00.246116] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-08T17:19:00.367281] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T17:19:00.449140] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:00.449386] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-08T17:19:00.449435] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-08T17:19:00.449914] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-08T17:19:00.449976] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-08T17:19:00.817669] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:00.817800] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-08T17:19:00.984263] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:19:01.617536] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-08T17:19:01.790667] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:19:01.988766] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T17:19:02.417554] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-08T17:19:03.146343] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T17:19:03.217519] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-08T17:19:04.017517] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-08T17:19:04.108212] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:19:04.507811] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T17:19:04.817577] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-08T17:19:05.610073] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T17:19:05.619209] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-08T17:19:06.417547] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-08T17:19:06.499905] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T17:19:06.792215] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T17:19:07.217545] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-08T17:19:08.017585] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-08T17:19:08.135840] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T17:19:08.618973] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:19:08.817569] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-08T17:19:09.428784] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T17:19:09.617554] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-08T17:19:10.417554] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-08T17:19:10.481506] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T17:19:10.889134] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:19:10.893073] [INFO ] [REMOTE ] ARIS: Full fetch complete (61081 records). [2025-10-08T17:19:10.893219] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-08T17:19:11.228349] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-08T17:19:11.294314] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-08T17:19:11.294412] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-08T17:19:11.295167] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-08T17:19:11.295234] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-08T17:19:11.296746] [DEBUG] [LOCAL ] ARIS: Trimmed 61081 records to 42358 (keeping 200 days of data) [2025-10-08T17:19:11.584877] [DEBUG] [LOCAL ] ARIS: Primary data saved (42358 records). [2025-10-08T17:19:11.585033] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-08T17:19:11.585139] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 25.9s. Estimated remaining: 4h 53m 40s. Rate: 7.6 symbols/min [2025-10-08T17:19:11.772949] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:11.838982] [DEBUG] [LOCAL ] ARR: Loaded 52067 existing records from primary storage. [2025-10-08T17:19:11.839436] [INFO ] [MAIN ] ARR: Loaded 52067 existing records. [2025-10-08T17:19:12.021245] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-08T17:19:12.030129] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:12.031953] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-08T17:19:12.032091] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-08T17:19:12.040479] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-08T17:19:12.054895] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-08T17:19:12.093772] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:19:12.470872] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:12.813395] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T17:19:12.822104] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-08T17:19:13.617546] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-08T17:19:13.688152] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T17:19:14.364794] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:19:14.417564] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-08T17:19:14.523634] [DEBUG] [REMOTE ] ARR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-08T17:19:14.523993] [WARN ] [REMOTE ] ARR: No data returned for month 2025-01 [2025-10-08T17:19:14.524081] [FATAL] [REMOTE ] ARR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:19:14.524158] [FATAL] [MAIN ] ARR: Failed to fetch primary data. [2025-10-08T17:19:14.524240] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:19:14.524312] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-08T17:19:14.524375] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-08T17:19:14.524409] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-08T17:19:14.524620] [DEBUG] [LOCAL ] ARR: Deleted derivative data file. [2025-10-08T17:19:14.524737] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARR took 2.9s. Estimated remaining: 4h 52m 16s. Rate: 7.6 symbols/min [2025-10-08T17:19:14.694841] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:14.731985] [DEBUG] [LOCAL ] ARW: Loaded 32930 existing records from primary storage. [2025-10-08T17:19:14.732315] [INFO ] [MAIN ] ARW: Loaded 32930 existing records. [2025-10-08T17:19:14.953341] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:14.953726] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-08T17:19:14.953865] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-08T17:19:14.954122] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-08T17:19:14.954192] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-08T17:19:15.163279] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T17:19:15.233126] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-08T17:19:15.371716] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:16.017572] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-08T17:19:16.817578] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-08T17:19:16.916032] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T17:19:17.139343] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T17:19:17.617568] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-08T17:19:18.313728] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:19:18.417579] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-08T17:19:19.217600] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-08T17:19:19.593984] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T17:19:20.017563] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-08T17:19:20.129521] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T17:19:20.817555] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-08T17:19:20.980689] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T17:19:21.343453] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T17:19:21.617554] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-08T17:19:22.118448] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:19:22.417560] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-08T17:19:23.229055] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-08T17:19:23.232099] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T17:19:23.860038] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:19:24.017577] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-08T17:19:24.626855] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T17:19:24.629893] [INFO ] [REMOTE ] ARLO: Full fetch complete (62648 records). [2025-10-08T17:19:24.630019] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-08T17:19:24.630995] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:19:24.631086] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:19:24.631127] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:19:24.631165] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-08T17:19:24.631222] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-08T17:19:24.631256] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-10-08T17:19:24.631293] [DEBUG] [LOCAL ] ARLO: No derivative data file found to delete. [2025-10-08T17:19:24.631363] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARLO took 31.3s. Estimated remaining: 4h 52m 42s. Rate: 7.6 symbols/min [2025-10-08T17:19:24.798589] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:24.798818] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-08T17:19:24.798861] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-08T17:19:24.798974] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-08T17:19:24.799014] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-08T17:19:24.799055] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-08T17:19:24.799087] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-08T17:19:24.828787] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-08T17:19:25.170680] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:25.369738] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T17:19:25.617621] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-08T17:19:26.360323] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T17:19:26.417574] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-08T17:19:27.217517] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-08T17:19:27.320889] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T17:19:28.017533] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-08T17:19:28.175835] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T17:19:28.215780] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:19:28.216209] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-08T17:19:28.216325] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:19:28.216413] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-08T17:19:28.216503] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:19:28.216604] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-08T17:19:28.216731] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-08T17:19:28.216786] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-08T17:19:28.216832] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-08T17:19:28.216888] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 3.6s. Estimated remaining: 4h 51m 29s. Rate: 7.6 symbols/min [2025-10-08T17:19:28.437206] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:28.495596] [DEBUG] [LOCAL ] AS: Loaded 53105 existing records from primary storage. [2025-10-08T17:19:28.496002] [INFO ] [MAIN ] AS: Loaded 53105 existing records. [2025-10-08T17:19:28.683253] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:19:28.732232] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:28.732953] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-08T17:19:28.733005] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-08T17:19:28.733261] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-08T17:19:28.733319] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-08T17:19:28.822778] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-08T17:19:29.098767] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:29.617551] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-08T17:19:30.417575] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-08T17:19:30.597848] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T17:19:31.227238] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-08T17:19:31.252463] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T17:19:31.935186] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T17:19:32.017581] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-08T17:19:32.354089] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:19:32.817561] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-08T17:19:33.617576] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-08T17:19:33.670482] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T17:19:34.417554] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-08T17:19:34.507969] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:19:35.042136] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T17:19:35.217576] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-08T17:19:35.719545] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:19:36.017561] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-08T17:19:36.817548] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-08T17:19:36.863470] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T17:19:36.867354] [INFO ] [REMOTE ] AROC: Full fetch complete (71016 records). [2025-10-08T17:19:36.867512] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-08T17:19:37.284796] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-08T17:19:37.285178] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-08T17:19:37.286147] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-08T17:19:37.286241] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-08T17:19:37.287833] [DEBUG] [LOCAL ] AROC: Trimmed 71016 records to 48975 (keeping 200 days of data) [2025-10-08T17:19:37.417821] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:19:37.621168] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-08T17:19:37.639768] [DEBUG] [LOCAL ] AROC: Primary data saved (48975 records). [2025-10-08T17:19:37.639930] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-08T17:19:37.640669] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. AROC took 38.3s. Estimated remaining: 4h 51m 45s. Rate: 7.6 symbols/min [2025-10-08T17:19:37.824136] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:37.844337] [DEBUG] [LOCAL ] ASA: Loaded 14503 existing records from primary storage. [2025-10-08T17:19:37.844615] [INFO ] [MAIN ] ASA: Loaded 14503 existing records. [2025-10-08T17:19:38.049019] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:38.049477] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-08T17:19:38.049603] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-08T17:19:38.049953] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-08T17:19:38.050153] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-08T17:19:38.366560] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:19:38.422709] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-08T17:19:38.502499] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:39.174343] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T17:19:39.178342] [INFO ] [REMOTE ] ARMK: Full fetch complete (72622 records). [2025-10-08T17:19:39.178514] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-08T17:19:39.222802] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-08T17:19:39.584520] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-08T17:19:39.584630] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-08T17:19:39.585463] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-08T17:19:39.585518] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-08T17:19:39.587097] [DEBUG] [LOCAL ] ARMK: Trimmed 72622 records to 50319 (keeping 200 days of data) [2025-10-08T17:19:39.825439] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T17:19:39.931043] [DEBUG] [LOCAL ] ARMK: Primary data saved (50319 records). [2025-10-08T17:19:39.931213] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-08T17:19:39.931332] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARMK took 41.0s. Estimated remaining: 4h 50m 14s. Rate: 7.7 symbols/min [2025-10-08T17:19:40.022793] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-08T17:19:40.104125] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:40.155041] [DEBUG] [LOCAL ] ASAN: Loaded 52722 existing records from primary storage. [2025-10-08T17:19:40.155383] [INFO ] [MAIN ] ASAN: Loaded 52722 existing records. [2025-10-08T17:19:40.331066] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:40.331308] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-08T17:19:40.331355] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-08T17:19:40.331754] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-08T17:19:40.331815] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-08T17:19:40.693278] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:40.828556] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-08T17:19:40.850234] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:19:41.021536] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:19:41.617609] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-08T17:19:42.417555] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-08T17:19:42.581913] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T17:19:42.977585] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T17:19:43.217569] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-08T17:19:43.305336] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T17:19:44.017599] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-08T17:19:44.817571] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-08T17:19:45.066890] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T17:19:45.558572] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T17:19:45.612982] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T17:19:45.617489] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-08T17:19:46.417611] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-08T17:19:46.438500] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T17:19:47.217593] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-08T17:19:48.017526] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-08T17:19:48.031014] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T17:19:48.194352] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T17:19:48.817552] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-08T17:19:48.974904] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T17:19:49.617617] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-08T17:19:50.319681] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:19:50.417548] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-08T17:19:50.572344] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T17:19:50.575155] [INFO ] [REMOTE ] ARW: Full fetch complete (48019 records). [2025-10-08T17:19:50.575266] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-08T17:19:50.958598] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-08T17:19:50.958722] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-08T17:19:50.959328] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-08T17:19:50.959395] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-08T17:19:50.960567] [DEBUG] [LOCAL ] ARW: Trimmed 48019 records to 32823 (keeping 200 days of data) [2025-10-08T17:19:51.167761] [DEBUG] [LOCAL ] ARW: Primary data saved (32823 records). [2025-10-08T17:19:51.167946] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-08T17:19:51.168052] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARW took 36.6s. Estimated remaining: 4h 50m 56s. Rate: 7.6 symbols/min [2025-10-08T17:19:51.224793] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-08T17:19:51.346389] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:51.392536] [DEBUG] [LOCAL ] ASB: Loaded 49558 existing records from primary storage. [2025-10-08T17:19:51.392898] [INFO ] [MAIN ] ASB: Loaded 49558 existing records. [2025-10-08T17:19:51.573755] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:51.574030] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-08T17:19:51.574150] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-08T17:19:51.574601] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-08T17:19:51.574696] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-08T17:19:51.943621] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:52.017504] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-08T17:19:52.139096] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T17:19:52.305267] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T17:19:52.817577] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-08T17:19:53.514761] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T17:19:53.617552] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-08T17:19:54.417523] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-08T17:19:54.557764] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T17:19:54.966037] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-08T17:19:55.217583] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-08T17:19:55.867052] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T17:19:56.017512] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-08T17:19:56.214111] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T17:19:56.817558] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-08T17:19:57.617529] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-08T17:19:57.701216] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T17:19:58.417579] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-08T17:19:58.786103] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-08T17:19:58.922484] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T17:19:59.217544] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-08T17:20:00.017521] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-08T17:20:00.172329] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T17:20:00.174244] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T17:20:00.817544] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-08T17:20:01.612923] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T17:20:01.621958] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-08T17:20:01.838093] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T17:20:02.417730] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-08T17:20:03.217542] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-08T17:20:03.626852] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T17:20:04.017584] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-08T17:20:04.394699] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T17:20:04.546397] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T17:20:04.817559] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-08T17:20:05.501522] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T17:20:05.505702] [INFO ] [REMOTE ] AS: Full fetch complete (76559 records). [2025-10-08T17:20:05.505816] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-08T17:20:05.622730] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-08T17:20:05.904743] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-08T17:20:05.904836] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-08T17:20:05.905575] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-08T17:20:05.905616] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-08T17:20:05.907066] [DEBUG] [LOCAL ] AS: Trimmed 76559 records to 53122 (keeping 200 days of data) [2025-10-08T17:20:06.224273] [DEBUG] [LOCAL ] AS: Primary data saved (53122 records). [2025-10-08T17:20:06.224440] [INFO ] [MAIN ] AS: Full history saved. [2025-10-08T17:20:06.224540] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. AS took 38.0s. Estimated remaining: 4h 52m 33s. Rate: 7.6 symbols/min [2025-10-08T17:20:06.395155] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:06.401347] [DEBUG] [LOCAL ] ASBA: Loaded 3471 existing records from primary storage. [2025-10-08T17:20:06.401511] [INFO ] [MAIN ] ASBA: Loaded 3471 existing records. [2025-10-08T17:20:06.432624] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-08T17:20:06.591369] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:06.591846] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-08T17:20:06.591927] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-08T17:20:06.592126] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-08T17:20:06.592220] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-08T17:20:06.927991] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-08T17:20:07.011107] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:07.217506] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-08T17:20:07.598776] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-08T17:20:07.609245] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:20:07.611268] [INFO ] [REMOTE ] ASA: Full fetch complete (19209 records). [2025-10-08T17:20:07.611344] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-08T17:20:07.612139] [FATAL] [VALIDATOR ] ASA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:20:07.612223] [FATAL] [MAIN ] ASA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:20:07.612265] [WARN ] [MAIN ] ASA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:20:07.612327] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-08T17:20:07.612390] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-08T17:20:07.612424] [INFO ] [LOCAL ] ASA: Starting deletion of derivative data. [2025-10-08T17:20:07.612621] [DEBUG] [LOCAL ] ASA: Deleted derivative data file. [2025-10-08T17:20:07.612740] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASA took 30.0s. Estimated remaining: 4h 50m 51s. Rate: 7.6 symbols/min [2025-10-08T17:20:07.783243] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:07.823005] [DEBUG] [LOCAL ] ASC: Loaded 37428 existing records from primary storage. [2025-10-08T17:20:07.823304] [INFO ] [MAIN ] ASC: Loaded 37428 existing records. [2025-10-08T17:20:08.011846] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T17:20:08.019604] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-08T17:20:08.025218] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:08.027754] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-08T17:20:08.028473] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-08T17:20:08.028771] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-08T17:20:08.028831] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-08T17:20:08.409197] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:08.817581] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-08T17:20:09.617578] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-08T17:20:10.301499] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-08T17:20:10.417553] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-08T17:20:10.600356] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T17:20:11.217537] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-08T17:20:11.614458] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T17:20:12.017613] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-08T17:20:12.063164] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T17:20:12.642413] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:20:12.734271] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T17:20:12.817551] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-08T17:20:13.617557] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-08T17:20:14.417547] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-08T17:20:14.458124] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T17:20:14.777447] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:20:15.217556] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-08T17:20:16.017536] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-08T17:20:16.345455] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T17:20:16.746488] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T17:20:16.817582] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-08T17:20:17.186860] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T17:20:17.617558] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-08T17:20:18.173144] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T17:20:18.417587] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-08T17:20:19.023376] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T17:20:19.217567] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-08T17:20:19.922536] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T17:20:20.017540] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-08T17:20:20.817521] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-08T17:20:21.037541] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T17:20:21.041693] [INFO ] [REMOTE ] ASAN: Full fetch complete (76527 records). [2025-10-08T17:20:21.041878] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-08T17:20:21.500552] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-08T17:20:21.500756] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-08T17:20:21.501735] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-08T17:20:21.501822] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-08T17:20:21.525553] [DEBUG] [LOCAL ] ASAN: Trimmed 76527 records to 52721 (keeping 200 days of data) [2025-10-08T17:20:21.525420] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:20:21.617512] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-08T17:20:21.855161] [DEBUG] [LOCAL ] ASAN: Primary data saved (52721 records). [2025-10-08T17:20:21.855357] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-08T17:20:21.855480] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 41.9s. Estimated remaining: 4h 52m 15s. Rate: 7.6 symbols/min [2025-10-08T17:20:22.026314] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:22.045459] [DEBUG] [LOCAL ] ASG: Loaded 19702 existing records from primary storage. [2025-10-08T17:20:22.045729] [INFO ] [MAIN ] ASG: Loaded 19702 existing records. [2025-10-08T17:20:22.224149] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:22.224394] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-08T17:20:22.224447] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-08T17:20:22.224678] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-08T17:20:22.224750] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-08T17:20:22.425915] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-08T17:20:22.593617] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:22.677430] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T17:20:22.863664] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T17:20:22.901239] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T17:20:23.217569] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-08T17:20:23.780443] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T17:20:24.017615] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-08T17:20:24.817587] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-08T17:20:25.425428] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T17:20:25.615296] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T17:20:25.618499] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-08T17:20:25.620062] [INFO ] [REMOTE ] ASB: Full fetch complete (71726 records). [2025-10-08T17:20:25.620142] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-08T17:20:26.024448] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-08T17:20:26.024546] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-08T17:20:26.025297] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-08T17:20:26.025368] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-08T17:20:26.026920] [DEBUG] [LOCAL ] ASB: Trimmed 71726 records to 49541 (keeping 200 days of data) [2025-10-08T17:20:26.259860] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T17:20:26.364937] [DEBUG] [LOCAL ] ASB: Primary data saved (49541 records). [2025-10-08T17:20:26.365151] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-08T17:20:26.365259] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 35.2s. Estimated remaining: 4h 51m 18s. Rate: 7.6 symbols/min [2025-10-08T17:20:26.423495] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-08T17:20:26.543965] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:26.570749] [DEBUG] [LOCAL ] ASGI: Loaded 22719 existing records from primary storage. [2025-10-08T17:20:26.571076] [INFO ] [MAIN ] ASGI: Loaded 22719 existing records. [2025-10-08T17:20:26.747815] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:26.748098] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-08T17:20:26.748168] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-08T17:20:26.748559] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-08T17:20:26.748673] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-08T17:20:27.102791] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:27.217526] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-08T17:20:27.461370] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T17:20:28.017628] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-08T17:20:28.710349] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T17:20:28.817557] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-08T17:20:29.237295] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T17:20:29.617571] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-08T17:20:30.210031] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:20:30.417540] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-08T17:20:30.908504] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T17:20:31.084448] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T17:20:31.217593] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-08T17:20:32.017509] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-08T17:20:32.105809] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T17:20:32.817511] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-08T17:20:33.251590] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T17:20:33.278153] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T17:20:33.617556] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-08T17:20:34.417522] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-08T17:20:34.772856] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T17:20:34.974609] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T17:20:35.217585] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-08T17:20:35.676596] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T17:20:35.677441] [INFO ] [REMOTE ] ASBA: Full fetch complete (5215 records). [2025-10-08T17:20:35.677509] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-08T17:20:36.019447] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-08T17:20:36.047515] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-08T17:20:36.047674] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-08T17:20:36.047863] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-08T17:20:36.047904] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-08T17:20:36.048303] [DEBUG] [LOCAL ] ASBA: Trimmed 5215 records to 3456 (keeping 200 days of data) [2025-10-08T17:20:36.073516] [DEBUG] [LOCAL ] ASBA: Primary data saved (3456 records). [2025-10-08T17:20:36.073672] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-08T17:20:36.073780] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASBA took 29.8s. Estimated remaining: 4h 51m 36s. Rate: 7.6 symbols/min [2025-10-08T17:20:36.248267] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:36.283872] [DEBUG] [LOCAL ] ASGN: Loaded 36349 existing records from primary storage. [2025-10-08T17:20:36.284164] [INFO ] [MAIN ] ASGN: Loaded 36349 existing records. [2025-10-08T17:20:36.469246] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:36.469482] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-08T17:20:36.469528] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-08T17:20:36.469778] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-08T17:20:36.469836] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-08T17:20:36.833927] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-08T17:20:36.857837] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:37.116009] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T17:20:37.617617] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-08T17:20:38.394132] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T17:20:38.418536] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-08T17:20:38.423390] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T17:20:39.217599] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-08T17:20:39.642892] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T17:20:40.017569] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-08T17:20:40.045685] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T17:20:40.817587] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-08T17:20:41.243525] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:20:41.247271] [INFO ] [REMOTE ] ASC: Full fetch complete (56450 records). [2025-10-08T17:20:41.247386] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-08T17:20:41.624036] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-08T17:20:41.641332] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-08T17:20:41.642488] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-08T17:20:41.643222] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-08T17:20:41.643291] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-08T17:20:41.644751] [DEBUG] [LOCAL ] ASC: Trimmed 56450 records to 37471 (keeping 200 days of data) [2025-10-08T17:20:41.778489] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T17:20:41.893716] [DEBUG] [LOCAL ] ASC: Primary data saved (37471 records). [2025-10-08T17:20:41.893892] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-08T17:20:41.895055] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 34.3s. Estimated remaining: 4h 50m 59s. Rate: 7.6 symbols/min [2025-10-08T17:20:42.417545] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-08T17:20:43.081239] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T17:20:43.217614] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-08T17:20:43.516691] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:20:44.017605] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-08T17:20:44.556548] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T17:20:44.817622] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-08T17:20:45.143893] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T17:20:45.617637] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-08T17:20:46.055754] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:20:46.417578] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-08T17:20:46.806406] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T17:20:47.217530] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-08T17:20:47.397068] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T17:20:48.017598] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-08T17:20:48.356857] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T17:20:48.817587] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-08T17:20:49.621866] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-08T17:20:49.634622] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:20:49.767602] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T17:20:50.417526] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-08T17:20:50.572193] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T17:20:51.217571] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-08T17:20:51.741791] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T17:20:51.892364] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T17:20:52.017575] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-08T17:20:52.817568] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-08T17:20:53.617519] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-08T17:20:53.722286] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:20:53.822863] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:20:53.824928] [INFO ] [REMOTE ] ASGI: Full fetch complete (33417 records). [2025-10-08T17:20:53.825008] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-08T17:20:54.234551] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-08T17:20:54.234632] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-08T17:20:54.235101] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-08T17:20:54.235165] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-08T17:20:54.235962] [DEBUG] [LOCAL ] ASGI: Trimmed 33417 records to 22731 (keeping 200 days of data) [2025-10-08T17:20:54.371964] [DEBUG] [LOCAL ] ASGI: Primary data saved (22731 records). [2025-10-08T17:20:54.372118] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-08T17:20:54.372199] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASGI took 28.0s. Estimated remaining: 4h 51m 56s. Rate: 7.6 symbols/min [2025-10-08T17:20:54.417528] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-08T17:20:54.459370] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T17:20:54.461082] [INFO ] [REMOTE ] ASG: Full fetch complete (31061 records). [2025-10-08T17:20:54.461166] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-08T17:20:54.821421] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-08T17:20:54.821507] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-08T17:20:54.821925] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-08T17:20:54.821988] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-08T17:20:54.822758] [DEBUG] [LOCAL ] ASG: Trimmed 31061 records to 19553 (keeping 200 days of data) [2025-10-08T17:20:54.934356] [DEBUG] [LOCAL ] ASG: Primary data saved (19553 records). [2025-10-08T17:20:54.934509] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-08T17:20:54.934595] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASG took 33.1s. Estimated remaining: 4h 50m 5s. Rate: 7.6 symbols/min [2025-10-08T17:20:55.758991] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T17:20:55.767086] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-08T17:20:56.856148] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:20:56.863359] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-08T17:20:58.076463] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T17:20:58.084992] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-08T17:20:59.479612] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:20:59.488077] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-08T17:21:01.022313] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T17:21:01.032261] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-08T17:21:02.266112] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:21:02.269312] [INFO ] [REMOTE ] ASGN: Full fetch complete (52614 records). [2025-10-08T17:21:02.269429] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-08T17:21:02.703838] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-08T17:21:02.703924] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-08T17:21:02.704614] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-08T17:21:02.704720] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-08T17:21:02.705909] [DEBUG] [LOCAL ] ASGN: Trimmed 52614 records to 36282 (keeping 200 days of data) [2025-10-08T17:21:02.918854] [DEBUG] [LOCAL ] ASGN: Primary data saved (36282 records). [2025-10-08T17:21:02.918994] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-08T17:21:02.920135] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 26.8s. Estimated remaining: 4h 49m 59s. Rate: 7.6 symbols/min [2025-10-08T17:21:03.530301] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:03.585032] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:03.635024] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:03.644010] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:03.665264] [DEBUG] [LOCAL ] ASR: Loaded 9354 existing records from primary storage. [2025-10-08T17:21:03.672156] [INFO ] [MAIN ] ASR: Loaded 9354 existing records. [2025-10-08T17:21:03.814766] [DEBUG] [LOCAL ] ASIX: Loaded 22844 existing records from primary storage. [2025-10-08T17:21:03.829979] [DEBUG] [LOCAL ] ASH: Loaded 37636 existing records from primary storage. [2025-10-08T17:21:03.830584] [INFO ] [MAIN ] ASH: Loaded 37636 existing records. [2025-10-08T17:21:03.830734] [INFO ] [MAIN ] ASIX: Loaded 22844 existing records. [2025-10-08T17:21:04.044563] [DEBUG] [LOCAL ] ASPN: Loaded 49688 existing records from primary storage. [2025-10-08T17:21:04.095310] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:04.148109] [INFO ] [MAIN ] ASPN: Loaded 49688 existing records. [2025-10-08T17:21:04.153693] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-08T17:21:04.159428] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-08T17:21:04.257671] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-08T17:21:04.346212] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-08T17:21:04.396415] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:04.472777] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:04.469120] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-08T17:21:04.494075] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-08T17:21:04.504017] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-08T17:21:04.509490] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-08T17:21:04.534171] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-08T17:21:04.539459] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-08T17:21:04.565399] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-08T17:21:04.555035] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-08T17:21:04.775031] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:04.870473] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-08T17:21:04.968321] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-08T17:21:04.994110] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-08T17:21:05.061137] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-08T17:21:05.757010] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:05.787405] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-08T17:21:06.049537] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:06.022610] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:06.055095] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-08T17:21:06.064621] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-08T17:21:06.202479] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:06.202927] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-08T17:21:06.935350] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T17:21:06.937502] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-08T17:21:07.147351] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T17:21:07.151132] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-08T17:21:07.383631] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T17:21:07.385704] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-08T17:21:07.588243] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:21:07.595455] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-08T17:21:07.784442] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:21:07.795191] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-08T17:21:07.839695] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T17:21:07.844068] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-08T17:21:07.892600] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T17:21:07.894787] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-08T17:21:08.342479] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T17:21:08.344757] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-08T17:21:08.717132] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:21:08.817608] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-08T17:21:08.834935] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T17:21:08.868834] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T17:21:09.495093] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T17:21:09.617565] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-08T17:21:10.213881] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T17:21:10.417697] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-08T17:21:11.217560] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-08T17:21:11.266744] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:21:11.295011] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T17:21:11.926680] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T17:21:12.017566] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-08T17:21:12.817565] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-08T17:21:12.923334] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T17:21:13.617561] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-08T17:21:14.417571] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-08T17:21:14.534127] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T17:21:15.022193] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T17:21:15.217555] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-08T17:21:15.221555] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T17:21:16.017554] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-08T17:21:16.032375] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T17:21:16.817550] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-08T17:21:16.970692] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:21:17.617535] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-08T17:21:17.650584] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T17:21:18.417608] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-08T17:21:18.675977] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:21:19.217604] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-08T17:21:20.017700] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-08T17:21:20.303185] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T17:21:20.671727] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T17:21:20.672961] [INFO ] [REMOTE ] ASR: Full fetch complete (12386 records). [2025-10-08T17:21:20.673050] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-08T17:21:20.848706] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-08T17:21:21.130712] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-08T17:21:21.130885] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-08T17:21:21.131158] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-08T17:21:21.131231] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-08T17:21:21.154576] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T17:21:21.154871] [DEBUG] [LOCAL ] ASR: Trimmed 12386 records to 9328 (keeping 200 days of data) [2025-10-08T17:21:21.223687] [DEBUG] [LOCAL ] ASR: Primary data saved (9328 records). [2025-10-08T17:21:21.223856] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-08T17:21:21.223944] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 18.3s. Estimated remaining: 4h 52m 14s. Rate: 7.6 symbols/min [2025-10-08T17:21:21.400277] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:21.400476] [DEBUG] [LOCAL ] ASX: No existing data file found in primary storage. [2025-10-08T17:21:21.400512] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-10-08T17:21:21.400625] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-08T17:21:21.400699] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-08T17:21:21.400753] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-10-08T17:21:21.400787] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-08T17:21:21.619693] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-08T17:21:21.802199] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:21.814924] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T17:21:22.417635] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-08T17:21:23.217584] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-08T17:21:23.485709] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:21:24.005912] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T17:21:24.017504] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-08T17:21:24.323022] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T17:21:24.817576] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-08T17:21:25.617600] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-08T17:21:25.687441] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:21:25.982750] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T17:21:26.417629] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-08T17:21:26.893360] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T17:21:27.217601] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-08T17:21:27.520097] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:21:28.017594] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-08T17:21:28.639164] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T17:21:28.817590] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-08T17:21:29.617728] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-08T17:21:29.748683] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:21:30.229868] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T17:21:30.417570] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-08T17:21:31.217596] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-08T17:21:31.397373] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:21:31.878128] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T17:21:32.017591] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-08T17:21:32.685792] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:21:32.817694] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-08T17:21:33.617522] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-08T17:21:33.818834] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:21:33.907824] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:21:33.910071] [INFO ] [REMOTE ] ASIX: Full fetch complete (30482 records). [2025-10-08T17:21:33.910208] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-08T17:21:34.295062] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-08T17:21:34.295198] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-08T17:21:34.295628] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-08T17:21:34.295712] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-08T17:21:34.296597] [DEBUG] [LOCAL ] ASIX: Trimmed 30482 records to 22842 (keeping 200 days of data) [2025-10-08T17:21:34.417781] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-08T17:21:34.454894] [DEBUG] [LOCAL ] ASIX: Primary data saved (22842 records). [2025-10-08T17:21:34.455070] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-08T17:21:34.455185] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 31.5s. Estimated remaining: 4h 53m 19s. Rate: 7.5 symbols/min [2025-10-08T17:21:34.632523] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:34.674609] [DEBUG] [LOCAL ] ATEN: Loaded 38904 existing records from primary storage. [2025-10-08T17:21:34.674977] [INFO ] [MAIN ] ATEN: Loaded 38904 existing records. [2025-10-08T17:21:34.858361] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:34.858626] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-08T17:21:34.858711] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-08T17:21:34.859101] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-08T17:21:34.859162] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-08T17:21:35.222742] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-08T17:21:35.227638] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:35.587946] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T17:21:36.017560] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-08T17:21:36.090469] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T17:21:36.211046] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:21:36.817570] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-08T17:21:37.423409] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:21:37.617574] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-08T17:21:38.417563] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-08T17:21:38.461965] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T17:21:39.047439] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:21:39.217559] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-08T17:21:39.868367] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:21:39.872877] [INFO ] [REMOTE ] ASPN: Full fetch complete (72398 records). [2025-10-08T17:21:39.873077] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-08T17:21:40.026951] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-08T17:21:40.271362] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-08T17:21:40.271454] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-08T17:21:40.272206] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-08T17:21:40.272271] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-08T17:21:40.273751] [DEBUG] [LOCAL ] ASPN: Trimmed 72398 records to 49736 (keeping 200 days of data) [2025-10-08T17:21:40.567035] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T17:21:40.572406] [INFO ] [REMOTE ] ASH: Full fetch complete (55215 records). [2025-10-08T17:21:40.573698] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-08T17:21:40.582805] [DEBUG] [LOCAL ] ASPN: Primary data saved (49736 records). [2025-10-08T17:21:40.621591] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-08T17:21:40.648511] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASPN took 37.7s. Estimated remaining: 4h 52m 47s. Rate: 7.5 symbols/min [2025-10-08T17:21:40.819940] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-08T17:21:41.008713] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:41.174172] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-08T17:21:41.174255] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-08T17:21:41.174828] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-08T17:21:41.174892] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-08T17:21:41.176129] [DEBUG] [LOCAL ] ASH: Trimmed 55215 records to 37603 (keeping 200 days of data) [2025-10-08T17:21:41.253368] [DEBUG] [LOCAL ] ATGE: Loaded 31178 existing records from primary storage. [2025-10-08T17:21:41.282189] [INFO ] [MAIN ] ATGE: Loaded 31178 existing records. [2025-10-08T17:21:41.494191] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:41.496460] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-08T17:21:41.496521] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-08T17:21:41.496769] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-08T17:21:41.496834] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-08T17:21:41.814665] [DEBUG] [LOCAL ] ASH: Primary data saved (37603 records). [2025-10-08T17:21:41.830781] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-08T17:21:41.849959] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASH took 38.9s. Estimated remaining: 4h 51m 8s. Rate: 7.6 symbols/min [2025-10-08T17:21:42.089909] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:42.109411] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-08T17:21:42.227713] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T17:21:42.233012] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:42.280224] [DEBUG] [LOCAL ] ATHM: Loaded 31991 existing records from primary storage. [2025-10-08T17:21:42.280584] [INFO ] [MAIN ] ATHM: Loaded 31991 existing records. [2025-10-08T17:21:42.423446] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-08T17:21:42.464194] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T17:21:42.497055] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:42.506522] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-08T17:21:42.506613] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-08T17:21:42.506884] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-08T17:21:42.506943] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-08T17:21:42.877322] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:43.217541] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-08T17:21:43.375630] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:21:43.842961] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T17:21:44.017584] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-08T17:21:44.651025] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:21:44.817504] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-08T17:21:44.872694] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:21:45.617543] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-08T17:21:46.417512] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-08T17:21:46.670720] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T17:21:46.708984] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T17:21:47.217551] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-08T17:21:48.017516] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-08T17:21:48.084205] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T17:21:48.724809] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T17:21:48.817565] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-08T17:21:49.617602] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-08T17:21:49.690082] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T17:21:50.150208] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T17:21:50.417610] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-08T17:21:51.217587] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-08T17:21:51.418400] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T17:21:51.874812] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T17:21:52.017547] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-08T17:21:52.738977] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T17:21:52.817576] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-08T17:21:53.617610] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-08T17:21:53.745532] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T17:21:53.752468] [INFO ] [REMOTE ] ASX: Full fetch complete (76592 records). [2025-10-08T17:21:53.752621] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-08T17:21:54.152072] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-08T17:21:54.160743] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-08T17:21:54.166905] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-08T17:21:54.167001] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-08T17:21:54.178086] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:21:54.188184] [DEBUG] [LOCAL ] ASX: Trimmed 76592 records to 52863 (keeping 200 days of data) [2025-10-08T17:21:54.417702] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-08T17:21:54.517081] [DEBUG] [LOCAL ] ASX: Primary data saved (52863 records). [2025-10-08T17:21:54.517216] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-08T17:21:54.517289] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 33.3s. Estimated remaining: 4h 52m 4s. Rate: 7.6 symbols/min [2025-10-08T17:21:54.695428] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:54.704515] [DEBUG] [LOCAL ] ATHS: Loaded 6795 existing records from primary storage. [2025-10-08T17:21:54.705062] [INFO ] [MAIN ] ATHS: Loaded 6795 existing records. [2025-10-08T17:21:54.888691] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:54.889134] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-08T17:21:54.889250] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-08T17:21:54.889479] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-08T17:21:54.889673] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-08T17:21:54.998121] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T17:21:55.222767] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-08T17:21:55.357832] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:55.733336] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:21:56.017570] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-08T17:21:56.561307] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T17:21:56.817543] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-08T17:21:57.467782] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T17:21:57.617572] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-08T17:21:58.283380] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:21:58.417559] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-08T17:21:58.940034] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T17:21:59.217603] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-08T17:22:00.017564] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-08T17:22:00.040229] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T17:22:00.123011] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T17:22:00.817567] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-08T17:22:01.082611] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:22:01.617583] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-08T17:22:02.417596] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-08T17:22:02.490982] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T17:22:02.814395] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T17:22:02.817192] [INFO ] [REMOTE ] ATGE: Full fetch complete (46180 records). [2025-10-08T17:22:02.817547] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-08T17:22:03.222812] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-08T17:22:03.282946] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-08T17:22:03.283062] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-08T17:22:03.283820] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-08T17:22:03.283889] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-08T17:22:03.285483] [DEBUG] [LOCAL ] ATGE: Trimmed 46180 records to 31120 (keeping 200 days of data) [2025-10-08T17:22:03.496955] [DEBUG] [LOCAL ] ATGE: Primary data saved (31120 records). [2025-10-08T17:22:03.497186] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-08T17:22:03.497310] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATGE took 22.8s. Estimated remaining: 4h 52m 9s. Rate: 7.5 symbols/min [2025-10-08T17:22:03.697121] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:03.697568] [DEBUG] [LOCAL ] ATI: No existing data file found in primary storage. [2025-10-08T17:22:03.697627] [WARN ] [MAIN ] ATI: No existing data found, performing full refresh instead. [2025-10-08T17:22:03.697783] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-08T17:22:03.697827] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-08T17:22:03.697870] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-08T17:22:03.697904] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-08T17:22:04.018483] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-08T17:22:04.124736] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:04.126347] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:22:04.526318] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T17:22:04.526581] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T17:22:04.817554] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-08T17:22:05.422296] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T17:22:05.617592] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-08T17:22:06.417553] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-08T17:22:06.542547] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T17:22:07.217592] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-08T17:22:07.612844] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-08T17:22:07.864600] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T17:22:08.017546] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-08T17:22:08.573391] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:22:08.817548] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-08T17:22:09.617514] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-08T17:22:09.964026] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:22:10.257802] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T17:22:10.417559] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-08T17:22:11.217557] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-08T17:22:11.394978] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T17:22:12.017548] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-08T17:22:12.636661] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T17:22:12.817547] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-08T17:22:13.525141] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:22:13.617597] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-08T17:22:14.275882] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T17:22:14.417593] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-08T17:22:14.973830] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T17:22:14.979367] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:22:15.217583] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-08T17:22:16.017610] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-08T17:22:16.536032] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:22:16.538990] [INFO ] [REMOTE ] ATEN: Full fetch complete (57056 records). [2025-10-08T17:22:16.539136] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-08T17:22:16.824177] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-08T17:22:16.999610] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-08T17:22:16.999901] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-08T17:22:17.000595] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-08T17:22:17.000692] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-08T17:22:17.002435] [DEBUG] [LOCAL ] ATEN: Trimmed 57056 records to 38823 (keeping 200 days of data) [2025-10-08T17:22:17.279785] [DEBUG] [LOCAL ] ATEN: Primary data saved (38823 records). [2025-10-08T17:22:17.279997] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-08T17:22:17.280201] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATEN took 42.8s. Estimated remaining: 4h 53m 18s. Rate: 7.5 symbols/min [2025-10-08T17:22:17.410269] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T17:22:17.498042] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:17.537773] [DEBUG] [LOCAL ] ATKR: Loaded 35515 existing records from primary storage. [2025-10-08T17:22:17.538248] [INFO ] [MAIN ] ATKR: Loaded 35515 existing records. [2025-10-08T17:22:17.621120] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-08T17:22:17.755810] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:22:17.756234] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-08T17:22:17.756316] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-08T17:22:17.756869] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-08T17:22:17.756943] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-08T17:22:17.925411] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T17:22:18.230425] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:18.285958] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T17:22:18.417573] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-08T17:22:19.217584] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-08T17:22:19.647723] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T17:22:20.017584] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-08T17:22:20.709732] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T17:22:20.710901] [INFO ] [REMOTE ] ATHS: Full fetch complete (9755 records). [2025-10-08T17:22:20.711016] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-08T17:22:20.819063] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-08T17:22:21.143375] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T17:22:21.143580] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-08T17:22:21.143705] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-08T17:22:21.153977] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-08T17:22:21.154480] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-08T17:22:21.155245] [DEBUG] [LOCAL ] ATHS: Trimmed 9755 records to 6780 (keeping 200 days of data) [2025-10-08T17:22:21.197756] [DEBUG] [LOCAL ] ATHS: Primary data saved (6780 records). [2025-10-08T17:22:21.197869] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-08T17:22:21.197982] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHS took 26.7s. Estimated remaining: 4h 52m 17s. Rate: 7.5 symbols/min [2025-10-08T17:22:21.363882] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:21.364117] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-10-08T17:22:21.364159] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-10-08T17:22:21.364268] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-08T17:22:21.364308] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-08T17:22:21.364348] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-08T17:22:21.364380] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-08T17:22:21.623731] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-08T17:22:21.714088] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:22.380914] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:22:22.417508] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-08T17:22:22.976418] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T17:22:23.217629] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-08T17:22:23.596022] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T17:22:24.017621] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-08T17:22:24.383155] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:22:24.817585] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-08T17:22:25.540905] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T17:22:25.617520] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-08T17:22:26.430291] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-08T17:22:26.436944] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:22:26.759142] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T17:22:26.761768] [INFO ] [REMOTE ] ATHM: Full fetch complete (50660 records). [2025-10-08T17:22:26.761875] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-08T17:22:27.133073] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-08T17:22:27.133156] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-08T17:22:27.133746] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-08T17:22:27.133829] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-08T17:22:27.134935] [DEBUG] [LOCAL ] ATHM: Trimmed 50660 records to 31820 (keeping 200 days of data) [2025-10-08T17:22:27.217703] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-08T17:22:27.318131] [DEBUG] [LOCAL ] ATHM: Primary data saved (31820 records). [2025-10-08T17:22:27.318276] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-08T17:22:27.318363] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHM took 45.5s. Estimated remaining: 4h 51m 45s. Rate: 7.5 symbols/min [2025-10-08T17:22:27.484830] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:27.485014] [DEBUG] [LOCAL ] ATO: No existing data file found in primary storage. [2025-10-08T17:22:27.485056] [WARN ] [MAIN ] ATO: No existing data found, performing full refresh instead. [2025-10-08T17:22:27.485202] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-08T17:22:27.485264] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-08T17:22:27.485310] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-08T17:22:27.485343] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-08T17:22:27.843757] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:27.973452] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T17:22:28.017533] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-08T17:22:28.817712] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-08T17:22:29.001996] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T17:22:29.134736] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T17:22:29.617568] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-08T17:22:30.011774] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T17:22:30.417608] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-08T17:22:31.217577] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-08T17:22:31.329507] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:22:31.600883] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T17:22:32.017575] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-08T17:22:32.372851] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T17:22:32.817588] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-08T17:22:33.617529] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-08T17:22:33.912019] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:22:34.071510] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T17:22:34.417562] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-08T17:22:34.977080] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:22:35.217611] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-08T17:22:35.710326] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T17:22:36.017623] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-08T17:22:36.634680] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T17:22:36.817561] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-08T17:22:37.585239] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T17:22:37.617516] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-08T17:22:38.063611] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T17:22:38.417614] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-08T17:22:39.159825] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T17:22:39.217568] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-08T17:22:39.639405] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:22:40.017583] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-08T17:22:40.484963] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T17:22:40.817589] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-08T17:22:41.001728] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:22:41.004691] [INFO ] [REMOTE ] ATKR: Full fetch complete (53531 records). [2025-10-08T17:22:41.004851] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-08T17:22:41.383366] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-08T17:22:41.383457] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-08T17:22:41.384060] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-08T17:22:41.384129] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-08T17:22:41.385319] [DEBUG] [LOCAL ] ATKR: Trimmed 53531 records to 35380 (keeping 200 days of data) [2025-10-08T17:22:41.602381] [DEBUG] [LOCAL ] ATKR: Primary data saved (35380 records). [2025-10-08T17:22:41.602531] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-08T17:22:41.602618] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATKR took 24.3s. Estimated remaining: 4h 52m 59s. Rate: 7.5 symbols/min [2025-10-08T17:22:41.623729] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-08T17:22:41.775746] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:41.807483] [DEBUG] [LOCAL ] ATR: Loaded 30585 existing records from primary storage. [2025-10-08T17:22:41.807972] [INFO ] [MAIN ] ATR: Loaded 30585 existing records. [2025-10-08T17:22:41.988168] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:22:41.988404] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-08T17:22:41.988481] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-08T17:22:41.988806] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-08T17:22:41.988864] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-08T17:22:42.403597] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:42.428358] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-08T17:22:42.434462] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T17:22:43.217630] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-08T17:22:43.304709] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T17:22:44.017595] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-08T17:22:44.052430] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:22:44.056618] [INFO ] [REMOTE ] ATI: Full fetch complete (73899 records). [2025-10-08T17:22:44.056826] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-08T17:22:44.473177] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-08T17:22:44.473360] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-08T17:22:44.474208] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-08T17:22:44.474281] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-08T17:22:44.476053] [DEBUG] [LOCAL ] ATI: Trimmed 73899 records to 51415 (keeping 200 days of data) [2025-10-08T17:22:44.732860] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T17:22:44.819695] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-08T17:22:44.854629] [DEBUG] [LOCAL ] ATI: Primary data saved (51415 records). [2025-10-08T17:22:44.854870] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-08T17:22:44.854998] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATI took 41.4s. Estimated remaining: 4h 51m 50s. Rate: 7.5 symbols/min [2025-10-08T17:22:45.068136] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:45.088467] [DEBUG] [LOCAL ] ATS: Loaded 17751 existing records from primary storage. [2025-10-08T17:22:45.088814] [INFO ] [MAIN ] ATS: Loaded 17751 existing records. [2025-10-08T17:22:45.340096] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:22:45.340510] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-08T17:22:45.340662] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-08T17:22:45.355925] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-08T17:22:45.356688] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T17:22:45.356998] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-08T17:22:45.622760] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-08T17:22:45.786202] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:46.293581] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T17:22:46.417593] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-08T17:22:47.002317] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:22:47.217569] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-08T17:22:47.533202] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T17:22:48.017547] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-08T17:22:48.299388] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T17:22:48.817627] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-08T17:22:49.617590] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-08T17:22:49.662736] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:22:50.417570] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-08T17:22:50.488475] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T17:22:51.027797] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T17:22:51.217596] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-08T17:22:51.392889] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:22:52.017576] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-08T17:22:52.817593] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-08T17:22:53.617575] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-08T17:23:05.225234] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (11.61 seconds). [2025-10-08T17:23:05.237294] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-08T17:23:06.505418] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (13.69 seconds). [2025-10-08T17:23:06.516917] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-08T17:23:07.315822] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-08T17:23:07.325918] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-08T17:23:07.342271] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (15.32 seconds). [2025-10-08T17:23:07.347561] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-08T17:23:07.817145] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:23:07.820669] [INFO ] [REMOTE ] ATO: Full fetch complete (60508 records). [2025-10-08T17:23:07.820820] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-08T17:23:08.250021] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-08T17:23:08.250224] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-08T17:23:08.250991] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-08T17:23:08.251059] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-08T17:23:08.252397] [DEBUG] [LOCAL ] ATO: Trimmed 60508 records to 41855 (keeping 200 days of data) [2025-10-08T17:23:08.382564] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T17:23:08.388423] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-08T17:23:08.595224] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:23:08.608525] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-08T17:23:08.634687] [DEBUG] [LOCAL ] ATO: Primary data saved (41855 records). [2025-10-08T17:23:08.634861] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-08T17:23:08.634965] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATO took 41.3s. Estimated remaining: 4h 55m 5s. Rate: 7.5 symbols/min [2025-10-08T17:23:08.831673] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:08.891729] [DEBUG] [LOCAL ] ATUS: Loaded 49494 existing records from primary storage. [2025-10-08T17:23:08.892391] [INFO ] [MAIN ] ATUS: Loaded 49494 existing records. [2025-10-08T17:23:09.063052] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (17.85 seconds). [2025-10-08T17:23:09.105718] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-08T17:23:09.137296] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:09.139254] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-08T17:23:09.139376] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-08T17:23:09.140803] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-08T17:23:09.140972] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-08T17:23:09.478015] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T17:23:09.530845] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-08T17:23:09.536369] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:09.536839] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-08T17:23:10.532894] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T17:23:10.537787] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-08T17:23:10.894309] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T17:23:10.904834] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-08T17:23:11.609487] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T17:23:11.613987] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-08T17:23:12.317816] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:23:12.328913] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-08T17:23:12.595906] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T17:23:12.600448] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-08T17:23:13.008850] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (3.90 seconds). [2025-10-08T17:23:13.015950] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-08T17:23:13.115590] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (4.51 seconds). [2025-10-08T17:23:13.126129] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-08T17:23:13.608947] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T17:23:13.619887] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-08T17:23:13.636625] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:23:13.642507] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-08T17:23:13.954407] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T17:23:13.961535] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-08T17:23:14.135528] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:23:14.138686] [INFO ] [REMOTE ] ATMU: Full fetch complete (56673 records). [2025-10-08T17:23:14.138824] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-08T17:23:14.540527] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-08T17:23:14.540696] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-08T17:23:14.541500] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-08T17:23:14.541567] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-08T17:23:14.542878] [DEBUG] [LOCAL ] ATMU: Trimmed 56673 records to 39145 (keeping 200 days of data) [2025-10-08T17:23:14.767586] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T17:23:14.775666] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-08T17:23:14.827559] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T17:23:14.841513] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-08T17:23:14.845731] [DEBUG] [LOCAL ] ATMU: Primary data saved (39145 records). [2025-10-08T17:23:14.847120] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-08T17:23:14.847322] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATMU took 53.6s. Estimated remaining: 4h 54m 33s. Rate: 7.5 symbols/min [2025-10-08T17:23:15.020402] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:15.040331] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T17:23:15.047437] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-08T17:23:15.097004] [DEBUG] [LOCAL ] AU: Loaded 52994 existing records from primary storage. [2025-10-08T17:23:15.097373] [INFO ] [MAIN ] AU: Loaded 52994 existing records. [2025-10-08T17:23:15.278899] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:15.279177] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-08T17:23:15.279236] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-08T17:23:15.279736] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-08T17:23:15.279799] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-08T17:23:15.630197] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:15.630518] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-08T17:23:15.915786] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T17:23:15.919726] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-08T17:23:16.154032] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T17:23:16.161320] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-08T17:23:16.514163] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T17:23:16.524922] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-08T17:23:16.786211] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T17:23:16.787794] [INFO ] [REMOTE ] ATS: Full fetch complete (25644 records). [2025-10-08T17:23:16.787884] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-08T17:23:17.190035] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-08T17:23:17.190200] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-08T17:23:17.190570] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-08T17:23:17.190610] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-08T17:23:17.191397] [DEBUG] [LOCAL ] ATS: Trimmed 25644 records to 17730 (keeping 200 days of data) [2025-10-08T17:23:17.316837] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:23:17.328535] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-08T17:23:17.349966] [DEBUG] [LOCAL ] ATS: Primary data saved (17730 records). [2025-10-08T17:23:17.350137] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-08T17:23:17.350269] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATS took 32.5s. Estimated remaining: 4h 53m 15s. Rate: 7.5 symbols/min [2025-10-08T17:23:17.550860] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:17.592153] [DEBUG] [LOCAL ] AUB: Loaded 46248 existing records from primary storage. [2025-10-08T17:23:17.592501] [INFO ] [MAIN ] AUB: Loaded 46248 existing records. [2025-10-08T17:23:17.735243] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T17:23:17.845890] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-08T17:23:17.845297] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:17.847093] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-08T17:23:17.847170] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-08T17:23:17.847524] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-08T17:23:17.847678] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-08T17:23:18.080952] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:23:18.202231] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-08T17:23:18.287741] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:18.288052] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-08T17:23:18.947899] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:23:18.955962] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-08T17:23:19.038161] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:23:19.217610] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-08T17:23:19.639804] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T17:23:19.883136] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T17:23:20.017582] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-08T17:23:20.370803] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T17:23:20.373504] [INFO ] [REMOTE ] ATR: Full fetch complete (43755 records). [2025-10-08T17:23:20.373669] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-08T17:23:20.776637] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-08T17:23:20.776796] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-08T17:23:20.777441] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-08T17:23:20.777523] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-08T17:23:20.779500] [DEBUG] [LOCAL ] ATR: Trimmed 43755 records to 30573 (keeping 200 days of data) [2025-10-08T17:23:20.875687] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-08T17:23:20.919215] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:23:21.032930] [DEBUG] [LOCAL ] ATR: Primary data saved (30573 records). [2025-10-08T17:23:21.033112] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-08T17:23:21.033206] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATR took 39.4s. Estimated remaining: 4h 52m 13s. Rate: 7.5 symbols/min [2025-10-08T17:23:21.228933] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:21.235450] [DEBUG] [LOCAL ] AUNA: Loaded 5054 existing records from primary storage. [2025-10-08T17:23:21.235707] [INFO ] [MAIN ] AUNA: Loaded 5054 existing records. [2025-10-08T17:23:21.425406] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:21.425734] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-08T17:23:21.425880] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-08T17:23:21.426097] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-08T17:23:21.426154] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-08T17:23:21.618125] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-08T17:23:21.829833] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:21.864245] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T17:23:22.062441] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T17:23:22.417710] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-08T17:23:23.162357] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T17:23:23.217547] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-08T17:23:23.425540] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T17:23:23.917769] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T17:23:24.017573] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-08T17:23:24.817561] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-08T17:23:25.617631] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-08T17:23:25.760399] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:23:26.417601] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-08T17:23:26.665145] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T17:23:26.849140] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T17:23:26.873130] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T17:23:27.217595] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-08T17:23:28.017616] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-08T17:23:28.683185] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T17:23:28.755435] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:23:28.817498] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-08T17:23:29.617572] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-08T17:23:30.417535] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-08T17:23:30.439846] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:23:30.443854] [INFO ] [REMOTE ] ATUS: Full fetch complete (71048 records). [2025-10-08T17:23:30.444016] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-08T17:23:30.851130] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-08T17:23:30.851230] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-08T17:23:30.852000] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-08T17:23:30.852065] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-08T17:23:30.853522] [DEBUG] [LOCAL ] ATUS: Trimmed 71048 records to 49482 (keeping 200 days of data) [2025-10-08T17:23:31.156609] [DEBUG] [LOCAL ] ATUS: Primary data saved (49482 records). [2025-10-08T17:23:31.156775] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-08T17:23:31.156897] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 22.5s. Estimated remaining: 4h 52m 32s. Rate: 7.5 symbols/min [2025-10-08T17:23:31.224308] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-08T17:23:31.340594] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:31.371852] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T17:23:31.413741] [DEBUG] [LOCAL ] AVA: Loaded 39243 existing records from primary storage. [2025-10-08T17:23:31.414107] [INFO ] [MAIN ] AVA: Loaded 39243 existing records. [2025-10-08T17:23:31.600598] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:31.601063] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-08T17:23:31.601120] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-08T17:23:31.601381] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-08T17:23:31.601440] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-08T17:23:31.865721] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T17:23:31.984389] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:32.017554] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-08T17:23:32.474185] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:23:32.516433] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T17:23:32.817578] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-08T17:23:33.617563] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-08T17:23:34.417530] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-08T17:23:34.432188] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T17:23:34.561292] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T17:23:35.217540] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-08T17:23:35.851749] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T17:23:36.017561] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-08T17:23:36.817526] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-08T17:23:37.005621] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T17:23:37.617520] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-08T17:23:37.667790] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:23:37.967340] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T17:23:38.189740] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T17:23:38.417560] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-08T17:23:39.217593] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-08T17:23:39.846932] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T17:23:40.017565] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-08T17:23:40.317351] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:23:40.817586] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-08T17:23:41.381826] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:23:41.454584] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T17:23:41.617553] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-08T17:23:42.417553] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-08T17:23:43.107146] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T17:23:43.108497] [INFO ] [REMOTE ] AUNA: Full fetch complete (7820 records). [2025-10-08T17:23:43.108736] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-08T17:23:43.222809] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-08T17:23:43.242625] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:23:43.517266] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-08T17:23:43.517382] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-08T17:23:43.517637] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-08T17:23:43.517717] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-08T17:23:43.518109] [DEBUG] [LOCAL ] AUNA: Trimmed 7820 records to 5056 (keeping 200 days of data) [2025-10-08T17:23:43.546002] [DEBUG] [LOCAL ] AUNA: Primary data saved (5056 records). [2025-10-08T17:23:43.546094] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-08T17:23:43.546170] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUNA took 22.5s. Estimated remaining: 4h 53m 18s. Rate: 7.5 symbols/min [2025-10-08T17:23:43.713807] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:43.713999] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-10-08T17:23:43.714036] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-10-08T17:23:43.714144] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-08T17:23:43.714185] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-08T17:23:43.714225] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-08T17:23:43.714256] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-08T17:23:44.024113] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-08T17:23:44.065266] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:44.595678] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T17:23:44.817608] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-08T17:23:45.402929] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T17:23:45.617537] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-08T17:23:45.779031] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T17:23:46.417622] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-08T17:23:46.772392] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T17:23:47.116582] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T17:23:47.217555] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-08T17:23:48.017573] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-08T17:23:48.807491] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:23:48.820822] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-08T17:23:49.617532] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-08T17:23:49.716412] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T17:23:49.786555] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T17:23:50.417556] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-08T17:23:51.217607] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-08T17:23:51.950319] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T17:23:51.975195] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:23:51.997003] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T17:23:52.017530] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-08T17:23:52.717040] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T17:23:52.817575] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-08T17:23:53.617590] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-08T17:23:54.172100] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T17:23:54.417564] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-08T17:23:54.639278] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T17:23:54.643615] [INFO ] [REMOTE ] AU: Full fetch complete (76290 records). [2025-10-08T17:23:54.643776] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-08T17:23:55.155843] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-08T17:23:55.155993] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-08T17:23:55.157060] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-08T17:23:55.157128] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-08T17:23:55.159441] [DEBUG] [LOCAL ] AU: Trimmed 76290 records to 52990 (keeping 200 days of data) [2025-10-08T17:23:55.223405] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-08T17:23:55.527276] [DEBUG] [LOCAL ] AU: Primary data saved (52990 records). [2025-10-08T17:23:55.527475] [INFO ] [MAIN ] AU: Full history saved. [2025-10-08T17:23:55.527627] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AU took 40.7s. Estimated remaining: 4h 53m 59s. Rate: 7.5 symbols/min [2025-10-08T17:23:55.718311] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:55.765539] [DEBUG] [LOCAL ] AVB: Loaded 42115 existing records from primary storage. [2025-10-08T17:23:55.766183] [INFO ] [MAIN ] AVB: Loaded 42115 existing records. [2025-10-08T17:23:55.968946] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:55.969314] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-08T17:23:55.969427] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-08T17:23:55.970410] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-08T17:23:55.970472] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-08T17:23:56.022321] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-08T17:23:56.108070] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T17:23:56.313790] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:23:56.416581] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:56.817555] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-08T17:23:57.617611] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-08T17:23:57.691257] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T17:23:57.842192] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T17:23:58.417602] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-08T17:23:59.017213] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T17:23:59.130077] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T17:23:59.217571] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-08T17:24:00.011806] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T17:24:00.017483] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-08T17:24:00.681080] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T17:24:00.682726] [INFO ] [REMOTE ] AVAL: Full fetch complete (14703 records). [2025-10-08T17:24:00.682811] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-08T17:24:00.817726] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-08T17:24:01.094457] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-08T17:24:01.094550] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-08T17:24:01.094864] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-08T17:24:01.094926] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-08T17:24:01.095583] [DEBUG] [LOCAL ] AVAL: Trimmed 14703 records to 8653 (keeping 200 days of data) [2025-10-08T17:24:01.149741] [DEBUG] [LOCAL ] AVAL: Primary data saved (8653 records). [2025-10-08T17:24:01.149899] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-08T17:24:01.149976] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AVAL took 17.6s. Estimated remaining: 4h 53m 21s. Rate: 7.5 symbols/min [2025-10-08T17:24:01.330023] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:01.330219] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-08T17:24:01.330273] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-08T17:24:01.330425] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-08T17:24:01.330498] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-08T17:24:01.330569] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-08T17:24:01.330603] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-08T17:24:01.622614] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-08T17:24:01.700165] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:02.140232] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:24:02.145814] [INFO ] [REMOTE ] AVA: Full fetch complete (55633 records). [2025-10-08T17:24:02.146062] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-08T17:24:02.422737] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-08T17:24:02.589574] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-08T17:24:02.589696] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-08T17:24:02.590686] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-08T17:24:02.590764] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-08T17:24:02.591907] [DEBUG] [LOCAL ] AVA: Trimmed 55633 records to 39116 (keeping 200 days of data) [2025-10-08T17:24:02.684946] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:24:02.688857] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-08T17:24:02.689864] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:24:02.690248] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-08T17:24:02.690609] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:24:02.691227] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-08T17:24:02.691579] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-08T17:24:02.691946] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-08T17:24:02.692768] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-08T17:24:02.693099] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVBC took 1.5s. Estimated remaining: 4h 51m 54s. Rate: 7.5 symbols/min [2025-10-08T17:24:02.904302] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:02.936080] [DEBUG] [LOCAL ] AVD: Loaded 22358 existing records from primary storage. [2025-10-08T17:24:02.937709] [INFO ] [MAIN ] AVD: Loaded 22358 existing records. [2025-10-08T17:24:03.189637] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:03.226170] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-08T17:24:03.225999] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-08T17:24:03.229244] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-08T17:24:03.231723] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-08T17:24:03.233805] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-08T17:24:03.365220] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:24:03.695346] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:03.703202] [DEBUG] [LOCAL ] AVA: Primary data saved (39116 records). [2025-10-08T17:24:03.703338] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-08T17:24:03.703420] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 32.5s. Estimated remaining: 4h 50m 22s. Rate: 7.5 symbols/min [2025-10-08T17:24:03.877304] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:03.898586] [DEBUG] [LOCAL ] AVK: Loaded 18202 existing records from primary storage. [2025-10-08T17:24:03.898917] [INFO ] [MAIN ] AVK: Loaded 18202 existing records. [2025-10-08T17:24:04.022663] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-08T17:24:04.081048] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:04.081349] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-08T17:24:04.081431] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-08T17:24:04.082169] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-08T17:24:04.082235] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-08T17:24:04.449195] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:04.706359] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:24:04.817560] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-08T17:24:05.265090] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T17:24:05.617575] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-08T17:24:05.846236] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:24:06.417568] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-08T17:24:07.135491] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T17:24:07.217552] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-08T17:24:07.718381] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:24:08.017566] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-08T17:24:08.780414] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T17:24:08.786278] [INFO ] [REMOTE ] AUB: Full fetch complete (65774 records). [2025-10-08T17:24:08.786464] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-08T17:24:08.827527] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-08T17:24:09.210617] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-08T17:24:09.210762] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-08T17:24:09.211529] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-08T17:24:09.211580] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-08T17:24:09.213192] [DEBUG] [LOCAL ] AUB: Trimmed 65774 records to 46185 (keeping 200 days of data) [2025-10-08T17:24:09.349639] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T17:24:09.552915] [DEBUG] [LOCAL ] AUB: Primary data saved (46185 records). [2025-10-08T17:24:09.553079] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-08T17:24:09.554004] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AUB took 52.2s. Estimated remaining: 4h 49m 48s. Rate: 7.6 symbols/min [2025-10-08T17:24:09.623019] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-08T17:24:09.737527] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:09.779585] [DEBUG] [LOCAL ] AVNS: Loaded 33660 existing records from primary storage. [2025-10-08T17:24:09.780001] [INFO ] [MAIN ] AVNS: Loaded 33660 existing records. [2025-10-08T17:24:09.988961] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:09.989240] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-08T17:24:09.989305] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-08T17:24:09.990316] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-08T17:24:09.990393] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-08T17:24:10.421312] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-08T17:24:10.416407] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:24:10.421192] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:10.724472] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:24:11.217595] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-08T17:24:12.022101] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-08T17:24:12.040718] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T17:24:12.061904] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T17:24:12.817615] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-08T17:24:13.428755] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:24:13.617561] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-08T17:24:14.367024] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T17:24:14.417565] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-08T17:24:14.964056] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T17:24:15.217600] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-08T17:24:15.927445] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T17:24:16.017555] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-08T17:24:16.426162] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T17:24:16.817587] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-08T17:24:16.895934] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T17:24:17.617610] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-08T17:24:18.398285] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T17:24:18.417501] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-08T17:24:19.031091] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T17:24:19.217589] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-08T17:24:20.017594] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-08T17:24:20.079755] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T17:24:20.384579] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:24:20.817567] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-08T17:24:21.064800] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:24:21.617613] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-08T17:24:22.399006] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T17:24:22.417498] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-08T17:24:22.592516] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T17:24:23.217622] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-08T17:24:24.017594] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-08T17:24:24.290322] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T17:24:24.293937] [INFO ] [REMOTE ] AVB: Full fetch complete (58797 records). [2025-10-08T17:24:24.294061] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-08T17:24:24.690940] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T17:24:24.756877] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-08T17:24:24.757011] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-08T17:24:24.757718] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-08T17:24:24.757781] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-08T17:24:24.759212] [DEBUG] [LOCAL ] AVB: Trimmed 58797 records to 42092 (keeping 200 days of data) [2025-10-08T17:24:24.823601] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-08T17:24:25.026146] [DEBUG] [LOCAL ] AVB: Primary data saved (42092 records). [2025-10-08T17:24:25.026424] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-08T17:24:25.026535] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVB took 29.5s. Estimated remaining: 4h 51m 10s. Rate: 7.5 symbols/min [2025-10-08T17:24:25.199232] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:25.221529] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-10-08T17:24:25.221711] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-10-08T17:24:25.222071] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-08T17:24:25.222144] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-08T17:24:25.222222] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-08T17:24:25.222949] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-08T17:24:25.223974] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T17:24:25.588409] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:25.623433] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-08T17:24:25.637493] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T17:24:26.417565] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-08T17:24:26.665564] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T17:24:27.217630] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-08T17:24:27.595149] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T17:24:28.017691] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-08T17:24:28.292570] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T17:24:28.817583] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-08T17:24:29.218783] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T17:24:29.617615] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-08T17:24:30.198608] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:24:30.417617] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-08T17:24:31.093625] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:24:31.217493] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-08T17:24:31.801800] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T17:24:32.017585] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-08T17:24:32.385985] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T17:24:32.817507] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-08T17:24:33.205398] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T17:24:33.617576] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-08T17:24:34.109727] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T17:24:34.417556] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-08T17:24:34.917352] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:24:34.920520] [INFO ] [REMOTE ] AVNS: Full fetch complete (48430 records). [2025-10-08T17:24:34.920688] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-08T17:24:35.219050] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-08T17:24:35.347930] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-08T17:24:35.348100] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-08T17:24:35.348772] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-08T17:24:35.348838] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-08T17:24:35.350104] [DEBUG] [LOCAL ] AVNS: Trimmed 48430 records to 33577 (keeping 200 days of data) [2025-10-08T17:24:35.544741] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T17:24:35.572488] [DEBUG] [LOCAL ] AVNS: Primary data saved (33577 records). [2025-10-08T17:24:35.572681] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-08T17:24:35.573730] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVNS took 26.0s. Estimated remaining: 4h 51m 33s. Rate: 7.5 symbols/min [2025-10-08T17:24:35.745506] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:35.802787] [DEBUG] [LOCAL ] AVTR: Loaded 53566 existing records from primary storage. [2025-10-08T17:24:35.803185] [INFO ] [MAIN ] AVTR: Loaded 53566 existing records. [2025-10-08T17:24:35.982386] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:35.982603] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-08T17:24:35.982675] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-08T17:24:35.982994] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-08T17:24:35.983051] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-08T17:24:36.022858] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-08T17:24:36.365308] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T17:24:36.364730] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:36.763904] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T17:24:36.817547] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-08T17:24:37.617557] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-08T17:24:37.898185] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T17:24:38.417606] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-08T17:24:39.217605] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-08T17:24:39.270850] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T17:24:39.835423] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:24:40.017547] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-08T17:24:40.213379] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T17:24:40.817569] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-08T17:24:41.363267] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T17:24:41.617515] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-08T17:24:41.807440] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:24:42.417522] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-08T17:24:42.744924] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T17:24:43.217552] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-08T17:24:43.667026] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T17:24:44.017584] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-08T17:24:44.795582] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T17:24:44.817493] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-08T17:24:44.986803] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T17:24:45.617610] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-08T17:24:46.422709] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-08T17:24:46.443262] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:24:46.501947] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T17:24:47.217574] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-08T17:24:47.552467] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T17:24:47.554701] [INFO ] [REMOTE ] AVK: Full fetch complete (26738 records). [2025-10-08T17:24:47.554786] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-08T17:24:47.938376] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-08T17:24:47.938499] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-08T17:24:47.938903] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-08T17:24:47.938965] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-08T17:24:47.939821] [DEBUG] [LOCAL ] AVK: Trimmed 26738 records to 18294 (keeping 200 days of data) [2025-10-08T17:24:48.018220] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-08T17:24:48.050463] [DEBUG] [LOCAL ] AVK: Primary data saved (18294 records). [2025-10-08T17:24:48.050603] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-08T17:24:48.050720] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVK took 44.3s. Estimated remaining: 4h 52m 18s. Rate: 7.5 symbols/min [2025-10-08T17:24:48.232573] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:48.269344] [DEBUG] [LOCAL ] AVY: Loaded 37557 existing records from primary storage. [2025-10-08T17:24:48.269697] [INFO ] [MAIN ] AVY: Loaded 37557 existing records. [2025-10-08T17:24:48.442754] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:48.442985] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-08T17:24:48.443038] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-08T17:24:48.444333] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-08T17:24:48.444394] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-08T17:24:48.798975] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:48.817495] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-08T17:24:49.022587] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T17:24:49.024254] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:24:49.036828] [INFO ] [REMOTE ] AVD: Full fetch complete (33259 records). [2025-10-08T17:24:49.037512] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-08T17:24:49.420516] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-08T17:24:49.420598] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-08T17:24:49.421191] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-08T17:24:49.421275] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-08T17:24:49.422160] [DEBUG] [LOCAL ] AVD: Trimmed 33259 records to 22246 (keeping 200 days of data) [2025-10-08T17:24:49.547349] [DEBUG] [LOCAL ] AVD: Primary data saved (22246 records). [2025-10-08T17:24:49.547498] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-08T17:24:49.547588] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVD took 46.9s. Estimated remaining: 4h 50m 53s. Rate: 7.5 symbols/min [2025-10-08T17:24:49.622828] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-08T17:24:49.716210] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:49.743446] [DEBUG] [LOCAL ] AWF: Loaded 24241 existing records from primary storage. [2025-10-08T17:24:49.743729] [INFO ] [MAIN ] AWF: Loaded 24241 existing records. [2025-10-08T17:24:49.921225] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:49.921532] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-08T17:24:49.921866] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-08T17:24:49.922280] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-08T17:24:49.922340] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-08T17:24:50.293050] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:50.307334] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:24:50.417526] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-08T17:24:51.217599] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-08T17:24:51.552638] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T17:24:51.960539] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:24:52.017542] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-08T17:24:52.296065] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T17:24:52.817589] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-08T17:24:53.538603] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T17:24:53.617529] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-08T17:24:54.290621] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T17:24:54.417549] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-08T17:24:55.211256] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T17:24:55.217428] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-08T17:24:55.243558] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:24:56.017511] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-08T17:24:56.312179] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T17:24:56.817592] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-08T17:24:57.617625] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-08T17:24:57.850694] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T17:24:58.325925] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T17:24:58.417609] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-08T17:24:59.032793] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:24:59.217559] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-08T17:24:59.818311] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:25:00.017621] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-08T17:25:00.815682] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T17:25:00.823237] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-08T17:25:01.617587] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-08T17:25:02.174544] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-08T17:25:02.417588] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-08T17:25:02.482046] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T17:25:02.832113] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T17:25:03.217619] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-08T17:25:03.547550] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:25:04.017548] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-08T17:25:04.559510] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:25:04.817610] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-08T17:25:05.558508] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:25:05.617519] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-08T17:25:05.926280] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T17:25:06.417622] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-08T17:25:07.217672] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-08T17:25:07.412660] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T17:25:07.434140] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T17:25:07.438713] [INFO ] [REMOTE ] AVNT: Full fetch complete (56365 records). [2025-10-08T17:25:07.438891] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-08T17:25:07.899093] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-08T17:25:07.899196] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-08T17:25:07.899859] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-08T17:25:07.899924] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-08T17:25:07.901290] [DEBUG] [LOCAL ] AVNT: Trimmed 56365 records to 39051 (keeping 200 days of data) [2025-10-08T17:25:08.021086] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-08T17:25:08.167621] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:25:08.189412] [DEBUG] [LOCAL ] AVNT: Primary data saved (39051 records). [2025-10-08T17:25:08.189636] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-08T17:25:08.189774] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVNT took 43.2s. Estimated remaining: 4h 52m 50s. Rate: 7.5 symbols/min [2025-10-08T17:25:08.368460] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:08.394383] [DEBUG] [LOCAL ] AWI: Loaded 25292 existing records from primary storage. [2025-10-08T17:25:08.394662] [INFO ] [MAIN ] AWI: Loaded 25292 existing records. [2025-10-08T17:25:08.567666] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:08.567891] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-08T17:25:08.567938] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-08T17:25:08.568166] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-08T17:25:08.568225] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-08T17:25:08.822840] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-08T17:25:08.918546] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:09.617528] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-08T17:25:09.697058] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:25:09.701412] [INFO ] [REMOTE ] AVTR: Full fetch complete (77441 records). [2025-10-08T17:25:09.701568] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-08T17:25:10.080414] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:25:10.129074] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-08T17:25:10.129159] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-08T17:25:10.129941] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-08T17:25:10.130010] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-08T17:25:10.131568] [DEBUG] [LOCAL ] AVTR: Trimmed 77441 records to 53563 (keeping 200 days of data) [2025-10-08T17:25:10.429476] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-08T17:25:10.455485] [DEBUG] [LOCAL ] AVTR: Primary data saved (53563 records). [2025-10-08T17:25:10.455628] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-08T17:25:10.455751] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 34.9s. Estimated remaining: 4h 51m 35s. Rate: 7.5 symbols/min [2025-10-08T17:25:10.632413] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:10.680665] [DEBUG] [LOCAL ] AWK: Loaded 48693 existing records from primary storage. [2025-10-08T17:25:10.681039] [INFO ] [MAIN ] AWK: Loaded 48693 existing records. [2025-10-08T17:25:10.867043] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:10.867342] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-08T17:25:10.867396] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-08T17:25:10.869124] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-08T17:25:10.869196] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-08T17:25:11.231510] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-08T17:25:11.241845] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:11.284798] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T17:25:11.521372] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T17:25:12.017592] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-08T17:25:12.366905] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T17:25:12.817557] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-08T17:25:13.086198] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:25:13.617592] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-08T17:25:14.157291] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:25:14.417615] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-08T17:25:14.976018] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T17:25:15.217597] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-08T17:25:15.578170] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T17:25:16.017531] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-08T17:25:16.253293] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T17:25:16.817569] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-08T17:25:17.260087] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T17:25:17.617565] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-08T17:25:17.722362] [DEBUG] [REMOTE ] AVY: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-08T17:25:17.722769] [WARN ] [REMOTE ] AVY: No data returned for month 2025-10 [2025-10-08T17:25:17.722877] [FATAL] [REMOTE ] AVY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:25:17.723007] [FATAL] [MAIN ] AVY: Failed to fetch primary data. [2025-10-08T17:25:17.723094] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:25:17.723190] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-08T17:25:17.723271] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-08T17:25:17.723307] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-08T17:25:17.723586] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-10-08T17:25:17.724740] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVY took 29.7s. Estimated remaining: 4h 51m 18s. Rate: 7.5 symbols/min [2025-10-08T17:25:17.901166] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:17.923546] [DEBUG] [LOCAL ] AWP: Loaded 21505 existing records from primary storage. [2025-10-08T17:25:17.923884] [INFO ] [MAIN ] AWP: Loaded 21505 existing records. [2025-10-08T17:25:18.043957] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T17:25:18.128324] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:18.128563] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-08T17:25:18.128613] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-08T17:25:18.129307] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-08T17:25:18.129369] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-08T17:25:18.422734] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-08T17:25:18.478863] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:19.217594] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-08T17:25:19.884846] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T17:25:20.017622] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-08T17:25:20.261922] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T17:25:20.817572] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-08T17:25:21.106516] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T17:25:21.617548] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-08T17:25:21.638357] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T17:25:21.640459] [INFO ] [REMOTE ] AWF: Full fetch complete (36025 records). [2025-10-08T17:25:21.640531] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-08T17:25:22.010897] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-08T17:25:22.011127] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-08T17:25:22.011569] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-08T17:25:22.011610] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-08T17:25:22.012405] [DEBUG] [LOCAL ] AWF: Trimmed 36025 records to 24261 (keeping 200 days of data) [2025-10-08T17:25:22.153890] [DEBUG] [LOCAL ] AWF: Primary data saved (24261 records). [2025-10-08T17:25:22.154017] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-08T17:25:22.154095] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 32.6s. Estimated remaining: 4h 50m 29s. Rate: 7.5 symbols/min [2025-10-08T17:25:22.318985] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:22.340124] [DEBUG] [LOCAL ] AWR: Loaded 22714 existing records from primary storage. [2025-10-08T17:25:22.340378] [INFO ] [MAIN ] AWR: Loaded 22714 existing records. [2025-10-08T17:25:22.422742] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-08T17:25:22.519697] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:22.519952] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-08T17:25:22.520000] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-08T17:25:22.520860] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-08T17:25:22.520943] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-08T17:25:22.878391] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:22.894837] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:25:23.217561] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-08T17:25:23.953564] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:25:24.017515] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-08T17:25:24.524536] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T17:25:24.817599] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-08T17:25:25.488011] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:25:25.617589] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-08T17:25:26.029251] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T17:25:26.417565] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-08T17:25:26.662983] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T17:25:27.217590] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-08T17:25:28.031634] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-08T17:25:28.037966] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:25:28.267241] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T17:25:28.817595] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-08T17:25:28.868004] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:25:29.617525] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-08T17:25:30.078566] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T17:25:30.417558] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-08T17:25:30.792695] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T17:25:31.104604] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T17:25:31.217545] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-08T17:25:32.017529] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-08T17:25:32.268617] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T17:25:32.271161] [INFO ] [REMOTE ] AWI: Full fetch complete (35681 records). [2025-10-08T17:25:32.271338] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-08T17:25:32.722671] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-08T17:25:32.722787] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-08T17:25:32.723259] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-08T17:25:32.723304] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-08T17:25:32.724439] [DEBUG] [LOCAL ] AWI: Trimmed 35681 records to 25305 (keeping 200 days of data) [2025-10-08T17:25:32.817577] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-08T17:25:32.895201] [DEBUG] [LOCAL ] AWI: Primary data saved (25305 records). [2025-10-08T17:25:32.895388] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-08T17:25:32.895517] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 24.7s. Estimated remaining: 4h 50m 52s. Rate: 7.5 symbols/min [2025-10-08T17:25:33.075319] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:33.102720] [DEBUG] [LOCAL ] AX: Loaded 28121 existing records from primary storage. [2025-10-08T17:25:33.103019] [INFO ] [MAIN ] AX: Loaded 28121 existing records. [2025-10-08T17:25:33.282875] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:33.283141] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-08T17:25:33.283191] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-08T17:25:33.283981] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-08T17:25:33.284043] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-08T17:25:33.618174] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-08T17:25:33.663308] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:33.765976] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:25:33.913823] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:25:34.417573] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-08T17:25:34.443279] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T17:25:35.217588] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-08T17:25:35.748047] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T17:25:36.017612] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-08T17:25:36.270835] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:25:36.817615] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-08T17:25:37.617629] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-08T17:25:37.705948] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T17:25:37.942026] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:25:38.417568] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-08T17:25:39.062095] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:25:39.217518] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-08T17:25:39.271093] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T17:25:40.017554] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-08T17:25:40.326785] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T17:25:40.817597] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-08T17:25:41.318485] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:25:41.582841] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T17:25:41.617499] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-08T17:25:42.417518] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-08T17:25:42.530522] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T17:25:43.217599] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-08T17:25:43.985898] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T17:25:44.017541] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-08T17:25:44.400808] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T17:25:44.817568] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-08T17:25:45.617532] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-08T17:25:45.891859] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T17:25:45.917512] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:25:46.417516] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-08T17:25:46.724967] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T17:25:47.217521] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-08T17:25:47.251921] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:25:47.254401] [INFO ] [REMOTE ] AWP: Full fetch complete (32134 records). [2025-10-08T17:25:47.254489] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-08T17:25:47.626188] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-08T17:25:47.626272] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-08T17:25:47.626734] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-08T17:25:47.626795] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-08T17:25:47.627540] [DEBUG] [LOCAL ] AWP: Trimmed 32134 records to 21500 (keeping 200 days of data) [2025-10-08T17:25:47.767159] [DEBUG] [LOCAL ] AWP: Primary data saved (21500 records). [2025-10-08T17:25:47.767301] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-08T17:25:47.767387] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 30.0s. Estimated remaining: 4h 52m 2s. Rate: 7.5 symbols/min [2025-10-08T17:25:47.971552] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:47.971774] [DEBUG] [LOCAL ] AXL: No existing data file found in primary storage. [2025-10-08T17:25:47.971868] [WARN ] [MAIN ] AXL: No existing data found, performing full refresh instead. [2025-10-08T17:25:47.972014] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-08T17:25:47.972057] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-08T17:25:47.972098] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-10-08T17:25:47.972130] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-08T17:25:48.025176] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-08T17:25:48.343271] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T17:25:48.342517] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:48.817611] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-08T17:25:49.484573] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T17:25:49.617543] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-08T17:25:49.838672] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T17:25:50.417564] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-08T17:25:50.439405] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T17:25:51.217575] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-08T17:25:51.850960] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:25:52.017554] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-08T17:25:52.598998] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:25:52.817549] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-08T17:25:53.144548] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T17:25:53.617574] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-08T17:25:54.235760] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:25:54.410014] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T17:25:54.417492] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-08T17:25:55.217512] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-08T17:25:55.620261] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T17:25:56.017576] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-08T17:25:56.765833] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:25:56.817622] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-08T17:25:57.617571] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-08T17:25:57.679158] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T17:25:58.325106] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T17:25:58.417625] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-08T17:25:58.743096] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T17:25:59.217636] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-08T17:25:59.344069] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T17:26:00.017623] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-08T17:26:00.787729] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:26:00.817509] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-08T17:26:00.874112] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T17:26:01.617581] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-08T17:26:02.305809] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T17:26:02.417574] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-08T17:26:02.437667] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T17:26:02.439875] [INFO ] [REMOTE ] AWR: Full fetch complete (32273 records). [2025-10-08T17:26:02.439972] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-08T17:26:02.837153] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-08T17:26:02.837243] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-08T17:26:02.837741] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-08T17:26:02.837806] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-08T17:26:02.838571] [DEBUG] [LOCAL ] AWR: Trimmed 32273 records to 22687 (keeping 200 days of data) [2025-10-08T17:26:02.983632] [DEBUG] [LOCAL ] AWR: Primary data saved (22687 records). [2025-10-08T17:26:02.983799] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-08T17:26:02.983937] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWR took 40.8s. Estimated remaining: 4h 53m 15s. Rate: 7.4 symbols/min [2025-10-08T17:26:03.150843] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:03.203313] [DEBUG] [LOCAL ] AXP: Loaded 53170 existing records from primary storage. [2025-10-08T17:26:03.203698] [INFO ] [MAIN ] AXP: Loaded 53170 existing records. [2025-10-08T17:26:03.224521] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-08T17:26:03.386784] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:03.387056] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-08T17:26:03.387105] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-08T17:26:03.387411] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-08T17:26:03.387470] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-08T17:26:03.748353] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:03.820516] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T17:26:04.017583] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-08T17:26:04.558841] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:26:04.562621] [INFO ] [REMOTE ] AWK: Full fetch complete (70690 records). [2025-10-08T17:26:04.562781] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-08T17:26:04.822687] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-08T17:26:04.953203] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-08T17:26:04.953300] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-08T17:26:04.954108] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-08T17:26:04.954176] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-08T17:26:04.955734] [DEBUG] [LOCAL ] AWK: Trimmed 70690 records to 48684 (keeping 200 days of data) [2025-10-08T17:26:05.266486] [DEBUG] [LOCAL ] AWK: Primary data saved (48684 records). [2025-10-08T17:26:05.266779] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-08T17:26:05.267596] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWK took 54.8s. Estimated remaining: 4h 52m 2s. Rate: 7.5 symbols/min [2025-10-08T17:26:05.451019] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:05.458594] [DEBUG] [LOCAL ] AXR: Loaded 2994 existing records from primary storage. [2025-10-08T17:26:05.458956] [INFO ] [MAIN ] AXR: Loaded 2994 existing records. [2025-10-08T17:26:05.620301] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-08T17:26:05.690872] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:05.691489] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-08T17:26:05.691695] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-08T17:26:05.692078] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-08T17:26:05.692147] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-08T17:26:05.805153] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T17:26:06.107666] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:06.417535] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-08T17:26:06.576183] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T17:26:06.782061] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T17:26:06.784312] [INFO ] [REMOTE ] AX: Full fetch complete (42382 records). [2025-10-08T17:26:06.784395] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-08T17:26:07.167902] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-08T17:26:07.167994] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-08T17:26:07.168673] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-08T17:26:07.168737] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-08T17:26:07.169606] [DEBUG] [LOCAL ] AX: Trimmed 42382 records to 28069 (keeping 200 days of data) [2025-10-08T17:26:07.224193] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-08T17:26:07.341059] [DEBUG] [LOCAL ] AX: Primary data saved (28069 records). [2025-10-08T17:26:07.341202] [INFO ] [MAIN ] AX: Full history saved. [2025-10-08T17:26:07.341316] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 34.4s. Estimated remaining: 4h 50m 47s. Rate: 7.5 symbols/min [2025-10-08T17:26:07.528549] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:07.570285] [DEBUG] [LOCAL ] AXS: Loaded 38558 existing records from primary storage. [2025-10-08T17:26:07.570664] [INFO ] [MAIN ] AXS: Loaded 38558 existing records. [2025-10-08T17:26:07.781812] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:07.782180] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-08T17:26:07.782268] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-08T17:26:07.782613] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-08T17:26:07.782730] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-08T17:26:08.009835] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T17:26:08.025127] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-08T17:26:08.214347] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:26:08.220703] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:08.817687] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-08T17:26:09.617506] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-08T17:26:10.073351] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T17:26:10.120899] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T17:26:10.162162] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T17:26:10.417539] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-08T17:26:11.217558] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-08T17:26:11.693518] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T17:26:12.017604] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-08T17:26:12.415588] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T17:26:12.611171] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T17:26:12.817638] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-08T17:26:13.617556] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-08T17:26:14.422835] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:26:14.421623] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-08T17:26:15.217547] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-08T17:26:15.596509] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T17:26:15.839947] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T17:26:16.017543] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-08T17:26:16.060679] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T17:26:16.064541] [INFO ] [REMOTE ] AXL: Full fetch complete (72785 records). [2025-10-08T17:26:16.064709] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-08T17:26:16.465885] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-08T17:26:16.466089] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-08T17:26:16.466947] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-08T17:26:16.467012] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-08T17:26:16.468674] [DEBUG] [LOCAL ] AXL: Trimmed 72785 records to 50517 (keeping 200 days of data) [2025-10-08T17:26:16.743839] [DEBUG] [LOCAL ] AXL: Primary data saved (50517 records). [2025-10-08T17:26:16.743993] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-08T17:26:16.744069] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 29.0s. Estimated remaining: 4h 50m 55s. Rate: 7.5 symbols/min [2025-10-08T17:26:16.822879] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-08T17:26:16.922324] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:16.972907] [DEBUG] [LOCAL ] AXTA: Loaded 52161 existing records from primary storage. [2025-10-08T17:26:16.973262] [INFO ] [MAIN ] AXTA: Loaded 52161 existing records. [2025-10-08T17:26:17.158152] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:17.158594] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-08T17:26:17.158709] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-08T17:26:17.159771] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-08T17:26:17.159836] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-08T17:26:17.379551] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:26:17.546726] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:17.570719] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T17:26:17.617596] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-08T17:26:18.417564] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-08T17:26:18.975905] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:26:19.217572] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-08T17:26:19.908756] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T17:26:20.017620] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-08T17:26:20.435208] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T17:26:20.483139] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T17:26:20.817567] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-08T17:26:21.617559] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-08T17:26:22.055366] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T17:26:22.427675] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-08T17:26:22.434617] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:26:23.217621] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-08T17:26:24.017613] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-08T17:26:24.513324] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-08T17:26:24.817577] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-08T17:26:24.927409] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:26:25.166562] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T17:26:25.301141] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T17:26:25.617546] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-08T17:26:26.417549] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-08T17:26:26.910001] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:26:26.910807] [INFO ] [REMOTE ] AXR: Full fetch complete (4640 records). [2025-10-08T17:26:26.910879] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-08T17:26:27.223752] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-08T17:26:27.417437] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-08T17:26:27.417541] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-08T17:26:27.417778] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-08T17:26:27.417885] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-08T17:26:27.418585] [DEBUG] [LOCAL ] AXR: Trimmed 4640 records to 2986 (keeping 200 days of data) [2025-10-08T17:26:27.437455] [DEBUG] [LOCAL ] AXR: Primary data saved (2986 records). [2025-10-08T17:26:27.437668] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-08T17:26:27.437780] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 22.2s. Estimated remaining: 4h 51m 16s. Rate: 7.5 symbols/min [2025-10-08T17:26:27.470708] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T17:26:28.017560] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-08T17:26:28.791825] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:26:28.817500] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-08T17:26:29.617540] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-08T17:26:29.737851] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T17:26:30.294943] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T17:26:30.417584] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-08T17:26:31.198210] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T17:26:31.217498] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-08T17:26:31.806470] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:26:32.017627] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-08T17:26:32.817590] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-08T17:26:32.973762] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T17:26:33.513391] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T17:26:33.617549] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-08T17:26:34.417544] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-08T17:26:34.559509] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:26:35.023070] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T17:26:35.217595] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-08T17:26:35.883591] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T17:26:36.017547] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-08T17:26:36.470145] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T17:26:36.817554] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-08T17:26:37.617568] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-08T17:26:37.668010] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T17:26:37.946172] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T17:26:37.949579] [INFO ] [REMOTE ] AXS: Full fetch complete (55723 records). [2025-10-08T17:26:37.949777] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-08T17:26:38.354294] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-08T17:26:38.354393] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-08T17:26:38.355114] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-08T17:26:38.355183] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-08T17:26:38.356478] [DEBUG] [LOCAL ] AXS: Trimmed 55723 records to 38632 (keeping 200 days of data) [2025-10-08T17:26:38.422215] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-08T17:26:38.635796] [DEBUG] [LOCAL ] AXS: Primary data saved (38632 records). [2025-10-08T17:26:38.635979] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-08T17:26:38.636095] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXS took 31.3s. Estimated remaining: 4h 51m 43s. Rate: 7.4 symbols/min [2025-10-08T17:26:39.761840] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T17:26:39.775254] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-08T17:26:40.159800] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T17:26:40.170789] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-08T17:26:41.726320] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-08T17:26:41.732305] [INFO ] [REMOTE ] AXP: Full fetch complete (76912 records). [2025-10-08T17:26:41.732513] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-08T17:26:42.106792] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-08T17:26:42.151305] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-08T17:26:42.232184] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-08T17:26:42.232297] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-08T17:26:42.233156] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-08T17:26:42.233341] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-08T17:26:42.235117] [DEBUG] [LOCAL ] AXP: Trimmed 76912 records to 53172 (keeping 200 days of data) [2025-10-08T17:26:42.586928] [DEBUG] [LOCAL ] AXP: Primary data saved (53172 records). [2025-10-08T17:26:42.587171] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-08T17:26:42.587335] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXP took 39.6s. Estimated remaining: 4h 50m 50s. Rate: 7.5 symbols/min [2025-10-08T17:26:44.060803] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T17:26:44.073162] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-08T17:26:45.745047] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T17:26:45.757374] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-08T17:26:47.368533] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:26:47.372568] [INFO ] [REMOTE ] AXTA: Full fetch complete (75117 records). [2025-10-08T17:26:47.372730] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-08T17:26:47.758343] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-08T17:26:47.758476] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-08T17:26:47.759359] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-08T17:26:47.759426] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-08T17:26:47.760987] [DEBUG] [LOCAL ] AXTA: Trimmed 75117 records to 52183 (keeping 200 days of data) [2025-10-08T17:26:48.055182] [DEBUG] [LOCAL ] AXTA: Primary data saved (52183 records). [2025-10-08T17:26:48.055322] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-08T17:26:48.055405] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 31.3s. Estimated remaining: 4h 50m 14s. Rate: 7.5 symbols/min [2025-10-08T17:26:48.706203] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:48.699124] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:48.695666] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:48.719837] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-08T17:26:48.756356] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:48.756478] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-08T17:26:48.757059] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-08T17:26:48.757484] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-08T17:26:48.757673] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-08T17:26:48.757729] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-08T17:26:48.920077] [DEBUG] [LOCAL ] AYI: Loaded 25223 existing records from primary storage. [2025-10-08T17:26:48.932464] [INFO ] [MAIN ] AYI: Loaded 25223 existing records. [2025-10-08T17:26:48.938025] [DEBUG] [LOCAL ] AZZ: Loaded 22027 existing records from primary storage. [2025-10-08T17:26:48.919283] [DEBUG] [LOCAL ] AZO: Loaded 11286 existing records from primary storage. [2025-10-08T17:26:48.995856] [INFO ] [MAIN ] AZZ: Loaded 22027 existing records. [2025-10-08T17:26:48.977245] [INFO ] [MAIN ] AZO: Loaded 11286 existing records. [2025-10-08T17:26:49.626497] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:49.587816] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:49.647008] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-08T17:26:49.706944] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-08T17:26:49.727484] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-08T17:26:49.733179] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:49.727327] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:49.733802] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-08T17:26:49.733720] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-08T17:26:49.734972] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-08T17:26:49.735094] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-08T17:26:49.746206] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-08T17:26:49.746390] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-08T17:26:49.733912] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-08T17:26:49.775977] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-08T17:26:49.789713] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-08T17:26:49.888604] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-08T17:26:50.740334] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:50.785232] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-08T17:26:50.801815] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:50.807274] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-08T17:26:50.871222] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:50.871733] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-08T17:26:51.050125] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T17:26:51.056884] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-08T17:26:51.680489] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T17:26:51.686917] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-08T17:26:51.758142] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T17:26:51.765744] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-08T17:26:51.876792] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T17:26:51.888556] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-08T17:26:52.027690] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T17:26:52.033620] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-08T17:26:52.079824] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:26:52.080250] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-08T17:26:52.080357] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:26:52.080462] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-08T17:26:52.080527] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:26:52.080589] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-08T17:26:52.080732] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-08T17:26:52.080805] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-08T17:26:52.080905] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-08T17:26:52.081013] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.0s. Estimated remaining: 4h 49m 23s. Rate: 7.5 symbols/min [2025-10-08T17:26:52.381216] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:52.393629] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T17:26:52.398290] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-08T17:26:52.454432] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-08T17:26:52.454946] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-08T17:26:52.660888] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:52.661225] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-08T17:26:52.661284] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-08T17:26:52.663007] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-08T17:26:52.663074] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-08T17:26:52.995317] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T17:26:53.038941] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T17:26:53.081828] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:53.059867] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-08T17:26:53.085552] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-08T17:26:53.087313] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-08T17:26:53.164397] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T17:26:53.617614] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-08T17:26:53.970889] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:26:54.221843] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T17:26:54.417628] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-08T17:26:54.713237] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T17:26:55.217705] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-08T17:26:55.281907] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-08T17:26:55.581072] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T17:26:56.017527] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-08T17:26:56.134212] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T17:26:56.817510] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-08T17:26:56.841614] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:26:57.617595] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-08T17:26:58.217792] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:26:58.370457] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T17:26:58.417580] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-08T17:26:59.217594] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-08T17:26:59.491620] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:27:00.017530] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-08T17:27:00.219185] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T17:27:00.817564] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-08T17:27:01.617586] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-08T17:27:02.103229] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:27:02.417519] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-08T17:27:02.456050] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-08T17:27:02.917975] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T17:27:03.217563] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-08T17:27:03.580020] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:27:04.017540] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-08T17:27:04.345801] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T17:27:04.790625] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T17:27:04.817500] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-08T17:27:05.617522] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-08T17:27:05.682633] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T17:27:06.417554] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-08T17:27:06.714734] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T17:27:07.217551] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-08T17:27:08.017562] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-08T17:27:08.083430] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T17:27:08.370885] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T17:27:08.817595] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-08T17:27:09.011025] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:27:09.617556] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-08T17:27:09.648307] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T17:27:10.417557] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-08T17:27:11.217551] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-08T17:27:11.585892] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T17:27:12.017537] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-08T17:27:12.060010] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-08T17:27:12.314288] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T17:27:12.316555] [INFO ] [REMOTE ] AZZ: Full fetch complete (31152 records). [2025-10-08T17:27:12.316682] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-08T17:27:12.692975] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-08T17:27:12.693086] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-08T17:27:12.693514] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-08T17:27:12.693557] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-08T17:27:12.694488] [DEBUG] [LOCAL ] AZZ: Trimmed 31152 records to 22128 (keeping 200 days of data) [2025-10-08T17:27:12.818363] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-08T17:27:12.832442] [DEBUG] [LOCAL ] AZZ: Primary data saved (22128 records). [2025-10-08T17:27:12.832607] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-08T17:27:12.832873] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZZ took 24.8s. Estimated remaining: 4h 51m 32s. Rate: 7.4 symbols/min [2025-10-08T17:27:13.002203] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:13.002421] [DEBUG] [LOCAL ] BABA: No existing data file found in primary storage. [2025-10-08T17:27:13.002464] [WARN ] [MAIN ] BABA: No existing data found, performing full refresh instead. [2025-10-08T17:27:13.002538] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-08T17:27:13.002574] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-08T17:27:13.002615] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-08T17:27:13.002673] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-08T17:27:13.304788] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T17:27:13.390772] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:13.617535] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-08T17:27:13.751559] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:27:14.417630] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-08T17:27:15.217566] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-08T17:27:15.571537] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:27:15.574605] [INFO ] [REMOTE ] AYI: Full fetch complete (37107 records). [2025-10-08T17:27:15.574782] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-08T17:27:15.989036] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-08T17:27:15.989227] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-08T17:27:15.989790] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-08T17:27:15.989906] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-08T17:27:15.991275] [DEBUG] [LOCAL ] AYI: Trimmed 37107 records to 25246 (keeping 200 days of data) [2025-10-08T17:27:16.049627] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-08T17:27:16.134546] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-08T17:27:16.200768] [DEBUG] [LOCAL ] AYI: Primary data saved (25246 records). [2025-10-08T17:27:16.200927] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-08T17:27:16.201019] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 28.1s. Estimated remaining: 4h 50m 33s. Rate: 7.5 symbols/min [2025-10-08T17:27:16.372269] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:16.423273] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-08T17:27:16.423638] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-08T17:27:16.607697] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:27:16.607919] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-08T17:27:16.607966] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-08T17:27:16.609863] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-08T17:27:16.609923] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-08T17:27:16.822736] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-08T17:27:16.976532] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:17.011305] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T17:27:17.012843] [INFO ] [REMOTE ] AZO: Full fetch complete (16053 records). [2025-10-08T17:27:17.012928] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-08T17:27:17.438704] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-08T17:27:17.438797] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-08T17:27:17.439190] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-08T17:27:17.439230] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-08T17:27:17.440094] [DEBUG] [LOCAL ] AZO: Trimmed 16053 records to 11256 (keeping 200 days of data) [2025-10-08T17:27:17.523047] [DEBUG] [LOCAL ] AZO: Primary data saved (11256 records). [2025-10-08T17:27:17.523235] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-08T17:27:17.523341] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AZO took 29.5s. Estimated remaining: 4h 49m 14s. Rate: 7.5 symbols/min [2025-10-08T17:27:17.631863] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-08T17:27:17.731774] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:17.732272] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-10-08T17:27:17.732396] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-10-08T17:27:17.732672] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-08T17:27:17.732775] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-08T17:27:17.732919] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-08T17:27:17.733099] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-08T17:27:18.169264] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-08T17:27:18.167197] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:18.417616] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-08T17:27:19.217553] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-08T17:27:19.332303] [DEBUG] [REMOTE ] BAH: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-08T17:27:19.332614] [WARN ] [REMOTE ] BAH: No data returned for month 2024-12 [2025-10-08T17:27:19.332740] [FATAL] [REMOTE ] BAH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:27:19.332786] [FATAL] [MAIN ] BAH: Failed to fetch primary data. [2025-10-08T17:27:19.332818] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:27:19.332887] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-08T17:27:19.332950] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-08T17:27:19.332984] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-10-08T17:27:19.333048] [DEBUG] [LOCAL ] BAH: No derivative data file found to delete. [2025-10-08T17:27:19.333118] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BAH took 1.8s. Estimated remaining: 4h 48m 0s. Rate: 7.5 symbols/min [2025-10-08T17:27:19.509557] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:19.545028] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-08T17:27:19.587061] [DEBUG] [LOCAL ] BAK: Loaded 39374 existing records from primary storage. [2025-10-08T17:27:19.587402] [INFO ] [MAIN ] BAK: Loaded 39374 existing records. [2025-10-08T17:27:19.781399] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:27:19.781681] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-08T17:27:19.781755] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-08T17:27:19.782021] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-08T17:27:19.782084] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-08T17:27:20.024078] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-08T17:27:20.160559] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:20.189876] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-08T17:27:20.817510] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-08T17:27:21.171950] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-08T17:27:21.617570] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-08T17:27:22.417596] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-08T17:27:22.587287] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-08T17:27:23.094893] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-08T17:27:23.217569] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-08T17:27:23.654185] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T17:27:23.732191] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T17:27:24.017637] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-08T17:27:24.817560] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-08T17:27:25.179997] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T17:27:25.495983] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-08T17:27:25.617560] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-08T17:27:26.417609] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-08T17:27:26.705666] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T17:27:26.752005] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T17:27:27.217543] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-08T17:27:28.017581] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-08T17:27:28.817541] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-08T17:27:29.136676] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-08T17:27:29.396631] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T17:27:29.514980] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-08T17:27:29.617554] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-08T17:27:30.417565] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-08T17:27:31.113209] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-08T17:27:31.217538] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-08T17:27:31.648993] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:27:32.017577] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-08T17:27:32.396888] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-08T17:27:32.817755] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-08T17:27:33.290863] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T17:27:33.630678] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-08T17:27:33.637394] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-08T17:27:34.417558] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-08T17:27:35.217508] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-08T17:27:35.269749] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-08T17:27:35.309572] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:27:36.017604] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-08T17:27:36.666859] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-08T17:27:36.817550] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-08T17:27:37.128002] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T17:27:37.132696] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-08T17:27:37.132883] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-08T17:27:37.579570] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-08T17:27:37.585163] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-08T17:27:37.596148] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-08T17:27:37.596374] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-08T17:27:37.598380] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T17:27:37.611313] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 53790 (keeping 200 days of data) [2025-10-08T17:27:37.669258] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-08T17:27:37.753995] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-08T17:27:38.030969] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-08T17:27:38.031285] [INFO ] [MAIN ] BA: Full history saved. [2025-10-08T17:27:38.031447] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BA took 46.0s. Estimated remaining: 4h 49m 45s. Rate: 7.5 symbols/min [2025-10-08T17:27:38.217420] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:38.217722] [DEBUG] [LOCAL ] BALL: No existing data file found in primary storage. [2025-10-08T17:27:38.217780] [WARN ] [MAIN ] BALL: No existing data found, performing full refresh instead. [2025-10-08T17:27:38.217999] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-08T17:27:38.218048] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-08T17:27:38.218092] [DEBUG] [LOCAL ] BALL: No primary data file found to delete. [2025-10-08T17:27:38.218125] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-08T17:27:38.422817] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-08T17:27:38.612839] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:39.217580] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-08T17:27:40.032219] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-08T17:27:40.034881] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T17:27:40.152666] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-08T17:27:40.817570] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-08T17:27:41.617553] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-08T17:27:41.683149] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T17:27:41.920895] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:27:42.028086] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-08T17:27:42.417553] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-08T17:27:43.217549] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-08T17:27:43.693975] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-08T17:27:43.758218] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T17:27:43.762237] [INFO ] [REMOTE ] BAK: Full fetch complete (57099 records). [2025-10-08T17:27:43.762879] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-08T17:27:44.026231] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-08T17:27:44.220973] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-08T17:27:44.221098] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-08T17:27:44.222200] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-08T17:27:44.222283] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-08T17:27:44.223790] [DEBUG] [LOCAL ] BAK: Trimmed 57099 records to 39408 (keeping 200 days of data) [2025-10-08T17:27:44.546181] [DEBUG] [LOCAL ] BAK: Primary data saved (39408 records). [2025-10-08T17:27:44.546419] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-08T17:27:44.546595] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAK took 25.2s. Estimated remaining: 4h 49m 21s. Rate: 7.5 symbols/min [2025-10-08T17:27:44.820484] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-08T17:27:44.848992] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:44.849438] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-08T17:27:44.849547] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-08T17:27:44.849735] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-08T17:27:44.849826] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-08T17:27:44.850094] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-08T17:27:44.850232] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-08T17:27:45.230327] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-08T17:27:45.383079] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:45.617586] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-08T17:27:46.417552] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-08T17:27:46.616176] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-08T17:27:46.645661] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:27:47.217578] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-08T17:27:47.431672] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-08T17:27:48.017531] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-08T17:27:48.064877] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:27:48.182427] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:27:48.817576] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-08T17:27:49.617573] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-08T17:27:50.145733] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T17:27:50.283998] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-08T17:27:50.370389] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T17:27:50.417518] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-08T17:27:51.217578] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-08T17:27:52.017520] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-08T17:27:52.300330] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T17:27:52.817587] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-08T17:27:53.619667] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-08T17:27:53.637366] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-08T17:27:53.691370] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T17:27:54.417538] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-08T17:27:54.629540] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-08T17:27:54.938767] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T17:27:55.217539] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-08T17:27:56.017626] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-08T17:27:56.660662] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-08T17:27:56.664833] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-08T17:27:56.664973] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-08T17:27:56.820056] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-08T17:27:57.072948] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-08T17:27:57.073098] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-08T17:27:57.073952] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-08T17:27:57.074044] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-08T17:27:57.101418] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T17:27:57.111354] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-10-08T17:27:57.450897] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-08T17:27:57.451038] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-08T17:27:57.451175] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAC took 41.3s. Estimated remaining: 4h 50m 4s. Rate: 7.5 symbols/min [2025-10-08T17:27:57.621816] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-08T17:27:57.624464] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:57.630984] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T17:27:57.679984] [DEBUG] [LOCAL ] BAM: Loaded 52009 existing records from primary storage. [2025-10-08T17:27:57.680301] [INFO ] [MAIN ] BAM: Loaded 52009 existing records. [2025-10-08T17:27:57.855997] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:27:57.856218] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-08T17:27:57.856294] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-08T17:27:57.858151] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-08T17:27:57.858218] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-08T17:27:58.210366] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:58.417544] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-08T17:27:58.998637] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.98 seconds). [2025-10-08T17:27:59.002867] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-08T17:27:59.003012] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-08T17:27:59.222760] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-08T17:27:59.405539] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-08T17:27:59.405893] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-08T17:27:59.407323] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-08T17:27:59.407510] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-08T17:27:59.410723] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-10-08T17:27:59.443235] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T17:27:59.798508] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:27:59.833798] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-08T17:27:59.833910] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-08T17:27:59.833977] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BABA took 47.0s. Estimated remaining: 4h 48m 57s. Rate: 7.5 symbols/min [2025-10-08T17:28:00.016716] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:00.022625] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-08T17:28:00.030621] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T17:28:00.081840] [DEBUG] [LOCAL ] BANC: Loaded 51275 existing records from primary storage. [2025-10-08T17:28:00.082217] [INFO ] [MAIN ] BANC: Loaded 51275 existing records. [2025-10-08T17:28:00.262092] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:00.262341] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-08T17:28:00.262389] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-08T17:28:00.262598] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-08T17:28:00.262692] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-08T17:28:00.628470] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:00.817623] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-08T17:28:01.616483] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T17:28:01.625685] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-08T17:28:01.635595] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T17:28:02.417609] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-08T17:28:03.217572] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-08T17:28:03.297570] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T17:28:03.469514] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T17:28:04.017563] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-08T17:28:04.536483] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T17:28:04.605873] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T17:28:04.817577] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-08T17:28:05.405321] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T17:28:05.617549] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-08T17:28:06.417707] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-08T17:28:07.217566] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-08T17:28:07.395411] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T17:28:07.788077] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T17:28:08.017562] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-08T17:28:08.275933] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:28:08.277404] [INFO ] [REMOTE ] BALY: Full fetch complete (16797 records). [2025-10-08T17:28:08.277496] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-08T17:28:08.460781] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T17:28:08.461100] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:28:08.461170] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:28:08.461238] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-08T17:28:08.461300] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-08T17:28:08.461336] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-08T17:28:08.461375] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-08T17:28:08.461442] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALY took 23.9s. Estimated remaining: 4h 48m 56s. Rate: 7.5 symbols/min [2025-10-08T17:28:08.624206] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:08.651287] [DEBUG] [LOCAL ] BAP: Loaded 25960 existing records from primary storage. [2025-10-08T17:28:08.651539] [INFO ] [MAIN ] BAP: Loaded 25960 existing records. [2025-10-08T17:28:08.825387] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:08.821798] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-08T17:28:08.825775] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-08T17:28:08.825872] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-08T17:28:08.826899] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-08T17:28:08.826965] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-08T17:28:09.173429] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:09.413221] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T17:28:09.418379] [INFO ] [REMOTE ] BALL: Full fetch complete (75372 records). [2025-10-08T17:28:09.418626] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-08T17:28:09.622719] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-08T17:28:09.824951] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-08T17:28:09.825085] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-08T17:28:09.825906] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-08T17:28:09.825974] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-08T17:28:09.827955] [DEBUG] [LOCAL ] BALL: Trimmed 75372 records to 51825 (keeping 200 days of data) [2025-10-08T17:28:10.163078] [DEBUG] [LOCAL ] BALL: Primary data saved (51825 records). [2025-10-08T17:28:10.163294] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-08T17:28:10.163388] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALL took 32.1s. Estimated remaining: 4h 47m 43s. Rate: 7.5 symbols/min [2025-10-08T17:28:10.337051] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:10.374399] [DEBUG] [LOCAL ] BARK: Loaded 37946 existing records from primary storage. [2025-10-08T17:28:10.374771] [INFO ] [MAIN ] BARK: Loaded 37946 existing records. [2025-10-08T17:28:10.432792] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-08T17:28:10.560517] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:10.560921] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-08T17:28:10.561048] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-08T17:28:10.561419] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-08T17:28:10.561483] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-08T17:28:10.930386] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:10.967049] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-08T17:28:11.012048] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T17:28:11.217532] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-08T17:28:11.430927] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T17:28:12.017566] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-08T17:28:12.821160] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-08T17:28:12.827275] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T17:28:13.552222] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T17:28:13.617521] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-08T17:28:14.424797] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-08T17:28:14.427306] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:28:14.823225] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T17:28:15.217535] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-08T17:28:16.017520] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-08T17:28:16.244907] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T17:28:16.699257] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T17:28:16.817521] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-08T17:28:16.934220] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:28:17.617560] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-08T17:28:18.009605] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:28:18.417627] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-08T17:28:18.971339] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:28:19.217586] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-08T17:28:20.017564] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-08T17:28:20.251976] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:28:20.324431] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T17:28:20.817551] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-08T17:28:21.273708] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T17:28:21.617602] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-08T17:28:22.249764] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T17:28:22.417551] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-08T17:28:23.217525] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-08T17:28:23.423392] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:28:23.511903] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T17:28:24.017630] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-08T17:28:24.281839] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:28:24.817545] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-08T17:28:25.190389] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T17:28:25.617555] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-08T17:28:26.417534] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-08T17:28:26.448435] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T17:28:26.880418] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T17:28:27.217599] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-08T17:28:28.022728] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-08T17:28:28.047222] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:28:28.817610] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-08T17:28:29.039095] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:28:29.617596] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-08T17:28:29.689682] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:28:30.201196] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T17:28:30.417567] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-08T17:28:31.190238] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T17:28:31.217496] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-08T17:28:31.440897] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T17:28:32.017591] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-08T17:28:32.817574] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-08T17:28:32.929982] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T17:28:33.392183] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T17:28:33.617551] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-08T17:28:34.417552] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-08T17:28:34.502139] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T17:28:34.852977] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T17:28:35.217565] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-08T17:28:35.401494] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T17:28:36.017572] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-08T17:28:36.261176] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T17:28:36.263350] [INFO ] [REMOTE ] BAP: Full fetch complete (37363 records). [2025-10-08T17:28:36.263446] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-08T17:28:36.676397] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-08T17:28:36.676520] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-08T17:28:36.677123] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-08T17:28:36.677187] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-08T17:28:36.678131] [DEBUG] [LOCAL ] BAP: Trimmed 37363 records to 25923 (keeping 200 days of data) [2025-10-08T17:28:36.825934] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-08T17:28:36.852521] [DEBUG] [LOCAL ] BAP: Primary data saved (25923 records). [2025-10-08T17:28:36.852756] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-08T17:28:36.852855] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BAP took 28.4s. Estimated remaining: 4h 50m 45s. Rate: 7.4 symbols/min [2025-10-08T17:28:37.019407] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:37.074672] [DEBUG] [LOCAL ] BAX: Loaded 53504 existing records from primary storage. [2025-10-08T17:28:37.075040] [INFO ] [MAIN ] BAX: Loaded 53504 existing records. [2025-10-08T17:28:37.252858] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:37.253104] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-08T17:28:37.253164] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-08T17:28:37.253427] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-08T17:28:37.253484] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-08T17:28:37.361267] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T17:28:37.396270] [INFO ] [REMOTE ] BARK: Full fetch complete (55987 records). [2025-10-08T17:28:37.418589] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-08T17:28:37.628726] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-08T17:28:37.832279] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:38.022189] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-08T17:28:38.022281] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-08T17:28:38.022865] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-08T17:28:38.022927] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-08T17:28:38.024115] [DEBUG] [LOCAL ] BARK: Trimmed 55987 records to 37978 (keeping 200 days of data) [2025-10-08T17:28:38.240127] [DEBUG] [LOCAL ] BARK: Primary data saved (37978 records). [2025-10-08T17:28:38.240285] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-08T17:28:38.240374] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BARK took 28.1s. Estimated remaining: 4h 49m 29s. Rate: 7.5 symbols/min [2025-10-08T17:28:38.446689] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-08T17:28:38.453500] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:38.499310] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T17:28:38.550551] [DEBUG] [LOCAL ] BB: Loaded 52944 existing records from primary storage. [2025-10-08T17:28:38.550947] [INFO ] [MAIN ] BB: Loaded 52944 existing records. [2025-10-08T17:28:38.724133] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:38.724352] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-08T17:28:38.724398] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-08T17:28:38.724674] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-08T17:28:38.724734] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-08T17:28:39.075221] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:39.217568] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-08T17:28:39.438955] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T17:28:40.017570] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-08T17:28:40.424750] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T17:28:40.817525] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-08T17:28:41.263140] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T17:28:41.325144] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T17:28:41.617553] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-08T17:28:42.322457] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T17:28:42.326448] [INFO ] [REMOTE ] BAM: Full fetch complete (74544 records). [2025-10-08T17:28:42.326587] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-08T17:28:42.422673] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-08T17:28:42.739411] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-08T17:28:42.739526] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-08T17:28:42.740485] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-08T17:28:42.740585] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-08T17:28:42.742566] [DEBUG] [LOCAL ] BAM: Trimmed 74544 records to 52011 (keeping 200 days of data) [2025-10-08T17:28:43.006993] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:28:43.014211] [INFO ] [REMOTE ] BANC: Full fetch complete (74327 records). [2025-10-08T17:28:43.015172] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-08T17:28:43.221261] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-08T17:28:43.444885] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-08T17:28:43.445540] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-08T17:28:43.446430] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-08T17:28:43.446510] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-08T17:28:43.452403] [DEBUG] [LOCAL ] BANC: Trimmed 74327 records to 51277 (keeping 200 days of data) [2025-10-08T17:28:43.644229] [DEBUG] [LOCAL ] BAM: Primary data saved (52011 records). [2025-10-08T17:28:43.644708] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-08T17:28:43.645340] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAM took 46.2s. Estimated remaining: 4h 48m 55s. Rate: 7.5 symbols/min [2025-10-08T17:28:43.845944] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:44.012812] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-08T17:28:44.015383] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-08T17:28:44.244575] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:44.245985] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-08T17:28:44.246361] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-08T17:28:44.247683] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-08T17:28:44.248077] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-08T17:28:44.632612] [DEBUG] [LOCAL ] BANC: Primary data saved (51277 records). [2025-10-08T17:28:44.637961] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-08T17:28:44.638403] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BANC took 44.8s. Estimated remaining: 4h 47m 36s. Rate: 7.5 symbols/min [2025-10-08T17:28:44.763823] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-08T17:28:44.883809] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-08T17:28:44.952627] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:44.977913] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-08T17:28:44.977280] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:45.018749] [DEBUG] [LOCAL ] BBAR: Loaded 41683 existing records from primary storage. [2025-10-08T17:28:45.019093] [INFO ] [MAIN ] BBAR: Loaded 41683 existing records. [2025-10-08T17:28:45.201681] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:45.202079] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-08T17:28:45.202126] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-08T17:28:45.219334] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-08T17:28:45.224587] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-08T17:28:45.361918] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-08T17:28:45.619500] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-08T17:28:45.640723] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:46.417591] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-08T17:28:46.982869] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-08T17:28:47.217555] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-08T17:28:47.338719] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T17:28:47.463531] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-08T17:28:47.696213] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T17:28:48.017693] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-08T17:28:48.817590] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-08T17:28:49.019897] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:28:49.617609] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-08T17:28:49.761231] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T17:28:50.417722] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-08T17:28:51.224766] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-08T17:28:51.230422] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-08T17:28:51.370759] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:28:52.017628] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-08T17:28:52.435533] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T17:28:52.483492] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:28:52.817604] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-08T17:28:53.617618] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-08T17:28:54.264337] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-08T17:28:54.305013] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T17:28:54.417545] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-08T17:28:55.130873] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:28:55.217519] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-08T17:28:55.552176] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:28:56.017574] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-08T17:28:56.817509] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-08T17:28:57.223522] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T17:28:57.346285] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T17:28:57.617597] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-08T17:28:58.417508] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-08T17:28:58.602384] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T17:28:59.217590] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-08T17:28:59.796090] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T17:28:59.923141] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-08T17:29:00.017562] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-08T17:29:00.817561] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-08T17:29:01.206162] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-08T17:29:01.617590] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-08T17:29:02.425310] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-08T17:29:02.449207] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-08T17:29:02.527272] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:29:03.072427] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T17:29:03.217596] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-08T17:29:04.017580] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-08T17:29:04.252458] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T17:29:04.600809] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T17:29:04.817627] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-08T17:29:05.617583] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-08T17:29:06.180310] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T17:29:06.417513] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-08T17:29:06.536703] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-08T17:29:07.068252] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T17:29:07.217550] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-08T17:29:08.017566] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-08T17:29:08.098100] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T17:29:08.543974] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:29:08.548183] [INFO ] [REMOTE ] BAX: Full fetch complete (77441 records). [2025-10-08T17:29:08.548334] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-08T17:29:08.825926] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-08T17:29:08.950494] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-08T17:29:08.950581] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-08T17:29:08.951370] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-08T17:29:08.951434] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-08T17:29:08.953050] [DEBUG] [LOCAL ] BAX: Trimmed 77441 records to 53504 (keeping 200 days of data) [2025-10-08T17:29:09.286540] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:29:09.313394] [DEBUG] [LOCAL ] BAX: Primary data saved (53504 records). [2025-10-08T17:29:09.313517] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-08T17:29:09.313610] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 32.5s. Estimated remaining: 4h 50m 14s. Rate: 7.4 symbols/min [2025-10-08T17:29:09.483956] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:09.533153] [DEBUG] [LOCAL ] BBD: Loaded 53239 existing records from primary storage. [2025-10-08T17:29:09.533478] [INFO ] [MAIN ] BBD: Loaded 53239 existing records. [2025-10-08T17:29:09.627588] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-08T17:29:09.708411] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:09.708627] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-08T17:29:09.708707] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-08T17:29:09.708996] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-08T17:29:09.709059] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-08T17:29:10.055854] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:10.417583] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-08T17:29:11.217545] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-08T17:29:11.687151] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T17:29:11.787080] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-10-08T17:29:12.017540] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-08T17:29:12.104351] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:29:12.711022] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T17:29:12.817526] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-08T17:29:13.617545] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-08T17:29:13.989306] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T17:29:13.994089] [INFO ] [REMOTE ] BB: Full fetch complete (76990 records). [2025-10-08T17:29:13.994276] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-08T17:29:14.259423] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:29:14.307441] [INFO ] [REMOTE ] BBAR: Full fetch complete (60999 records). [2025-10-08T17:29:14.324817] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-08T17:29:14.426220] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-08T17:29:14.639892] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-08T17:29:14.645192] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-08T17:29:14.646327] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-08T17:29:14.706622] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-08T17:29:14.772438] [DEBUG] [LOCAL ] BB: Trimmed 76990 records to 52939 (keeping 200 days of data) [2025-10-08T17:29:14.925682] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-08T17:29:14.926218] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-08T17:29:14.927144] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-08T17:29:14.927483] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-08T17:29:14.934613] [DEBUG] [LOCAL ] BBAR: Trimmed 60999 records to 41817 (keeping 200 days of data) [2025-10-08T17:29:15.412353] [DEBUG] [LOCAL ] BB: Primary data saved (52939 records). [2025-10-08T17:29:15.415145] [INFO ] [MAIN ] BB: Full history saved. [2025-10-08T17:29:15.420708] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 37.2s. Estimated remaining: 4h 49m 47s. Rate: 7.4 symbols/min [2025-10-08T17:29:15.525239] [DEBUG] [LOCAL ] BBAR: Primary data saved (41817 records). [2025-10-08T17:29:15.528045] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-08T17:29:15.533637] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 30.9s. Estimated remaining: 4h 48m 20s. Rate: 7.5 symbols/min [2025-10-08T17:29:15.700041] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:15.771073] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:15.792461] [DEBUG] [LOCAL ] BBDO: Loaded 4997 existing records from primary storage. [2025-10-08T17:29:15.792964] [INFO ] [MAIN ] BBDO: Loaded 4997 existing records. [2025-10-08T17:29:15.922040] [DEBUG] [LOCAL ] BBDC: Loaded 32890 existing records from primary storage. [2025-10-08T17:29:15.957806] [INFO ] [MAIN ] BBDC: Loaded 32890 existing records. [2025-10-08T17:29:15.985896] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:16.006976] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-08T17:29:16.029469] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-08T17:29:16.066972] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-08T17:29:16.093673] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-08T17:29:16.264696] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:16.280340] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-08T17:29:16.280669] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-08T17:29:16.320001] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-08T17:29:16.341031] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-08T17:29:16.750552] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:16.754101] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-08T17:29:16.753826] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-08T17:29:16.863891] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-08T17:29:16.911775] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.29 seconds). [2025-10-08T17:29:16.933819] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-08T17:29:17.006056] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:17.600298] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T17:29:17.617536] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-08T17:29:18.417629] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-08T17:29:18.598322] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T17:29:18.822577] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-08T17:29:18.888861] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:29:19.133794] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-08T17:29:19.217521] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-08T17:29:20.017557] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-08T17:29:20.484035] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T17:29:20.817560] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-08T17:29:20.927018] [DEBUG] [REMOTE ] BBDO: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-08T17:29:20.940487] [WARN ] [REMOTE ] BBDO: No data returned for month 2025-03 [2025-10-08T17:29:20.942991] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T17:29:20.943263] [FATAL] [REMOTE ] BBDO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:29:20.955314] [FATAL] [MAIN ] BBDO: Failed to fetch primary data. [2025-10-08T17:29:20.956030] [WARN ] [MAIN ] BBDO: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:29:20.956527] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-08T17:29:20.956635] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-08T17:29:20.956737] [INFO ] [LOCAL ] BBDO: Starting deletion of derivative data. [2025-10-08T17:29:20.957072] [DEBUG] [LOCAL ] BBDO: Deleted derivative data file. [2025-10-08T17:29:20.957189] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBDO took 5.4s. Estimated remaining: 4h 47m 46s. Rate: 7.5 symbols/min [2025-10-08T17:29:21.153505] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:21.153758] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-08T17:29:21.153804] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-08T17:29:21.153916] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-08T17:29:21.153958] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-08T17:29:21.154003] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-08T17:29:21.154035] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-08T17:29:21.499459] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:21.617512] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-08T17:29:22.417638] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-08T17:29:22.869471] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T17:29:23.217547] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-08T17:29:23.272739] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:29:24.017554] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-08T17:29:24.817554] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-08T17:29:25.617533] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-08T17:29:25.635122] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T17:29:25.901444] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T17:29:26.012966] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-08T17:29:26.417562] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-08T17:29:26.554324] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T17:29:27.217551] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-08T17:29:28.017569] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-08T17:29:28.690455] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:29:28.778542] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T17:29:28.817685] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-08T17:29:29.129833] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-08T17:29:29.133884] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-08T17:29:29.133996] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-08T17:29:29.585799] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-08T17:29:29.585902] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-08T17:29:29.586827] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-08T17:29:29.586896] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-08T17:29:29.588524] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-08T17:29:29.638435] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-08T17:29:29.685675] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T17:29:29.934012] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-08T17:29:29.934169] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-08T17:29:29.934259] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBAI took 46.3s. Estimated remaining: 4h 47m 48s. Rate: 7.5 symbols/min [2025-10-08T17:29:30.101386] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:30.101594] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-08T17:29:30.101631] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-08T17:29:30.101770] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-08T17:29:30.101811] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-08T17:29:30.101851] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-08T17:29:30.101885] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-08T17:29:30.422736] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-08T17:29:30.480391] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:31.193731] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:29:31.217493] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-08T17:29:31.340453] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T17:29:32.017555] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-08T17:29:32.817551] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-08T17:29:32.974445] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T17:29:33.243437] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:29:33.617532] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-08T17:29:33.899524] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T17:29:34.417558] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-08T17:29:34.961698] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T17:29:35.217534] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-08T17:29:35.884575] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T17:29:36.017533] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-08T17:29:36.450167] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:29:36.468514] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-08T17:29:36.470092] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T17:29:36.480935] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:29:36.481389] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-08T17:29:36.481566] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:29:36.481670] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-08T17:29:36.481760] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-08T17:29:36.482115] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-08T17:29:36.482172] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-08T17:29:36.482220] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBT took 6.5s. Estimated remaining: 4h 47m 25s. Rate: 7.5 symbols/min [2025-10-08T17:29:36.650421] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:36.657265] [DEBUG] [LOCAL ] BBU: Loaded 5038 existing records from primary storage. [2025-10-08T17:29:36.657555] [INFO ] [MAIN ] BBU: Loaded 5038 existing records. [2025-10-08T17:29:36.828394] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-08T17:29:36.833450] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:36.833694] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-08T17:29:36.833769] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-08T17:29:36.834586] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-08T17:29:36.834688] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-08T17:29:37.197079] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:37.617550] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-08T17:29:38.289121] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T17:29:38.417549] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-08T17:29:39.189068] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T17:29:39.217540] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-08T17:29:39.611798] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T17:29:40.017549] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-08T17:29:40.817575] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-08T17:29:40.901317] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T17:29:41.236744] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-08T17:29:41.312902] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T17:29:41.617574] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-08T17:29:42.417580] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-08T17:29:42.710195] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:29:43.217552] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-08T17:29:44.017591] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-08T17:29:44.132516] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T17:29:44.136697] [INFO ] [REMOTE ] BBD: Full fetch complete (77112 records). [2025-10-08T17:29:44.136879] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-08T17:29:44.467139] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:29:44.595559] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-08T17:29:44.595684] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-08T17:29:44.596622] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-08T17:29:44.596718] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-08T17:29:44.598558] [DEBUG] [LOCAL ] BBD: Trimmed 77112 records to 53245 (keeping 200 days of data) [2025-10-08T17:29:44.824372] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-08T17:29:44.997663] [DEBUG] [LOCAL ] BBD: Primary data saved (53245 records). [2025-10-08T17:29:44.998126] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-08T17:29:44.998235] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBD took 35.7s. Estimated remaining: 4h 47m 22s. Rate: 7.5 symbols/min [2025-10-08T17:29:45.246910] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:45.266935] [DEBUG] [LOCAL ] BBUC: Loaded 13427 existing records from primary storage. [2025-10-08T17:29:45.267233] [INFO ] [MAIN ] BBUC: Loaded 13427 existing records. [2025-10-08T17:29:45.449757] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T17:29:45.512461] [INFO ] [REMOTE ] BBDC: Full fetch complete (48555 records). [2025-10-08T17:29:45.520219] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-08T17:29:45.545685] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:45.552616] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-08T17:29:45.582231] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-08T17:29:45.619689] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-08T17:29:45.614168] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-08T17:29:45.670852] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-08T17:29:46.103359] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T17:29:46.221200] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T17:29:46.383149] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-08T17:29:46.397218] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-08T17:29:46.413499] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-08T17:29:46.418161] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:46.418318] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-08T17:29:46.418265] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-08T17:29:46.420383] [DEBUG] [LOCAL ] BBDC: Trimmed 48555 records to 33016 (keeping 200 days of data) [2025-10-08T17:29:46.613159] [DEBUG] [LOCAL ] BBDC: Primary data saved (33016 records). [2025-10-08T17:29:46.613302] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-08T17:29:46.613388] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDC took 31.2s. Estimated remaining: 4h 46m 12s. Rate: 7.5 symbols/min [2025-10-08T17:29:46.788787] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:46.834722] [DEBUG] [LOCAL ] BBVA: Loaded 49183 existing records from primary storage. [2025-10-08T17:29:46.835052] [INFO ] [MAIN ] BBVA: Loaded 49183 existing records. [2025-10-08T17:29:47.010343] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:47.010544] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-08T17:29:47.010600] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-08T17:29:47.012051] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-08T17:29:47.012112] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-08T17:29:47.223135] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-08T17:29:47.381560] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:47.453713] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T17:29:47.970592] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T17:29:48.017517] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-08T17:29:48.817568] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-08T17:29:48.928157] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T17:29:48.929793] [INFO ] [REMOTE ] BBN: Full fetch complete (26200 records). [2025-10-08T17:29:48.929915] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-08T17:29:49.306280] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-08T17:29:49.306374] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-08T17:29:49.306803] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-08T17:29:49.306866] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-08T17:29:49.307750] [DEBUG] [LOCAL ] BBN: Trimmed 26200 records to 18059 (keeping 200 days of data) [2025-10-08T17:29:49.421361] [DEBUG] [LOCAL ] BBN: Primary data saved (18059 records). [2025-10-08T17:29:49.421505] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-08T17:29:49.421583] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBN took 28.5s. Estimated remaining: 4h 45m 15s. Rate: 7.5 symbols/min [2025-10-08T17:29:49.602237] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:49.617543] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-08T17:29:49.629921] [DEBUG] [LOCAL ] BBW: Loaded 27006 existing records from primary storage. [2025-10-08T17:29:49.630203] [INFO ] [MAIN ] BBW: Loaded 27006 existing records. [2025-10-08T17:29:49.753833] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T17:29:49.822595] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:49.822821] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-08T17:29:49.822869] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-08T17:29:49.823788] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-08T17:29:49.823852] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-08T17:29:50.184725] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:50.417551] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-08T17:29:51.217556] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-08T17:29:51.543400] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T17:29:51.685768] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:29:51.700568] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T17:29:52.017593] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-08T17:29:52.817554] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-08T17:29:52.935399] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-08T17:29:53.617518] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-08T17:29:53.757628] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T17:29:54.417569] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-08T17:29:55.191340] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T17:29:55.217507] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-08T17:29:55.336818] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T17:29:55.885699] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T17:29:56.017571] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-08T17:29:56.817517] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-08T17:29:56.894527] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T17:29:57.617551] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-08T17:29:58.080149] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T17:29:58.417589] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-08T17:29:58.738601] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-08T17:29:58.954901] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T17:29:59.217544] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-08T17:29:59.999539] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-08T17:30:00.017578] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-08T17:30:00.817525] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-08T17:30:00.947307] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T17:30:01.617579] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-08T17:30:02.417552] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-08T17:30:02.718279] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T17:30:02.787418] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T17:30:02.920556] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T17:30:03.217628] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-08T17:30:04.017573] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-08T17:30:04.817530] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-08T17:30:04.903933] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:30:05.054945] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T17:30:05.617591] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-08T17:30:06.018517] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:30:06.417591] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-08T17:30:07.217525] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-08T17:30:07.298092] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T17:30:07.366913] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T17:30:08.017520] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-08T17:30:08.212737] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:30:08.621360] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T17:30:08.817516] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-08T17:30:09.617623] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-08T17:30:10.147002] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:30:10.417610] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-08T17:30:10.593020] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T17:30:11.217574] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-08T17:30:11.375873] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T17:30:12.017613] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-08T17:30:12.817542] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-08T17:30:12.891617] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T17:30:12.893956] [INFO ] [REMOTE ] BBUC: Full fetch complete (18465 records). [2025-10-08T17:30:12.894119] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-08T17:30:13.171750] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T17:30:13.312185] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-08T17:30:13.312278] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-08T17:30:13.312627] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-08T17:30:13.312770] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-08T17:30:13.313372] [DEBUG] [LOCAL ] BBUC: Trimmed 18465 records to 13474 (keeping 200 days of data) [2025-10-08T17:30:13.400604] [DEBUG] [LOCAL ] BBUC: Primary data saved (13474 records). [2025-10-08T17:30:13.400760] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-08T17:30:13.400860] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBUC took 28.4s. Estimated remaining: 4h 47m 39s. Rate: 7.5 symbols/min [2025-10-08T17:30:13.569903] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:13.622352] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-08T17:30:13.624170] [DEBUG] [LOCAL ] BBWI: Loaded 53581 existing records from primary storage. [2025-10-08T17:30:13.624545] [INFO ] [MAIN ] BBWI: Loaded 53581 existing records. [2025-10-08T17:30:13.808298] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:13.808581] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-08T17:30:13.808671] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-08T17:30:13.809000] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-08T17:30:13.809059] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-08T17:30:14.168057] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:14.379713] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:30:14.417539] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-08T17:30:15.217509] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-08T17:30:15.457052] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T17:30:16.017609] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-08T17:30:16.604237] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-08T17:30:16.639739] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T17:30:16.817606] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-08T17:30:16.852676] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:30:17.617615] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-08T17:30:18.330376] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T17:30:18.417523] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-08T17:30:18.963085] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T17:30:19.217571] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-08T17:30:19.820867] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T17:30:20.017568] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-08T17:30:20.189974] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T17:30:20.817576] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-08T17:30:21.214342] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T17:30:21.217304] [INFO ] [REMOTE ] BBW: Full fetch complete (39576 records). [2025-10-08T17:30:21.217388] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-08T17:30:21.598579] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-08T17:30:21.604740] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-08T17:30:21.604969] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T17:30:21.607484] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-08T17:30:21.608193] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-08T17:30:21.609094] [DEBUG] [LOCAL ] BBW: Trimmed 39576 records to 27086 (keeping 200 days of data) [2025-10-08T17:30:21.662719] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-08T17:30:21.778896] [DEBUG] [LOCAL ] BBW: Primary data saved (27086 records). [2025-10-08T17:30:21.779084] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-08T17:30:21.779207] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBW took 32.4s. Estimated remaining: 4h 47m 34s. Rate: 7.5 symbols/min [2025-10-08T17:30:21.950783] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:22.006605] [DEBUG] [LOCAL ] BBY: Loaded 53455 existing records from primary storage. [2025-10-08T17:30:22.007013] [INFO ] [MAIN ] BBY: Loaded 53455 existing records. [2025-10-08T17:30:22.186124] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:22.186356] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-08T17:30:22.186404] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-08T17:30:22.186757] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-08T17:30:22.186818] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-08T17:30:22.429896] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-08T17:30:22.572686] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:22.578242] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T17:30:22.580328] [INFO ] [REMOTE ] BBU: Full fetch complete (6999 records). [2025-10-08T17:30:22.580562] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-08T17:30:22.942671] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-08T17:30:22.942761] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-08T17:30:22.942940] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-08T17:30:22.942976] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-08T17:30:22.943363] [DEBUG] [LOCAL ] BBU: Trimmed 6999 records to 5128 (keeping 200 days of data) [2025-10-08T17:30:22.974727] [DEBUG] [LOCAL ] BBU: Primary data saved (5128 records). [2025-10-08T17:30:22.974894] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-08T17:30:22.975019] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBU took 46.5s. Estimated remaining: 4h 46m 22s. Rate: 7.5 symbols/min [2025-10-08T17:30:23.143335] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:23.186346] [DEBUG] [LOCAL ] BC: Loaded 44173 existing records from primary storage. [2025-10-08T17:30:23.186690] [INFO ] [MAIN ] BC: Loaded 44173 existing records. [2025-10-08T17:30:23.222709] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-08T17:30:23.367905] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:23.368111] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-08T17:30:23.368160] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-08T17:30:23.368341] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-08T17:30:23.368381] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-08T17:30:23.732497] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:24.017512] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-08T17:30:24.046093] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T17:30:24.817527] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-08T17:30:25.169493] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T17:30:25.617504] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-08T17:30:25.706139] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:30:26.417603] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-08T17:30:26.537861] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T17:30:26.542453] [INFO ] [REMOTE ] BBVA: Full fetch complete (71598 records). [2025-10-08T17:30:26.542667] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-08T17:30:27.029216] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-08T17:30:27.029353] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-08T17:30:27.030407] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-08T17:30:27.030496] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-08T17:30:27.032714] [DEBUG] [LOCAL ] BBVA: Trimmed 71598 records to 49165 (keeping 200 days of data) [2025-10-08T17:30:27.170087] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:30:27.262486] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-08T17:30:27.399245] [DEBUG] [LOCAL ] BBVA: Primary data saved (49165 records). [2025-10-08T17:30:27.399457] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-08T17:30:27.399579] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBVA took 40.8s. Estimated remaining: 4h 45m 40s. Rate: 7.5 symbols/min [2025-10-08T17:30:27.582373] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:27.619322] [DEBUG] [LOCAL ] BCAT: Loaded 34059 existing records from primary storage. [2025-10-08T17:30:27.619768] [INFO ] [MAIN ] BCAT: Loaded 34059 existing records. [2025-10-08T17:30:27.801501] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:27.801800] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-08T17:30:27.801865] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-08T17:30:27.802114] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-08T17:30:27.802171] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-08T17:30:28.037762] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-08T17:30:28.173812] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:28.207875] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T17:30:28.817558] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-08T17:30:29.127801] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T17:30:29.617612] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-08T17:30:29.689718] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T17:30:30.350174] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:30:30.417557] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-08T17:30:31.217514] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-08T17:30:31.469153] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T17:30:31.729312] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T17:30:32.017550] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-08T17:30:32.164449] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T17:30:32.817555] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-08T17:30:33.617550] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-08T17:30:33.756323] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T17:30:34.259458] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T17:30:34.417530] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-08T17:30:35.217531] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-08T17:30:35.274371] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:30:36.017556] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-08T17:30:36.137457] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T17:30:36.817578] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-08T17:30:36.889003] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T17:30:37.396477] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T17:30:37.617626] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-08T17:30:38.417539] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-08T17:30:38.701561] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T17:30:39.217593] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-08T17:30:39.523030] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T17:30:39.568864] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T17:30:40.017563] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-08T17:30:40.682858] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T17:30:40.817609] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-08T17:30:41.617574] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-08T17:30:41.816428] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T17:30:42.390292] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:30:42.417570] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-08T17:30:43.217576] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-08T17:30:43.358791] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:30:43.806259] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T17:30:44.017573] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-08T17:30:44.594988] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T17:30:44.817562] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-08T17:30:45.183894] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T17:30:45.617554] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-08T17:30:46.153971] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T17:30:46.417600] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-08T17:30:47.057953] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:30:47.064928] [INFO ] [REMOTE ] BBWI: Full fetch complete (77440 records). [2025-10-08T17:30:47.065206] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-08T17:30:47.228702] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-08T17:30:47.508265] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-08T17:30:47.508370] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-08T17:30:47.509217] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-08T17:30:47.509293] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-08T17:30:47.510966] [DEBUG] [LOCAL ] BBWI: Trimmed 77440 records to 53582 (keeping 200 days of data) [2025-10-08T17:30:47.851523] [DEBUG] [LOCAL ] BBWI: Primary data saved (53582 records). [2025-10-08T17:30:47.851734] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-08T17:30:47.851849] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBWI took 34.5s. Estimated remaining: 4h 47m 28s. Rate: 7.5 symbols/min [2025-10-08T17:30:48.021325] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-08T17:30:48.025244] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:48.026264] [DEBUG] [LOCAL ] BCC: No existing data file found in primary storage. [2025-10-08T17:30:48.026333] [WARN ] [MAIN ] BCC: No existing data found, performing full refresh instead. [2025-10-08T17:30:48.026482] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-08T17:30:48.026544] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-08T17:30:48.026592] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-08T17:30:48.026674] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-08T17:30:48.399045] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:48.431159] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-08T17:30:48.610111] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T17:30:48.817557] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-08T17:30:49.272308] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:30:49.617587] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-08T17:30:50.251518] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:30:50.417570] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-08T17:30:51.074244] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T17:30:51.217554] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-08T17:30:51.999574] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T17:30:52.017516] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-08T17:30:52.417312] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T17:30:52.817609] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-08T17:30:53.297636] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:30:53.300805] [INFO ] [REMOTE ] BCAT: Full fetch complete (50031 records). [2025-10-08T17:30:53.300981] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-08T17:30:53.622675] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-08T17:30:53.796035] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-08T17:30:53.796136] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-08T17:30:53.796763] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-08T17:30:53.796832] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-08T17:30:53.798078] [DEBUG] [LOCAL ] BCAT: Trimmed 50031 records to 34116 (keeping 200 days of data) [2025-10-08T17:30:54.023349] [DEBUG] [LOCAL ] BCAT: Primary data saved (34116 records). [2025-10-08T17:30:54.023807] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-08T17:30:54.023973] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BCAT took 26.6s. Estimated remaining: 4h 47m 3s. Rate: 7.5 symbols/min [2025-10-08T17:30:54.206958] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:54.256541] [DEBUG] [LOCAL ] BCE: Loaded 52205 existing records from primary storage. [2025-10-08T17:30:54.256947] [INFO ] [MAIN ] BCE: Loaded 52205 existing records. [2025-10-08T17:30:54.423488] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-08T17:30:54.447351] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:54.462143] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-08T17:30:54.469060] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-08T17:30:54.472027] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-08T17:30:54.472372] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-08T17:30:54.473446] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T17:30:54.859762] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:55.217568] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-08T17:30:55.705574] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:30:55.857215] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-08T17:30:56.017560] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-08T17:30:56.336672] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T17:30:56.339918] [INFO ] [REMOTE ] BC: Full fetch complete (63652 records). [2025-10-08T17:30:56.340045] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-08T17:30:56.734391] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-08T17:30:56.734533] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-08T17:30:56.735264] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-08T17:30:56.735328] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-08T17:30:56.736572] [DEBUG] [LOCAL ] BC: Trimmed 63652 records to 44121 (keeping 200 days of data) [2025-10-08T17:30:56.826404] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-08T17:30:57.007849] [DEBUG] [LOCAL ] BC: Primary data saved (44121 records). [2025-10-08T17:30:57.007992] [INFO ] [MAIN ] BC: Full history saved. [2025-10-08T17:30:57.008078] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 34.0s. Estimated remaining: 4h 46m 8s. Rate: 7.5 symbols/min [2025-10-08T17:30:57.242705] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:57.272561] [DEBUG] [LOCAL ] BCH: Loaded 29740 existing records from primary storage. [2025-10-08T17:30:57.272909] [INFO ] [MAIN ] BCH: Loaded 29740 existing records. [2025-10-08T17:30:57.455688] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:57.456161] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-08T17:30:57.456292] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-08T17:30:57.456543] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-08T17:30:57.456602] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-08T17:30:57.621458] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-08T17:30:57.880022] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:30:57.886134] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:58.417586] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-08T17:30:58.780501] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T17:30:58.858028] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:30:59.217565] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-08T17:30:59.344595] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T17:31:00.017565] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-08T17:31:00.158626] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T17:31:00.804028] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T17:31:00.817488] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-08T17:31:01.617581] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-08T17:31:01.999403] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:31:02.417686] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-08T17:31:03.132630] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:31:03.217634] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-08T17:31:03.481945] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T17:31:04.017559] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-08T17:31:04.817527] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-08T17:31:04.855965] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:31:05.172698] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T17:31:05.617575] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-08T17:31:06.253386] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T17:31:06.417548] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-08T17:31:07.217533] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-08T17:31:07.451366] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T17:31:07.647021] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T17:31:08.017581] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-08T17:31:08.824311] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-08T17:31:08.828050] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T17:31:08.846998] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T17:31:08.852372] [INFO ] [REMOTE ] BBY: Full fetch complete (77230 records). [2025-10-08T17:31:08.852560] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-08T17:31:09.242928] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-08T17:31:09.243020] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-08T17:31:09.243852] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-08T17:31:09.243924] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-08T17:31:09.245449] [DEBUG] [LOCAL ] BBY: Trimmed 77230 records to 53453 (keeping 200 days of data) [2025-10-08T17:31:09.580098] [DEBUG] [LOCAL ] BBY: Primary data saved (53453 records). [2025-10-08T17:31:09.580245] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-08T17:31:09.580329] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BBY took 47.8s. Estimated remaining: 4h 46m 42s. Rate: 7.5 symbols/min [2025-10-08T17:31:09.623551] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-08T17:31:09.757823] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:09.757998] [DEBUG] [LOCAL ] BCO: No existing data file found in primary storage. [2025-10-08T17:31:09.758035] [WARN ] [MAIN ] BCO: No existing data found, performing full refresh instead. [2025-10-08T17:31:09.758154] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-08T17:31:09.758195] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-08T17:31:09.758234] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-10-08T17:31:09.758264] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-08T17:31:10.118569] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:10.134474] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T17:31:10.417608] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-08T17:31:10.864971] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T17:31:11.217612] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-08T17:31:11.666479] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:31:12.017577] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-08T17:31:12.390264] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:31:12.817606] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-08T17:31:13.607484] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:31:13.617490] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-08T17:31:14.417556] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-08T17:31:14.634950] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T17:31:14.686592] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:31:15.217623] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-08T17:31:15.499291] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T17:31:16.017533] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-08T17:31:16.252585] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T17:31:16.817582] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-08T17:31:17.288255] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T17:31:17.617560] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-08T17:31:17.736343] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T17:31:17.738998] [INFO ] [REMOTE ] BCC: Full fetch complete (41002 records). [2025-10-08T17:31:17.739082] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-08T17:31:18.103952] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-08T17:31:18.104032] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-08T17:31:18.104503] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-08T17:31:18.104543] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-08T17:31:18.105424] [DEBUG] [LOCAL ] BCC: Trimmed 41002 records to 28199 (keeping 200 days of data) [2025-10-08T17:31:18.276296] [DEBUG] [LOCAL ] BCC: Primary data saved (28199 records). [2025-10-08T17:31:18.276430] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-08T17:31:18.276504] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 30.4s. Estimated remaining: 4h 46m 40s. Rate: 7.5 symbols/min [2025-10-08T17:31:18.422662] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-08T17:31:18.450790] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:18.450921] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-10-08T17:31:18.450977] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-10-08T17:31:18.451109] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-08T17:31:18.451166] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-08T17:31:18.451215] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-08T17:31:18.451260] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-08T17:31:18.572174] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T17:31:18.590885] [INFO ] [REMOTE ] BCH: Full fetch complete (40728 records). [2025-10-08T17:31:18.601398] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-08T17:31:18.633743] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:31:18.660222] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:31:18.723316] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:31:18.744824] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-08T17:31:18.754965] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-08T17:31:18.755027] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-10-08T17:31:18.771144] [DEBUG] [LOCAL ] BCH: Deleted derivative data file. [2025-10-08T17:31:18.781589] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCH took 21.8s. Estimated remaining: 4h 45m 23s. Rate: 7.5 symbols/min [2025-10-08T17:31:18.912537] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:19.007772] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:19.007989] [DEBUG] [LOCAL ] BCSF: No existing data file found in primary storage. [2025-10-08T17:31:19.008078] [WARN ] [MAIN ] BCSF: No existing data found, performing full refresh instead. [2025-10-08T17:31:19.008197] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-08T17:31:19.008238] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-08T17:31:19.008279] [DEBUG] [LOCAL ] BCSF: No primary data file found to delete. [2025-10-08T17:31:19.008310] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-08T17:31:19.228953] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-08T17:31:19.400030] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:20.017526] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-08T17:31:20.053531] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:31:20.098586] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T17:31:20.817572] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-08T17:31:21.083036] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T17:31:21.617539] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-08T17:31:21.810923] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T17:31:22.417562] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-08T17:31:23.217592] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-08T17:31:23.432914] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T17:31:24.017526] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-08T17:31:24.139801] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T17:31:24.303790] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T17:31:24.817559] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-08T17:31:25.415119] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:31:25.617557] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-08T17:31:26.417545] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-08T17:31:26.521009] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T17:31:26.628302] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T17:31:27.217559] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-08T17:31:27.950775] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:31:28.017548] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-08T17:31:28.175479] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T17:31:28.817568] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-08T17:31:29.335540] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T17:31:29.617550] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-08T17:31:30.417691] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-08T17:31:30.619406] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T17:31:30.625448] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T17:31:31.217611] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-08T17:31:32.017538] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-08T17:31:32.102460] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:31:32.153607] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T17:31:32.817560] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-08T17:31:33.617582] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-08T17:31:33.931305] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T17:31:34.417590] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-08T17:31:34.573846] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T17:31:34.737438] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T17:31:35.217549] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-08T17:31:35.471376] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T17:31:36.017565] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-08T17:31:36.813705] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T17:31:36.818430] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-08T17:31:36.984897] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T17:31:37.617553] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-08T17:31:37.965272] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T17:31:38.417551] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-08T17:31:39.217549] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-08T17:31:39.702369] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T17:31:39.908075] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T17:31:40.017537] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-08T17:31:40.381237] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:31:40.817565] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-08T17:31:41.617510] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-08T17:31:41.923368] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T17:31:42.073617] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T17:31:42.417515] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-08T17:31:42.552549] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T17:31:42.554688] [INFO ] [REMOTE ] BCO: Full fetch complete (36480 records). [2025-10-08T17:31:42.554787] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-08T17:31:43.010915] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-08T17:31:43.010998] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-08T17:31:43.011464] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-08T17:31:43.011529] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-08T17:31:43.012561] [DEBUG] [LOCAL ] BCO: Trimmed 36480 records to 25786 (keeping 200 days of data) [2025-10-08T17:31:43.177188] [DEBUG] [LOCAL ] BCO: Primary data saved (25786 records). [2025-10-08T17:31:43.177326] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-08T17:31:43.177399] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCO took 33.6s. Estimated remaining: 4h 47m 44s. Rate: 7.4 symbols/min [2025-10-08T17:31:43.222790] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-08T17:31:43.347259] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:43.347451] [DEBUG] [LOCAL ] BCX: No existing data file found in primary storage. [2025-10-08T17:31:43.347488] [WARN ] [MAIN ] BCX: No existing data found, performing full refresh instead. [2025-10-08T17:31:43.347626] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-08T17:31:43.347754] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-08T17:31:43.347817] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-08T17:31:43.347853] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-08T17:31:43.691873] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:44.017578] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-08T17:31:44.194636] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T17:31:44.817531] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-08T17:31:44.907005] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:31:44.910898] [INFO ] [REMOTE ] BCE: Full fetch complete (75956 records). [2025-10-08T17:31:44.911017] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-08T17:31:45.308413] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-08T17:31:45.308608] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-08T17:31:45.309483] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-08T17:31:45.309540] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-08T17:31:45.311093] [DEBUG] [LOCAL ] BCE: Trimmed 75956 records to 52209 (keeping 200 days of data) [2025-10-08T17:31:45.560776] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:31:45.630971] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-08T17:31:45.673823] [DEBUG] [LOCAL ] BCE: Primary data saved (52209 records). [2025-10-08T17:31:45.673970] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-08T17:31:45.674056] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCE took 51.6s. Estimated remaining: 4h 46m 45s. Rate: 7.4 symbols/min [2025-10-08T17:31:45.839680] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:45.866021] [DEBUG] [LOCAL ] BDC: Loaded 24590 existing records from primary storage. [2025-10-08T17:31:45.866279] [INFO ] [MAIN ] BDC: Loaded 24590 existing records. [2025-10-08T17:31:46.046704] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:31:46.047139] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-08T17:31:46.047332] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-08T17:31:46.047737] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-08T17:31:46.047799] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-08T17:31:46.252207] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:31:46.425237] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-08T17:31:46.449662] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:47.034799] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T17:31:47.217587] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-08T17:31:48.017499] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-08T17:31:48.374419] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T17:31:48.433625] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:31:48.817531] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-08T17:31:49.006363] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T17:31:49.617598] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-08T17:31:50.417512] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-08T17:31:50.794337] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T17:31:50.819304] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T17:31:51.217602] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-08T17:31:51.391132] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T17:31:52.017516] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-08T17:31:52.484562] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T17:31:52.817618] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-08T17:31:53.197148] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:31:53.199936] [INFO ] [REMOTE ] BCSF: Full fetch complete (38843 records). [2025-10-08T17:31:53.200023] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-08T17:31:53.584359] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-08T17:31:53.584444] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-08T17:31:53.585000] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-08T17:31:53.585065] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-08T17:31:53.586178] [DEBUG] [LOCAL ] BCSF: Trimmed 38843 records to 27944 (keeping 200 days of data) [2025-10-08T17:31:53.641525] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-08T17:31:53.767740] [DEBUG] [LOCAL ] BCSF: Primary data saved (27944 records). [2025-10-08T17:31:53.767878] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-08T17:31:53.767955] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 35.0s. Estimated remaining: 4h 46m 38s. Rate: 7.4 symbols/min [2025-10-08T17:31:53.789750] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T17:31:54.417569] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-08T17:31:55.217722] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-08T17:31:55.414611] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T17:31:55.572502] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T17:31:55.975591] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T17:31:56.017616] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-08T17:31:56.817617] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-08T17:31:57.358354] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:31:57.617552] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-08T17:31:58.417611] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-08T17:31:58.616370] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T17:31:58.620669] [INFO ] [REMOTE ] BCS: Full fetch complete (77329 records). [2025-10-08T17:31:58.620820] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-08T17:31:59.018734] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:31:59.050239] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-08T17:31:59.050767] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-08T17:31:59.051573] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-08T17:31:59.051617] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-08T17:31:59.053017] [DEBUG] [LOCAL ] BCS: Trimmed 77329 records to 53444 (keeping 200 days of data) [2025-10-08T17:31:59.234981] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-08T17:31:59.394972] [DEBUG] [LOCAL ] BCS: Primary data saved (53444 records). [2025-10-08T17:31:59.395132] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-08T17:31:59.395231] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCS took 41.1s. Estimated remaining: 4h 46m 8s. Rate: 7.5 symbols/min [2025-10-08T17:31:59.470762] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:32:00.017609] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-08T17:32:00.487680] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T17:32:00.817602] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-08T17:32:00.945844] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T17:32:01.617579] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-08T17:32:02.023882] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T17:32:02.410790] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T17:32:02.417593] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-08T17:32:03.217545] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-08T17:32:03.260581] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T17:32:04.017622] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-08T17:32:04.436490] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T17:32:04.817633] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-08T17:32:05.081063] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:32:05.083322] [INFO ] [REMOTE ] BCX: Full fetch complete (33701 records). [2025-10-08T17:32:05.083431] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-08T17:32:05.513710] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-08T17:32:05.513821] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-08T17:32:05.514305] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-08T17:32:05.514366] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-08T17:32:05.515303] [DEBUG] [LOCAL ] BCX: Trimmed 33701 records to 21636 (keeping 200 days of data) [2025-10-08T17:32:05.658710] [DEBUG] [LOCAL ] BCX: Primary data saved (21636 records). [2025-10-08T17:32:05.658901] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-08T17:32:05.659011] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCX took 22.5s. Estimated remaining: 4h 45m 44s. Rate: 7.5 symbols/min [2025-10-08T17:32:05.843923] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T17:32:05.850072] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-08T17:32:06.731156] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T17:32:06.736677] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-08T17:32:07.702852] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T17:32:07.704998] [INFO ] [REMOTE ] BDC: Full fetch complete (35933 records). [2025-10-08T17:32:07.705084] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-08T17:32:08.072564] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-08T17:32:08.072667] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-08T17:32:08.073141] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-08T17:32:08.073183] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-08T17:32:08.074076] [DEBUG] [LOCAL ] BDC: Trimmed 35933 records to 24540 (keeping 200 days of data) [2025-10-08T17:32:08.228262] [DEBUG] [LOCAL ] BDC: Primary data saved (24540 records). [2025-10-08T17:32:08.228400] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-08T17:32:08.228506] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 22.6s. Estimated remaining: 4h 44m 47s. Rate: 7.5 symbols/min [2025-10-08T17:32:08.816941] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:08.907132] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:08.950790] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:08.998152] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:09.033482] [DEBUG] [LOCAL ] BDJ: Loaded 29018 existing records from primary storage. [2025-10-08T17:32:09.034283] [INFO ] [MAIN ] BDJ: Loaded 29018 existing records. [2025-10-08T17:32:09.212512] [DEBUG] [LOCAL ] BDX: Loaded 52271 existing records from primary storage. [2025-10-08T17:32:09.268751] [INFO ] [MAIN ] BDX: Loaded 52271 existing records. [2025-10-08T17:32:09.362864] [DEBUG] [LOCAL ] BDN: Loaded 47541 existing records from primary storage. [2025-10-08T17:32:09.383466] [DEBUG] [LOCAL ] BE: Loaded 53659 existing records from primary storage. [2025-10-08T17:32:09.400281] [INFO ] [MAIN ] BDN: Loaded 47541 existing records. [2025-10-08T17:32:09.405729] [INFO ] [MAIN ] BE: Loaded 53659 existing records. [2025-10-08T17:32:09.389438] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:09.411309] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-08T17:32:09.500839] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-08T17:32:09.634413] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-08T17:32:09.715779] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-08T17:32:09.826020] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:09.922822] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-08T17:32:09.972298] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-08T17:32:10.007447] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:10.049914] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-08T17:32:10.050772] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-08T17:32:10.050856] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-08T17:32:10.061778] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:10.076461] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-08T17:32:10.091561] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-08T17:32:10.127555] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-08T17:32:10.175529] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-08T17:32:10.237829] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-08T17:32:10.202289] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-08T17:32:10.272951] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-08T17:32:11.033364] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:11.129404] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-08T17:32:11.279079] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:11.328205] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-08T17:32:11.457696] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:11.476268] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-08T17:32:11.503766] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:11.504326] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-08T17:32:12.785349] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T17:32:12.796014] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-08T17:32:12.886730] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:32:12.897634] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-08T17:32:12.960089] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T17:32:12.971608] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-08T17:32:13.209746] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T17:32:13.221466] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-08T17:32:14.255492] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T17:32:14.264578] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-08T17:32:14.625000] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:32:14.635284] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-08T17:32:14.727433] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T17:32:14.851735] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:32:15.217549] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-08T17:32:15.428511] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:32:15.780708] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T17:32:16.017617] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-08T17:32:16.438149] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T17:32:16.817547] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-08T17:32:17.149338] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:32:17.617577] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-08T17:32:18.417520] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-08T17:32:18.549259] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T17:32:19.217572] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-08T17:32:19.258768] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T17:32:19.652144] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:32:20.017556] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-08T17:32:20.817577] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-08T17:32:21.152474] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T17:32:21.187779] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T17:32:21.617561] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-08T17:32:22.261401] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T17:32:22.417586] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-08T17:32:22.502690] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:32:23.217565] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-08T17:32:24.017527] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-08T17:32:24.336523] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T17:32:24.618533] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:32:24.817571] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-08T17:32:25.617586] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-08T17:32:25.714945] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:32:26.417538] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-08T17:32:26.481813] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T17:32:27.217536] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-08T17:32:27.701084] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-08T17:32:28.017528] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-08T17:32:28.068956] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T17:32:28.817543] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-08T17:32:29.011479] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:32:29.617589] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-08T17:32:29.762944] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T17:32:30.039723] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T17:32:30.417617] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-08T17:32:31.225239] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-08T17:32:31.231206] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T17:32:31.474289] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T17:32:32.017563] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-08T17:32:32.817567] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-08T17:32:32.963197] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T17:32:33.617542] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-08T17:32:33.912568] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-08T17:32:34.027188] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T17:32:34.417569] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-08T17:32:35.038307] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T17:32:35.217510] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-08T17:32:35.494980] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T17:32:35.497480] [INFO ] [REMOTE ] BDJ: Full fetch complete (42996 records). [2025-10-08T17:32:35.497623] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-08T17:32:35.892050] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-08T17:32:35.892148] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-08T17:32:35.892706] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-08T17:32:35.892770] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-08T17:32:35.893883] [DEBUG] [LOCAL ] BDJ: Trimmed 42996 records to 29178 (keeping 200 days of data) [2025-10-08T17:32:36.036725] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-08T17:32:36.074485] [DEBUG] [LOCAL ] BDJ: Primary data saved (29178 records). [2025-10-08T17:32:36.074674] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-08T17:32:36.074808] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 27.8s. Estimated remaining: 4h 47m 34s. Rate: 7.4 symbols/min [2025-10-08T17:32:36.240755] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:36.240955] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-08T17:32:36.240993] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-08T17:32:36.241102] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-08T17:32:36.241142] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-08T17:32:36.241182] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-08T17:32:36.241214] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-08T17:32:36.592336] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:36.817597] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-08T17:32:37.600456] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-08T17:32:37.617507] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-08T17:32:38.072396] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T17:32:38.326399] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T17:32:38.417550] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-08T17:32:39.218538] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-08T17:32:39.786811] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T17:32:39.792717] [INFO ] [REMOTE ] BDN: Full fetch complete (69255 records). [2025-10-08T17:32:39.792921] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-08T17:32:39.916373] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T17:32:40.024624] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-08T17:32:40.149997] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-08T17:32:40.259106] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-08T17:32:40.259247] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-08T17:32:40.260059] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-08T17:32:40.260163] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-08T17:32:40.261726] [DEBUG] [LOCAL ] BDN: Trimmed 69255 records to 47560 (keeping 200 days of data) [2025-10-08T17:32:40.538241] [DEBUG] [LOCAL ] BDN: Primary data saved (47560 records). [2025-10-08T17:32:40.538376] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-08T17:32:40.538497] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 32.3s. Estimated remaining: 4h 46m 54s. Rate: 7.4 symbols/min [2025-10-08T17:32:40.705586] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:40.757488] [DEBUG] [LOCAL ] BEKE: Loaded 53231 existing records from primary storage. [2025-10-08T17:32:40.757879] [INFO ] [MAIN ] BEKE: Loaded 53231 existing records. [2025-10-08T17:32:40.822963] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-08T17:32:40.935667] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:40.935871] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-08T17:32:40.935917] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-08T17:32:40.936125] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-08T17:32:40.936183] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-08T17:32:41.289077] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:41.570144] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T17:32:41.617595] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-08T17:32:42.417567] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-08T17:32:42.702619] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-08T17:32:43.217564] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-08T17:32:43.280352] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T17:32:43.303018] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-08T17:32:43.307537] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-08T17:32:43.307777] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-08T17:32:43.603923] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-08T17:32:43.733013] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-08T17:32:43.733140] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-08T17:32:43.734086] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-08T17:32:43.734153] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-08T17:32:43.735970] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53659 (keeping 200 days of data) [2025-10-08T17:32:44.032333] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-08T17:32:44.058072] [DEBUG] [LOCAL ] BE: Primary data saved (53659 records). [2025-10-08T17:32:44.058169] [INFO ] [MAIN ] BE: Full history saved. [2025-10-08T17:32:44.059071] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BE took 35.8s. Estimated remaining: 4h 46m 6s. Rate: 7.4 symbols/min [2025-10-08T17:32:44.227964] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:44.279300] [DEBUG] [LOCAL ] BEN: Loaded 53046 existing records from primary storage. [2025-10-08T17:32:44.279638] [INFO ] [MAIN ] BEN: Loaded 53046 existing records. [2025-10-08T17:32:44.442706] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T17:32:44.462191] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:44.463598] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-08T17:32:44.463687] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-08T17:32:44.463995] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-08T17:32:44.464051] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-08T17:32:44.817839] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-08T17:32:44.817719] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:45.617600] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-08T17:32:46.417535] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-08T17:32:46.494451] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:32:46.498919] [INFO ] [REMOTE ] BDX: Full fetch complete (75600 records). [2025-10-08T17:32:46.499125] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-08T17:32:46.801953] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-08T17:32:46.927252] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-08T17:32:46.927372] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-08T17:32:46.928522] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-08T17:32:46.928600] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-08T17:32:46.930683] [DEBUG] [LOCAL ] BDX: Trimmed 75600 records to 52250 (keeping 200 days of data) [2025-10-08T17:32:47.217615] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-08T17:32:47.305445] [DEBUG] [LOCAL ] BDX: Primary data saved (52250 records). [2025-10-08T17:32:47.305722] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-08T17:32:47.307337] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDX took 39.1s. Estimated remaining: 4h 45m 16s. Rate: 7.5 symbols/min [2025-10-08T17:32:47.520077] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:47.582278] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-08T17:32:47.586717] [DEBUG] [LOCAL ] BEP: Loaded 38827 existing records from primary storage. [2025-10-08T17:32:47.587356] [INFO ] [MAIN ] BEP: Loaded 38827 existing records. [2025-10-08T17:32:47.833828] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-08T17:32:47.859741] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:47.872913] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-08T17:32:47.873046] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-08T17:32:47.873384] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-08T17:32:47.873446] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-08T17:32:48.022739] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-08T17:32:48.327375] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:48.395497] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-08T17:32:48.817566] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-08T17:32:49.056459] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-08T17:32:49.617599] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-08T17:32:49.913998] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-08T17:32:50.417547] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-08T17:32:50.803090] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-08T17:32:51.217572] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-08T17:32:52.017581] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-08T17:32:52.631443] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T17:32:52.632319] [INFO ] [REMOTE ] BEDU: Full fetch complete (1403 records). [2025-10-08T17:32:52.632391] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-08T17:32:52.782196] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:32:52.817622] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-08T17:32:52.846139] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-08T17:32:52.847028] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:32:52.847099] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:32:52.847174] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-08T17:32:52.847234] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-08T17:32:52.847271] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-08T17:32:52.847328] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-08T17:32:52.847419] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 16.8s. Estimated remaining: 4h 44m 46s. Rate: 7.5 symbols/min [2025-10-08T17:32:53.018508] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:53.018803] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-10-08T17:32:53.018859] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-10-08T17:32:53.018974] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-08T17:32:53.019017] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-08T17:32:53.019058] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-08T17:32:53.019089] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-08T17:32:53.366281] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:53.617498] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-08T17:32:54.417594] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-08T17:32:54.746493] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T17:32:55.205456] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:32:55.218806] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-08T17:32:56.017584] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-08T17:32:56.242444] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T17:32:56.505933] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T17:32:56.817697] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-08T17:32:57.615734] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T17:32:57.631154] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-08T17:32:57.865008] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:32:58.417563] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-08T17:32:59.217571] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-08T17:32:59.365532] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:32:59.895771] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T17:33:00.017556] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-08T17:33:00.179556] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:33:00.817563] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-08T17:33:01.617567] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-08T17:33:01.777099] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T17:33:02.317802] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:33:02.417568] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-08T17:33:03.217558] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-08T17:33:03.495120] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T17:33:04.017982] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-08T17:33:04.019633] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T17:33:04.819303] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-08T17:33:04.822899] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T17:33:05.617515] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-08T17:33:05.810858] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:33:06.422665] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-08T17:33:06.444205] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:33:06.820746] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T17:33:07.217556] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-08T17:33:07.780431] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T17:33:08.017563] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-08T17:33:08.737809] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:33:08.817561] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-08T17:33:09.229474] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:33:09.617559] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-08T17:33:09.921751] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:33:10.417551] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-08T17:33:11.217515] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-08T17:33:11.461573] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T17:33:12.005098] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T17:33:12.017494] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-08T17:33:12.817583] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-08T17:33:13.111409] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T17:33:13.402525] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:33:13.617518] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-08T17:33:14.334861] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T17:33:14.417550] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-08T17:33:15.217567] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-08T17:33:15.557744] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T17:33:15.964046] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:33:16.017535] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-08T17:33:16.562049] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:33:16.817570] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-08T17:33:17.259781] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T17:33:17.617565] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-08T17:33:18.417571] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-08T17:33:18.490034] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T17:33:19.028370] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T17:33:19.217549] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-08T17:33:20.017549] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-08T17:33:20.244362] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T17:33:20.817514] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-08T17:33:21.018154] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:33:21.083210] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:33:21.617566] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-08T17:33:22.422658] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-08T17:33:22.439906] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T17:33:22.836082] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:33:23.217550] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-08T17:33:23.320827] [DEBUG] [REMOTE ] BEPC: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-08T17:33:23.321146] [WARN ] [REMOTE ] BEPC: No data returned for month 2025-10 [2025-10-08T17:33:23.321233] [FATAL] [REMOTE ] BEPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:33:23.321340] [FATAL] [MAIN ] BEPC: Failed to fetch primary data. [2025-10-08T17:33:23.321419] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:33:23.321504] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-08T17:33:23.321611] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-08T17:33:23.321707] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-10-08T17:33:23.321798] [DEBUG] [LOCAL ] BEPC: No derivative data file found to delete. [2025-10-08T17:33:23.321900] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEPC took 30.5s. Estimated remaining: 4h 47m 52s. Rate: 7.4 symbols/min [2025-10-08T17:33:23.497039] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:23.505626] [DEBUG] [LOCAL ] BEPH: Loaded 5357 existing records from primary storage. [2025-10-08T17:33:23.505907] [INFO ] [MAIN ] BEPH: Loaded 5357 existing records. [2025-10-08T17:33:23.690527] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:23.690903] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-08T17:33:23.690999] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-08T17:33:23.691264] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-08T17:33:23.691338] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-08T17:33:23.791744] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T17:33:23.819108] [INFO ] [REMOTE ] BEP: Full fetch complete (58643 records). [2025-10-08T17:33:23.834735] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-08T17:33:24.034213] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-08T17:33:24.253856] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:24.493071] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-08T17:33:24.493162] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-08T17:33:24.493784] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-08T17:33:24.493846] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-08T17:33:24.494999] [DEBUG] [LOCAL ] BEP: Trimmed 58643 records to 38922 (keeping 200 days of data) [2025-10-08T17:33:24.728905] [DEBUG] [LOCAL ] BEP: Primary data saved (38922 records). [2025-10-08T17:33:24.729047] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-08T17:33:24.729132] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 37.4s. Estimated remaining: 4h 46m 46s. Rate: 7.4 symbols/min [2025-10-08T17:33:24.825506] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-08T17:33:24.898156] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:24.903975] [DEBUG] [LOCAL ] BEPI: Loaded 3587 existing records from primary storage. [2025-10-08T17:33:24.904125] [INFO ] [MAIN ] BEPI: Loaded 3587 existing records. [2025-10-08T17:33:25.077315] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:25.077560] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-08T17:33:25.077613] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-08T17:33:25.077803] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-08T17:33:25.077860] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-08T17:33:25.428958] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:25.559234] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:33:25.617595] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-08T17:33:25.996271] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T17:33:26.128094] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T17:33:26.417597] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-08T17:33:27.217594] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-08T17:33:27.795226] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T17:33:27.897214] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T17:33:27.902240] [INFO ] [REMOTE ] BEKE: Full fetch complete (77189 records). [2025-10-08T17:33:27.902388] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-08T17:33:28.022748] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-08T17:33:28.329028] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-08T17:33:28.329122] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-08T17:33:28.330003] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-08T17:33:28.330073] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-08T17:33:28.331683] [DEBUG] [LOCAL ] BEKE: Trimmed 77189 records to 53231 (keeping 200 days of data) [2025-10-08T17:33:28.546298] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T17:33:28.663866] [DEBUG] [LOCAL ] BEKE: Primary data saved (53231 records). [2025-10-08T17:33:28.664038] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-08T17:33:28.664143] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEKE took 48.1s. Estimated remaining: 4h 46m 2s. Rate: 7.4 symbols/min [2025-10-08T17:33:28.823587] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-08T17:33:28.846170] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:28.853188] [DEBUG] [LOCAL ] BEPJ: Loaded 3141 existing records from primary storage. [2025-10-08T17:33:28.853381] [INFO ] [MAIN ] BEPJ: Loaded 3141 existing records. [2025-10-08T17:33:29.031928] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:29.032201] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-08T17:33:29.032251] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-08T17:33:29.032420] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-08T17:33:29.032476] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-08T17:33:29.389866] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:29.547217] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T17:33:29.617574] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-08T17:33:30.164413] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T17:33:30.417550] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-08T17:33:31.217634] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-08T17:33:31.689412] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:33:31.698391] [INFO ] [REMOTE ] BEN: Full fetch complete (76522 records). [2025-10-08T17:33:31.699085] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-08T17:33:31.700567] [FATAL] [VALIDATOR ] BEN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:33:31.700748] [FATAL] [MAIN ] BEN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:33:31.700817] [WARN ] [MAIN ] BEN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:33:31.702612] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-08T17:33:31.702768] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-10-08T17:33:31.702840] [INFO ] [LOCAL ] BEN: Starting deletion of derivative data. [2025-10-08T17:33:31.703130] [DEBUG] [LOCAL ] BEN: Deleted derivative data file. [2025-10-08T17:33:31.703426] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEN took 47.6s. Estimated remaining: 4h 45m 11s. Rate: 7.4 symbols/min [2025-10-08T17:33:31.915942] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T17:33:31.949321] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:31.995335] [DEBUG] [LOCAL ] BFAM: Loaded 33486 existing records from primary storage. [2025-10-08T17:33:31.995794] [INFO ] [MAIN ] BFAM: Loaded 33486 existing records. [2025-10-08T17:33:32.022705] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-08T17:33:32.208019] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:32.208270] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-08T17:33:32.208318] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-08T17:33:32.208580] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-08T17:33:32.208639] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-08T17:33:32.564773] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T17:33:32.593865] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:32.817544] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-08T17:33:33.617689] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-08T17:33:34.254697] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:33:34.417554] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-08T17:33:34.929163] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T17:33:34.999792] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T17:33:35.217547] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-08T17:33:35.634581] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T17:33:36.017599] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-08T17:33:36.614369] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T17:33:36.817594] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-08T17:33:37.380046] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T17:33:37.617573] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-08T17:33:38.205110] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T17:33:38.417580] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-08T17:33:38.972697] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T17:33:39.217561] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-08T17:33:39.843892] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T17:33:40.017551] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-08T17:33:40.581406] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T17:33:40.817514] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-08T17:33:41.290781] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T17:33:41.617554] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-08T17:33:42.076115] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-08T17:33:42.417537] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-08T17:33:43.049092] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T17:33:43.217607] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-08T17:33:44.017565] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-08T17:33:44.433482] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T17:33:44.639397] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:33:44.817575] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-08T17:33:45.617551] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-08T17:33:46.154868] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T17:33:46.222194] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T17:33:46.417580] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-08T17:33:46.925146] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-08T17:33:47.217571] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-08T17:33:48.017598] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-08T17:33:48.364167] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T17:33:48.624664] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T17:33:48.817569] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-08T17:33:49.617585] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-08T17:33:49.888424] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T17:33:50.115076] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T17:33:50.417548] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-08T17:33:50.961018] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T17:33:51.217581] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-08T17:33:52.017569] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-08T17:33:52.572527] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T17:33:52.817529] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-08T17:33:52.889199] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:33:53.617560] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-08T17:33:53.962752] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T17:33:54.185661] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T17:33:54.417560] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-08T17:33:55.186325] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T17:33:55.187406] [INFO ] [REMOTE ] BEPH: Full fetch complete (7648 records). [2025-10-08T17:33:55.187478] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-08T17:33:55.222773] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-08T17:33:55.558134] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-08T17:33:55.558216] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-08T17:33:55.558433] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-08T17:33:55.558503] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-08T17:33:55.558951] [DEBUG] [LOCAL ] BEPH: Trimmed 7648 records to 5349 (keeping 200 days of data) [2025-10-08T17:33:55.590889] [DEBUG] [LOCAL ] BEPH: Primary data saved (5349 records). [2025-10-08T17:33:55.590976] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-08T17:33:55.591051] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPH took 32.3s. Estimated remaining: 4h 47m 17s. Rate: 7.4 symbols/min [2025-10-08T17:33:55.766919] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:55.770336] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:33:55.810002] [DEBUG] [LOCAL ] BFH: Loaded 41518 existing records from primary storage. [2025-10-08T17:33:55.810309] [INFO ] [MAIN ] BFH: Loaded 41518 existing records. [2025-10-08T17:33:55.988498] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:55.988729] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-08T17:33:55.988783] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-08T17:33:55.989117] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-08T17:33:55.989175] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-08T17:33:56.022634] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-08T17:33:56.349242] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:56.643281] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T17:33:56.644407] [INFO ] [REMOTE ] BEPI: Full fetch complete (4849 records). [2025-10-08T17:33:56.644502] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-08T17:33:56.818288] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-08T17:33:57.027639] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-08T17:33:57.027753] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-08T17:33:57.027907] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-08T17:33:57.027946] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-08T17:33:57.028329] [DEBUG] [LOCAL ] BEPI: Trimmed 4849 records to 3606 (keeping 200 days of data) [2025-10-08T17:33:57.051306] [DEBUG] [LOCAL ] BEPI: Primary data saved (3606 records). [2025-10-08T17:33:57.051440] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-08T17:33:57.051526] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPI took 32.3s. Estimated remaining: 4h 46m 13s. Rate: 7.4 symbols/min [2025-10-08T17:33:57.226348] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:57.241706] [DEBUG] [LOCAL ] BFK: Loaded 13628 existing records from primary storage. [2025-10-08T17:33:57.241969] [INFO ] [MAIN ] BFK: Loaded 13628 existing records. [2025-10-08T17:33:57.422222] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:57.422456] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-08T17:33:57.422586] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-08T17:33:57.422812] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-08T17:33:57.422872] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-08T17:33:57.624063] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-08T17:33:57.783833] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:58.258721] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:33:58.417572] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-08T17:33:58.714132] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T17:33:58.725307] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-08T17:33:59.217608] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-08T17:34:00.017584] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-08T17:34:00.359549] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T17:34:00.817553] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-08T17:34:01.605234] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:34:01.617499] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-08T17:34:01.757530] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T17:34:02.417548] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-08T17:34:02.836916] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:34:03.217575] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-08T17:34:03.894329] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T17:34:04.017510] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-08T17:34:04.459882] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:34:04.462803] [INFO ] [REMOTE ] BFAM: Full fetch complete (47031 records). [2025-10-08T17:34:04.462926] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-08T17:34:04.819630] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-08T17:34:04.830066] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T17:34:04.872155] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-08T17:34:04.872252] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-08T17:34:04.872877] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-08T17:34:04.872972] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-08T17:34:04.874245] [DEBUG] [LOCAL ] BFAM: Trimmed 47031 records to 33473 (keeping 200 days of data) [2025-10-08T17:34:05.073872] [DEBUG] [LOCAL ] BFAM: Primary data saved (33473 records). [2025-10-08T17:34:05.074021] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-08T17:34:05.074108] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BFAM took 33.4s. Estimated remaining: 4h 46m 4s. Rate: 7.4 symbols/min [2025-10-08T17:34:05.247002] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:05.318989] [DEBUG] [LOCAL ] BFLY: Loaded 51810 existing records from primary storage. [2025-10-08T17:34:05.319328] [INFO ] [MAIN ] BFLY: Loaded 51810 existing records. [2025-10-08T17:34:05.502233] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:05.502839] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-08T17:34:05.502951] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-08T17:34:05.503323] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-08T17:34:05.503383] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-08T17:34:05.622806] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-08T17:34:05.871376] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:06.417549] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-08T17:34:06.439388] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T17:34:06.545207] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T17:34:06.907485] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:34:06.908243] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4471 records). [2025-10-08T17:34:06.908314] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-08T17:34:07.222637] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-08T17:34:07.285175] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-08T17:34:07.285253] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-08T17:34:07.285394] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-08T17:34:07.285430] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-08T17:34:07.285825] [DEBUG] [LOCAL ] BEPJ: Trimmed 4471 records to 3132 (keeping 200 days of data) [2025-10-08T17:34:07.305521] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3132 records). [2025-10-08T17:34:07.305615] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-08T17:34:07.305724] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BEPJ took 38.6s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-10-08T17:34:07.474362] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:07.485201] [DEBUG] [LOCAL ] BFS: Loaded 9327 existing records from primary storage. [2025-10-08T17:34:07.485406] [INFO ] [MAIN ] BFS: Loaded 9327 existing records. [2025-10-08T17:34:07.660729] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:07.660992] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-08T17:34:07.661055] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-08T17:34:07.661255] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-08T17:34:07.661314] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-08T17:34:08.023626] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-08T17:34:08.023541] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:08.786999] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:34:08.817505] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-08T17:34:09.081994] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:34:09.553659] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T17:34:09.617506] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-08T17:34:10.417571] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-08T17:34:11.039600] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T17:34:11.217529] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-08T17:34:11.314676] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T17:34:12.017613] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-08T17:34:12.626697] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T17:34:12.641527] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T17:34:12.817611] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-08T17:34:13.617566] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-08T17:34:14.417515] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-08T17:34:14.479542] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T17:34:14.520354] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:34:15.217549] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-08T17:34:16.017522] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-08T17:34:16.239437] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T17:34:16.275617] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:34:16.817531] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-08T17:34:16.900314] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T17:34:17.617614] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-08T17:34:18.417567] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-08T17:34:18.484682] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T17:34:18.652218] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:34:19.080499] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T17:34:19.217533] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-08T17:34:20.017612] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-08T17:34:20.616427] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:34:20.632583] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T17:34:20.817543] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-08T17:34:21.502620] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:34:21.617518] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-08T17:34:22.417579] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-08T17:34:23.029683] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:34:23.217545] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-08T17:34:23.353295] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:34:23.906447] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:34:24.017584] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-08T17:34:24.786250] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T17:34:24.817502] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-08T17:34:25.511204] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T17:34:25.513002] [INFO ] [REMOTE ] BFS: Full fetch complete (12725 records). [2025-10-08T17:34:25.513074] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-08T17:34:25.513830] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:34:25.513976] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:34:25.514043] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:34:25.514089] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-08T17:34:25.514345] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-08T17:34:25.514410] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-08T17:34:25.515036] [DEBUG] [LOCAL ] BFS: Deleted derivative data file. [2025-10-08T17:34:25.515125] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFS took 18.2s. Estimated remaining: 4h 46m 23s. Rate: 7.4 symbols/min [2025-10-08T17:34:25.622686] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-08T17:34:25.687549] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:25.702913] [DEBUG] [LOCAL ] BFZ: Loaded 11914 existing records from primary storage. [2025-10-08T17:34:25.703596] [INFO ] [MAIN ] BFZ: Loaded 11914 existing records. [2025-10-08T17:34:25.877403] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:25.877606] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-08T17:34:25.877680] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-08T17:34:25.877964] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-08T17:34:25.878021] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-08T17:34:26.235253] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:26.417558] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-08T17:34:27.217544] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-08T17:34:27.290208] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T17:34:27.313253] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T17:34:28.017532] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-08T17:34:28.183966] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T17:34:28.817569] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-08T17:34:29.617613] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-08T17:34:29.678055] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T17:34:29.714631] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T17:34:30.417560] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-08T17:34:31.217610] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-08T17:34:31.262821] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T17:34:31.311477] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T17:34:31.780677] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T17:34:32.017578] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-08T17:34:32.817602] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-08T17:34:33.611702] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T17:34:33.617444] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-08T17:34:33.645236] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T17:34:34.304474] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T17:34:34.417762] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-08T17:34:35.217558] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-08T17:34:35.841417] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T17:34:36.017527] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-08T17:34:36.489589] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-08T17:34:36.817577] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-08T17:34:36.867428] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T17:34:36.868991] [INFO ] [REMOTE ] BFK: Full fetch complete (19105 records). [2025-10-08T17:34:36.869084] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-08T17:34:37.261416] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-08T17:34:37.261501] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-08T17:34:37.261862] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-08T17:34:37.261923] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-08T17:34:37.262515] [DEBUG] [LOCAL ] BFK: Trimmed 19105 records to 13712 (keeping 200 days of data) [2025-10-08T17:34:37.344328] [DEBUG] [LOCAL ] BFK: Primary data saved (13712 records). [2025-10-08T17:34:37.344490] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-08T17:34:37.344577] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFK took 40.3s. Estimated remaining: 4h 46m 46s. Rate: 7.4 symbols/min [2025-10-08T17:34:37.509635] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:37.554841] [DEBUG] [LOCAL ] BG: Loaded 50444 existing records from primary storage. [2025-10-08T17:34:37.555166] [INFO ] [MAIN ] BG: Loaded 50444 existing records. [2025-10-08T17:34:37.627063] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-08T17:34:37.732424] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:37.732679] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-08T17:34:37.732743] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-08T17:34:37.732981] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-08T17:34:37.733040] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-08T17:34:38.083610] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:38.417517] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-08T17:34:38.663746] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T17:34:38.837029] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T17:34:39.217581] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-08T17:34:39.927351] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:34:40.017615] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-08T17:34:40.817562] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-08T17:34:40.864166] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T17:34:41.381716] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T17:34:41.617562] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-08T17:34:42.417524] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-08T17:34:42.464348] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:34:42.564373] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T17:34:43.217594] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-08T17:34:44.017544] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-08T17:34:44.280082] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-08T17:34:44.284246] [INFO ] [REMOTE ] BFLY: Full fetch complete (75302 records). [2025-10-08T17:34:44.284392] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-08T17:34:44.700200] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-08T17:34:44.700380] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-08T17:34:44.701280] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-08T17:34:44.701347] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-08T17:34:44.703103] [DEBUG] [LOCAL ] BFLY: Trimmed 75302 records to 51825 (keeping 200 days of data) [2025-10-08T17:34:44.817537] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-08T17:34:45.014856] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:34:45.021180] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T17:34:45.047409] [DEBUG] [LOCAL ] BFLY: Primary data saved (51825 records). [2025-10-08T17:34:45.047542] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-08T17:34:45.047624] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 40.0s. Estimated remaining: 4h 46m 34s. Rate: 7.4 symbols/min [2025-10-08T17:34:45.213808] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:45.232476] [DEBUG] [LOCAL ] BGB: Loaded 17853 existing records from primary storage. [2025-10-08T17:34:45.232756] [INFO ] [MAIN ] BGB: Loaded 17853 existing records. [2025-10-08T17:34:45.410621] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:45.410928] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-08T17:34:45.410996] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-08T17:34:45.411155] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-08T17:34:45.411193] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-08T17:34:45.622803] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-08T17:34:45.764769] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:46.058030] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:34:46.061202] [INFO ] [REMOTE ] BFH: Full fetch complete (59735 records). [2025-10-08T17:34:46.061294] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-08T17:34:46.424441] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-08T17:34:46.444352] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-08T17:34:46.444436] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-08T17:34:46.445110] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-08T17:34:46.445176] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-08T17:34:46.446461] [DEBUG] [LOCAL ] BFH: Trimmed 59735 records to 41446 (keeping 200 days of data) [2025-10-08T17:34:46.699053] [DEBUG] [LOCAL ] BFH: Primary data saved (41446 records). [2025-10-08T17:34:46.699181] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-08T17:34:46.699272] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFH took 51.1s. Estimated remaining: 4h 45m 33s. Rate: 7.4 symbols/min [2025-10-08T17:34:46.864556] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:46.864760] [DEBUG] [LOCAL ] BGH: No existing data file found in primary storage. [2025-10-08T17:34:46.864804] [WARN ] [MAIN ] BGH: No existing data found, performing full refresh instead. [2025-10-08T17:34:46.864912] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-08T17:34:46.864954] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-08T17:34:46.864999] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-08T17:34:46.865031] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-08T17:34:47.221557] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-08T17:34:47.259145] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:47.356300] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T17:34:47.422768] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:34:48.017502] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-08T17:34:48.406964] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T17:34:48.817514] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-08T17:34:49.005001] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:34:49.511344] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:34:49.617628] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-08T17:34:50.417589] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-08T17:34:50.462902] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T17:34:51.217557] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-08T17:34:52.017527] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-08T17:34:52.215571] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T17:34:52.238225] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:34:52.805604] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:34:52.817489] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-08T17:34:53.617524] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-08T17:34:53.794687] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T17:34:54.417547] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-08T17:34:55.053403] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T17:34:55.217552] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-08T17:34:55.487355] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T17:34:55.915451] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T17:34:56.017576] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-08T17:34:56.817522] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-08T17:34:56.878227] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T17:34:56.879566] [INFO ] [REMOTE ] BFZ: Full fetch complete (17788 records). [2025-10-08T17:34:56.879680] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-08T17:34:57.305664] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-08T17:34:57.305754] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-08T17:34:57.306098] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-08T17:34:57.306160] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-08T17:34:57.306732] [DEBUG] [LOCAL ] BFZ: Trimmed 17788 records to 11932 (keeping 200 days of data) [2025-10-08T17:34:57.388791] [DEBUG] [LOCAL ] BFZ: Primary data saved (11932 records). [2025-10-08T17:34:57.388926] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-08T17:34:57.389032] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 31.9s. Estimated remaining: 4h 45m 46s. Rate: 7.4 symbols/min [2025-10-08T17:34:57.558687] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:57.575229] [DEBUG] [LOCAL ] BGR: Loaded 13482 existing records from primary storage. [2025-10-08T17:34:57.575490] [INFO ] [MAIN ] BGR: Loaded 13482 existing records. [2025-10-08T17:34:57.618608] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-08T17:34:57.757984] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:57.758339] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-08T17:34:57.758394] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-08T17:34:57.758702] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-08T17:34:57.768586] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-08T17:34:57.812287] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T17:34:58.131040] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:58.417560] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-08T17:34:59.143397] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:34:59.217516] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-08T17:34:59.253572] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:35:00.017569] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-08T17:35:00.122056] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T17:35:00.817608] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-08T17:35:01.031470] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T17:35:01.542828] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T17:35:01.617618] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-08T17:35:02.417580] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-08T17:35:02.477985] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T17:35:03.151435] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T17:35:03.217562] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-08T17:35:04.017517] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-08T17:35:04.217806] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:35:04.817572] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-08T17:35:05.617607] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-08T17:35:05.800547] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T17:35:05.870864] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T17:35:06.417589] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-08T17:35:06.652378] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T17:35:07.217553] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-08T17:35:08.017537] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-08T17:35:08.057741] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T17:35:08.103685] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T17:35:08.817611] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-08T17:35:09.256705] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T17:35:09.625070] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-08T17:35:09.627982] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T17:35:10.417549] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-08T17:35:11.217528] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-08T17:35:11.389447] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T17:35:11.428746] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T17:35:12.017577] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-08T17:35:12.259385] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T17:35:12.817549] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-08T17:35:12.935115] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T17:35:13.617528] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-08T17:35:13.781122] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T17:35:14.417056] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:35:14.421038] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-08T17:35:15.217530] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-08T17:35:15.398543] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:35:15.400861] [INFO ] [REMOTE ] BGH: Full fetch complete (22703 records). [2025-10-08T17:35:15.400938] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-08T17:35:15.792577] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-08T17:35:15.792784] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-08T17:35:15.793338] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-08T17:35:15.793428] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-08T17:35:15.794525] [DEBUG] [LOCAL ] BGH: Trimmed 22703 records to 17188 (keeping 200 days of data) [2025-10-08T17:35:15.910492] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T17:35:15.931717] [DEBUG] [LOCAL ] BGH: Primary data saved (17188 records). [2025-10-08T17:35:15.931906] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-08T17:35:15.931991] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 29.2s. Estimated remaining: 4h 47m 3s. Rate: 7.4 symbols/min [2025-10-08T17:35:16.023025] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-08T17:35:16.233768] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:16.296814] [DEBUG] [LOCAL ] BGS: Loaded 50456 existing records from primary storage. [2025-10-08T17:35:16.297312] [INFO ] [MAIN ] BGS: Loaded 50456 existing records. [2025-10-08T17:35:16.588695] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:16.589037] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-08T17:35:16.589113] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-08T17:35:16.589542] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-08T17:35:16.589613] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-08T17:35:16.822993] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-08T17:35:16.984769] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T17:35:17.047954] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:17.617553] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-08T17:35:17.927179] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T17:35:17.929674] [INFO ] [REMOTE ] BGB: Full fetch complete (27067 records). [2025-10-08T17:35:17.929943] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-08T17:35:18.316444] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-08T17:35:18.316582] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-08T17:35:18.317424] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-08T17:35:18.317513] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-08T17:35:18.318626] [DEBUG] [LOCAL ] BGB: Trimmed 27067 records to 17893 (keeping 200 days of data) [2025-10-08T17:35:18.417777] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-08T17:35:18.433765] [DEBUG] [LOCAL ] BGB: Primary data saved (17893 records). [2025-10-08T17:35:18.433912] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-08T17:35:18.434000] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGB took 33.4s. Estimated remaining: 4h 46m 9s. Rate: 7.4 symbols/min [2025-10-08T17:35:18.601509] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:18.611364] [DEBUG] [LOCAL ] BGSF: Loaded 7706 existing records from primary storage. [2025-10-08T17:35:18.611551] [INFO ] [MAIN ] BGSF: Loaded 7706 existing records. [2025-10-08T17:35:18.827670] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:18.828061] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-08T17:35:18.828131] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-08T17:35:18.828315] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-08T17:35:18.828373] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-08T17:35:19.201279] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:19.217494] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-08T17:35:19.236211] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T17:35:19.331980] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T17:35:19.335932] [INFO ] [REMOTE ] BG: Full fetch complete (72747 records). [2025-10-08T17:35:19.336095] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-08T17:35:19.742086] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-08T17:35:19.742166] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-08T17:35:19.742889] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-08T17:35:19.742951] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-08T17:35:19.744270] [DEBUG] [LOCAL ] BG: Trimmed 72747 records to 50428 (keeping 200 days of data) [2025-10-08T17:35:19.968582] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T17:35:20.025683] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-08T17:35:20.061507] [DEBUG] [LOCAL ] BG: Primary data saved (50428 records). [2025-10-08T17:35:20.061667] [INFO ] [MAIN ] BG: Full history saved. [2025-10-08T17:35:20.061773] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BG took 42.7s. Estimated remaining: 4h 45m 8s. Rate: 7.4 symbols/min [2025-10-08T17:35:20.232126] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:20.232275] [DEBUG] [LOCAL ] BGT: No existing data file found in primary storage. [2025-10-08T17:35:20.232321] [WARN ] [MAIN ] BGT: No existing data found, performing full refresh instead. [2025-10-08T17:35:20.232430] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-08T17:35:20.232470] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-08T17:35:20.232510] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-10-08T17:35:20.232540] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-08T17:35:20.576802] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:20.583789] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T17:35:20.817552] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-08T17:35:21.617548] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-08T17:35:21.697860] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T17:35:22.417553] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-08T17:35:23.217527] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-08T17:35:23.301362] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T17:35:23.348692] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T17:35:24.017572] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-08T17:35:24.352202] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T17:35:24.676396] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T17:35:24.677838] [INFO ] [REMOTE ] BGR: Full fetch complete (20159 records). [2025-10-08T17:35:24.677927] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-08T17:35:24.825495] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-08T17:35:25.054083] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-08T17:35:25.054163] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-08T17:35:25.054482] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-08T17:35:25.054522] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-08T17:35:25.055100] [DEBUG] [LOCAL ] BGR: Trimmed 20159 records to 13572 (keeping 200 days of data) [2025-10-08T17:35:25.138401] [DEBUG] [LOCAL ] BGR: Primary data saved (13572 records). [2025-10-08T17:35:25.138584] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-08T17:35:25.138704] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGR took 27.7s. Estimated remaining: 4h 44m 36s. Rate: 7.4 symbols/min [2025-10-08T17:35:25.307405] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:25.310439] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T17:35:25.322523] [DEBUG] [LOCAL ] BGX: Loaded 11063 existing records from primary storage. [2025-10-08T17:35:25.322775] [INFO ] [MAIN ] BGX: Loaded 11063 existing records. [2025-10-08T17:35:25.501200] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:25.501427] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-08T17:35:25.501474] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-08T17:35:25.501695] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-08T17:35:25.501759] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-08T17:35:25.622695] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-08T17:35:25.871909] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:26.417556] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-08T17:35:27.217613] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-08T17:35:27.304416] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T17:35:27.348709] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:35:27.941460] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T17:35:28.017537] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-08T17:35:28.817566] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-08T17:35:29.617551] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-08T17:35:29.665475] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:35:29.840469] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T17:35:30.377085] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T17:35:30.417543] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-08T17:35:31.217600] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-08T17:35:31.925296] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T17:35:32.011136] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:35:32.017489] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-08T17:35:32.817529] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-08T17:35:32.897426] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T17:35:33.617555] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-08T17:35:34.309605] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T17:35:34.417558] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-08T17:35:34.595000] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T17:35:35.217548] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-08T17:35:35.297753] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T17:35:36.017555] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-08T17:35:36.333935] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T17:35:36.655089] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:35:36.817563] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-08T17:35:37.267991] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T17:35:37.617561] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-08T17:35:38.417567] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-08T17:35:38.617274] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T17:35:39.191869] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T17:35:39.217516] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-08T17:35:39.680463] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:35:40.017601] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-08T17:35:40.817564] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-08T17:35:41.015313] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T17:35:41.617561] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-08T17:35:42.175037] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T17:35:42.207524] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T17:35:42.417537] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-08T17:35:43.193516] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T17:35:43.217496] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-08T17:35:43.799781] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T17:35:44.017576] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-08T17:35:44.817522] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-08T17:35:45.116687] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T17:35:45.617581] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-08T17:35:46.356048] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T17:35:46.417541] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-08T17:35:46.486489] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:35:47.217526] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-08T17:35:47.366376] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T17:35:48.015865] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T17:35:48.018384] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-08T17:35:48.817621] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-08T17:35:49.617517] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-08T17:35:49.688712] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T17:35:49.748633] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:35:50.417571] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-08T17:35:51.021541] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T17:35:51.035105] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T17:35:51.037607] [INFO ] [REMOTE ] BGX: Full fetch complete (16339 records). [2025-10-08T17:35:51.037730] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-08T17:35:51.218715] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-08T17:35:51.430029] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-08T17:35:51.430109] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-08T17:35:51.430421] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-08T17:35:51.430461] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-08T17:35:51.431018] [DEBUG] [LOCAL ] BGX: Trimmed 16339 records to 11113 (keeping 200 days of data) [2025-10-08T17:35:51.498702] [DEBUG] [LOCAL ] BGX: Primary data saved (11113 records). [2025-10-08T17:35:51.498836] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-08T17:35:51.498931] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGX took 26.4s. Estimated remaining: 4h 46m 54s. Rate: 7.3 symbols/min [2025-10-08T17:35:51.680141] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:51.702636] [DEBUG] [LOCAL ] BGY: Loaded 22024 existing records from primary storage. [2025-10-08T17:35:51.702968] [INFO ] [MAIN ] BGY: Loaded 22024 existing records. [2025-10-08T17:35:51.886943] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:51.887225] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-08T17:35:51.887287] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-08T17:35:51.887514] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-08T17:35:51.887573] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-08T17:35:52.027285] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-08T17:35:52.295111] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:52.305806] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:35:52.817578] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-08T17:35:53.338711] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:35:53.340578] [INFO ] [REMOTE ] BGSF: Full fetch complete (9266 records). [2025-10-08T17:35:53.340672] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-08T17:35:53.622822] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-08T17:35:53.698701] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-08T17:35:53.698792] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-08T17:35:53.699053] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-08T17:35:53.699092] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-08T17:35:53.699583] [DEBUG] [LOCAL ] BGSF: Trimmed 9266 records to 7730 (keeping 200 days of data) [2025-10-08T17:35:53.747035] [DEBUG] [LOCAL ] BGSF: Primary data saved (7730 records). [2025-10-08T17:35:53.747163] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-08T17:35:53.747260] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGSF took 35.3s. Estimated remaining: 4h 45m 59s. Rate: 7.4 symbols/min [2025-10-08T17:35:53.927695] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:53.945634] [DEBUG] [LOCAL ] BH: Loaded 16167 existing records from primary storage. [2025-10-08T17:35:53.945929] [INFO ] [MAIN ] BH: Loaded 16167 existing records. [2025-10-08T17:35:54.077119] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T17:35:54.145724] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:54.146010] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-08T17:35:54.146067] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-08T17:35:54.146416] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-08T17:35:54.146474] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-08T17:35:54.423181] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-08T17:35:54.506496] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:54.602121] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:35:54.603675] [INFO ] [REMOTE ] BGT: Full fetch complete (24332 records). [2025-10-08T17:35:54.603755] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-08T17:35:55.029107] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-08T17:35:55.029196] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-08T17:35:55.029584] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-08T17:35:55.029674] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-08T17:35:55.030487] [DEBUG] [LOCAL ] BGT: Trimmed 24332 records to 16621 (keeping 200 days of data) [2025-10-08T17:35:55.147821] [DEBUG] [LOCAL ] BGT: Primary data saved (16621 records). [2025-10-08T17:35:55.147963] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-08T17:35:55.148040] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGT took 35.1s. Estimated remaining: 4h 44m 57s. Rate: 7.4 symbols/min [2025-10-08T17:35:55.225457] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-08T17:35:55.362812] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:55.408628] [DEBUG] [LOCAL ] BHC: Loaded 46839 existing records from primary storage. [2025-10-08T17:35:55.409239] [INFO ] [MAIN ] BHC: Loaded 46839 existing records. [2025-10-08T17:35:55.570322] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T17:35:55.611427] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:55.611737] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-08T17:35:55.611793] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-08T17:35:55.612026] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-08T17:35:55.612084] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-08T17:35:55.963380] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:56.017498] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-08T17:35:56.817568] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-08T17:35:57.081447] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T17:35:57.617523] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-08T17:35:57.683688] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-08T17:35:57.736817] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:35:58.417551] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-08T17:35:59.217531] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-08T17:35:59.379698] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T17:35:59.437532] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T17:36:00.017562] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-08T17:36:00.822739] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-08T17:36:00.838027] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T17:36:01.317085] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T17:36:01.617519] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-08T17:36:01.848583] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:36:02.417515] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-08T17:36:02.498098] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T17:36:03.122956] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T17:36:03.217524] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-08T17:36:04.017550] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-08T17:36:04.821204] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-08T17:36:04.823136] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:36:04.827541] [INFO ] [REMOTE ] BGS: Full fetch complete (72518 records). [2025-10-08T17:36:04.827739] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-08T17:36:05.227568] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-08T17:36:05.227692] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-08T17:36:05.228436] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-08T17:36:05.228504] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-08T17:36:05.229973] [DEBUG] [LOCAL ] BGS: Trimmed 72518 records to 50497 (keeping 200 days of data) [2025-10-08T17:36:05.463528] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T17:36:05.551624] [DEBUG] [LOCAL ] BGS: Primary data saved (50497 records). [2025-10-08T17:36:05.551799] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-08T17:36:05.551886] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGS took 49.6s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-10-08T17:36:05.624476] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-08T17:36:05.722411] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:05.748038] [DEBUG] [LOCAL ] BHE: Loaded 24238 existing records from primary storage. [2025-10-08T17:36:05.748328] [INFO ] [MAIN ] BHE: Loaded 24238 existing records. [2025-10-08T17:36:05.974716] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:05.974956] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-08T17:36:05.975008] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-08T17:36:05.975495] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-08T17:36:05.975554] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-08T17:36:06.418289] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-08T17:36:06.418165] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:06.494175] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T17:36:06.669426] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:36:06.811451] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-08T17:36:07.217560] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-08T17:36:08.017517] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-08T17:36:08.386051] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:36:08.817518] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-08T17:36:08.817425] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T17:36:09.617569] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-08T17:36:10.417521] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-08T17:36:10.475227] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:36:10.646200] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T17:36:11.168740] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T17:36:11.217501] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-08T17:36:12.017510] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-08T17:36:12.412683] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T17:36:12.817532] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-08T17:36:13.012174] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:36:13.617519] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-08T17:36:14.004139] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:36:14.417553] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-08T17:36:14.508218] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T17:36:14.510298] [INFO ] [REMOTE ] BGY: Full fetch complete (32974 records). [2025-10-08T17:36:14.510386] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-08T17:36:14.876128] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-08T17:36:14.876211] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-08T17:36:14.876661] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-08T17:36:14.876725] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-08T17:36:14.877475] [DEBUG] [LOCAL ] BGY: Trimmed 32974 records to 21967 (keeping 200 days of data) [2025-10-08T17:36:15.004187] [DEBUG] [LOCAL ] BGY: Primary data saved (21967 records). [2025-10-08T17:36:15.004332] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-08T17:36:15.004416] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 23.5s. Estimated remaining: 4h 45m 9s. Rate: 7.4 symbols/min [2025-10-08T17:36:15.176523] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:15.200433] [DEBUG] [LOCAL ] BHK: Loaded 23307 existing records from primary storage. [2025-10-08T17:36:15.200754] [INFO ] [MAIN ] BHK: Loaded 23307 existing records. [2025-10-08T17:36:15.222691] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-08T17:36:15.400528] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:15.400802] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-08T17:36:15.400853] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-08T17:36:15.401063] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-08T17:36:15.401121] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-08T17:36:15.783369] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:15.802625] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T17:36:16.017525] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-08T17:36:16.337472] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T17:36:16.817512] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-08T17:36:17.131247] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T17:36:17.617554] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-08T17:36:18.417552] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-08T17:36:18.558244] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:36:18.602269] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T17:36:19.217575] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-08T17:36:19.396893] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T17:36:19.806901] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T17:36:20.017683] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-08T17:36:20.817532] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-08T17:36:21.075040] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T17:36:21.617536] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-08T17:36:21.832187] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:36:22.417624] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-08T17:36:22.684484] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T17:36:23.217557] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-08T17:36:23.621361] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T17:36:24.017567] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-08T17:36:24.817541] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-08T17:36:24.910446] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T17:36:24.953196] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T17:36:25.617531] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-08T17:36:25.840734] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T17:36:26.417820] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-08T17:36:27.005121] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:36:27.217587] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-08T17:36:27.684350] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T17:36:28.017583] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-08T17:36:28.582283] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T17:36:28.817584] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-08T17:36:29.319299] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:36:29.320908] [INFO ] [REMOTE ] BH: Full fetch complete (19763 records). [2025-10-08T17:36:29.320979] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-08T17:36:29.621162] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-08T17:36:29.707422] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-08T17:36:29.707511] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-08T17:36:29.707919] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-08T17:36:29.707982] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-08T17:36:29.708676] [DEBUG] [LOCAL ] BH: Trimmed 19763 records to 16182 (keeping 200 days of data) [2025-10-08T17:36:29.809748] [DEBUG] [LOCAL ] BH: Primary data saved (16182 records). [2025-10-08T17:36:29.809913] [INFO ] [MAIN ] BH: Full history saved. [2025-10-08T17:36:29.810002] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 36.1s. Estimated remaining: 4h 45m 53s. Rate: 7.4 symbols/min [2025-10-08T17:36:29.979566] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:30.030087] [DEBUG] [LOCAL ] BHP: Loaded 53371 existing records from primary storage. [2025-10-08T17:36:30.030426] [INFO ] [MAIN ] BHP: Loaded 53371 existing records. [2025-10-08T17:36:30.207664] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:30.207890] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-08T17:36:30.207936] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-08T17:36:30.208159] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-08T17:36:30.208216] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-08T17:36:30.419982] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-08T17:36:30.573736] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:30.614279] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:36:30.673461] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T17:36:31.217568] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-08T17:36:31.425204] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T17:36:32.017528] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-08T17:36:32.393247] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T17:36:32.817595] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-08T17:36:33.617524] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-08T17:36:33.818919] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T17:36:34.071985] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:36:34.417630] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-08T17:36:35.008292] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T17:36:35.217570] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-08T17:36:36.017507] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-08T17:36:36.362694] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T17:36:36.501272] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:36:36.817617] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-08T17:36:37.563202] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T17:36:37.566598] [INFO ] [REMOTE ] BHC: Full fetch complete (67051 records). [2025-10-08T17:36:37.566754] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-08T17:36:37.625019] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-08T17:36:37.970202] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-08T17:36:37.970288] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-08T17:36:37.971007] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-08T17:36:37.971070] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-08T17:36:37.972464] [DEBUG] [LOCAL ] BHC: Trimmed 67051 records to 46776 (keeping 200 days of data) [2025-10-08T17:36:38.250493] [DEBUG] [LOCAL ] BHC: Primary data saved (46776 records). [2025-10-08T17:36:38.250663] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-08T17:36:38.250774] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHC took 43.1s. Estimated remaining: 4h 45m 47s. Rate: 7.4 symbols/min [2025-10-08T17:36:38.425572] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:38.422904] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-08T17:36:38.448237] [DEBUG] [LOCAL ] BHR: Loaded 21777 existing records from primary storage. [2025-10-08T17:36:38.448675] [INFO ] [MAIN ] BHR: Loaded 21777 existing records. [2025-10-08T17:36:38.634487] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:38.634910] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-08T17:36:38.634985] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-08T17:36:38.635272] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-08T17:36:38.635420] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-08T17:36:38.767861] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T17:36:39.037524] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T17:36:39.073886] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:39.217538] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-08T17:36:39.277348] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T17:36:40.017501] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-08T17:36:40.246562] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:36:40.817574] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-08T17:36:41.090439] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:36:41.617512] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-08T17:36:41.858053] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T17:36:42.417514] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-08T17:36:42.491370] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T17:36:42.493191] [INFO ] [REMOTE ] BHE: Full fetch complete (36433 records). [2025-10-08T17:36:42.493266] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-08T17:36:42.865994] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-08T17:36:42.866097] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-08T17:36:42.866552] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-08T17:36:42.866590] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-08T17:36:42.867393] [DEBUG] [LOCAL ] BHE: Trimmed 36433 records to 24052 (keeping 200 days of data) [2025-10-08T17:36:43.022001] [DEBUG] [LOCAL ] BHE: Primary data saved (24052 records). [2025-10-08T17:36:43.022283] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-08T17:36:43.022399] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 37.5s. Estimated remaining: 4h 45m 13s. Rate: 7.4 symbols/min [2025-10-08T17:36:43.201394] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:43.206697] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-08T17:36:43.207212] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:36:43.206761] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-08T17:36:43.211263] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-08T17:36:43.211659] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-08T17:36:43.211731] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-08T17:36:43.211767] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-08T17:36:43.222676] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-08T17:36:43.567884] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:44.017583] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-08T17:36:44.200465] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T17:36:44.492216] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T17:36:44.817602] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-08T17:36:45.617552] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-08T17:36:45.974341] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:36:46.417568] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-08T17:36:47.217560] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-08T17:36:47.556758] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T17:36:47.708247] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T17:36:47.813306] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-08T17:36:48.017524] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-08T17:36:48.367812] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T17:36:48.817558] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-08T17:36:49.617547] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-08T17:36:50.417522] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-08T17:36:50.799873] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T17:36:50.905560] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T17:36:51.217502] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-08T17:36:51.395497] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:36:51.398140] [INFO ] [REMOTE ] BHK: Full fetch complete (30627 records). [2025-10-08T17:36:51.398302] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-08T17:36:51.842734] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-08T17:36:51.842876] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-08T17:36:51.843298] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-08T17:36:51.843338] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-08T17:36:51.844068] [DEBUG] [LOCAL ] BHK: Trimmed 30627 records to 23435 (keeping 200 days of data) [2025-10-08T17:36:51.984764] [DEBUG] [LOCAL ] BHK: Primary data saved (23435 records). [2025-10-08T17:36:51.984905] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-08T17:36:51.984996] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 37.0s. Estimated remaining: 4h 45m 11s. Rate: 7.4 symbols/min [2025-10-08T17:36:52.027548] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-08T17:36:52.156919] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:52.209491] [DEBUG] [LOCAL ] BHVN: Loaded 50123 existing records from primary storage. [2025-10-08T17:36:52.209897] [INFO ] [MAIN ] BHVN: Loaded 50123 existing records. [2025-10-08T17:36:52.387894] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:52.388165] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-08T17:36:52.388240] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-08T17:36:52.388592] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-08T17:36:52.388687] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-08T17:36:52.744468] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:52.817512] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-08T17:36:53.105785] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T17:36:53.130463] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T17:36:53.617621] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-08T17:36:54.312377] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:36:54.417601] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-08T17:36:54.788029] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-08T17:36:55.217548] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-08T17:36:55.505492] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T17:36:56.017546] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-08T17:36:56.522069] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T17:36:56.817570] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-08T17:36:57.617561] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-08T17:36:57.852754] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T17:36:57.897723] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-08T17:36:58.282282] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:36:58.417521] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-08T17:36:59.217553] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-08T17:36:59.952432] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T17:37:00.017547] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-08T17:37:00.817539] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-08T17:37:01.196080] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T17:37:01.539687] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:37:01.617523] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-08T17:37:01.660708] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T17:37:02.417553] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-08T17:37:03.127855] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:37:03.217497] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-08T17:37:04.024601] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-08T17:37:04.030920] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T17:37:04.817567] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-08T17:37:05.035637] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:37:05.060069] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T17:37:05.617557] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-08T17:37:06.417570] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-08T17:37:06.503461] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:37:06.507514] [INFO ] [REMOTE ] BHP: Full fetch complete (77263 records). [2025-10-08T17:37:06.507676] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-08T17:37:06.899734] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-08T17:37:06.899868] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-08T17:37:06.900968] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-08T17:37:06.901100] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-08T17:37:06.903968] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T17:37:06.906378] [DEBUG] [LOCAL ] BHP: Trimmed 77263 records to 53372 (keeping 200 days of data) [2025-10-08T17:37:07.232446] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-08T17:37:07.282242] [DEBUG] [LOCAL ] BHP: Primary data saved (53372 records). [2025-10-08T17:37:07.282418] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-08T17:37:07.282538] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHP took 37.5s. Estimated remaining: 4h 45m 58s. Rate: 7.3 symbols/min [2025-10-08T17:37:07.465459] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:07.495767] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:37:07.547146] [DEBUG] [LOCAL ] BILL: Loaded 52380 existing records from primary storage. [2025-10-08T17:37:07.547511] [INFO ] [MAIN ] BILL: Loaded 52380 existing records. [2025-10-08T17:37:07.719819] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:07.720023] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-08T17:37:07.720070] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-08T17:37:07.720344] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-08T17:37:07.720401] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-08T17:37:08.031692] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-08T17:37:08.073325] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:08.351801] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T17:37:08.415478] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T17:37:08.817562] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-08T17:37:09.617556] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-08T17:37:10.417536] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-08T17:37:10.460185] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T17:37:11.184552] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:37:11.217496] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-08T17:37:11.577781] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T17:37:11.580290] [INFO ] [REMOTE ] BHR: Full fetch complete (31189 records). [2025-10-08T17:37:11.580392] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-08T17:37:11.954000] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-08T17:37:11.954150] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-08T17:37:11.954575] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-08T17:37:11.955262] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-08T17:37:11.956211] [DEBUG] [LOCAL ] BHR: Trimmed 31189 records to 21855 (keeping 200 days of data) [2025-10-08T17:37:12.040483] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-08T17:37:12.086156] [DEBUG] [LOCAL ] BHR: Primary data saved (21855 records). [2025-10-08T17:37:12.086272] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-08T17:37:12.086349] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHR took 33.8s. Estimated remaining: 4h 45m 24s. Rate: 7.4 symbols/min [2025-10-08T17:37:12.256501] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:12.281129] [DEBUG] [LOCAL ] BIO: Loaded 24515 existing records from primary storage. [2025-10-08T17:37:12.281403] [INFO ] [MAIN ] BIO: Loaded 24515 existing records. [2025-10-08T17:37:12.390797] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T17:37:12.469627] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:12.469869] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-08T17:37:12.469926] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-08T17:37:12.470130] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-08T17:37:12.470190] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-08T17:37:12.834965] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-08T17:37:12.841737] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:12.900725] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T17:37:13.617552] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-08T17:37:14.136702] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T17:37:14.392908] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T17:37:14.417509] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-08T17:37:15.217543] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-08T17:37:15.931029] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T17:37:15.936530] [INFO ] [REMOTE ] BHVN: Full fetch complete (70093 records). [2025-10-08T17:37:15.936696] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-08T17:37:16.019048] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-08T17:37:16.404786] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T17:37:16.432995] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-08T17:37:16.433070] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-08T17:37:16.434054] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-08T17:37:16.434125] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-08T17:37:16.438679] [DEBUG] [LOCAL ] BHVN: Trimmed 70093 records to 50190 (keeping 200 days of data) [2025-10-08T17:37:16.769244] [DEBUG] [LOCAL ] BHVN: Primary data saved (50190 records). [2025-10-08T17:37:16.769449] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-08T17:37:16.769568] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHVN took 24.8s. Estimated remaining: 4h 44m 49s. Rate: 7.4 symbols/min [2025-10-08T17:37:16.822638] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-08T17:37:16.952332] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:16.988793] [DEBUG] [LOCAL ] BIP: Loaded 39410 existing records from primary storage. [2025-10-08T17:37:16.989134] [INFO ] [MAIN ] BIP: Loaded 39410 existing records. [2025-10-08T17:37:17.169063] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:17.169291] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-08T17:37:17.169351] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-08T17:37:17.169562] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-08T17:37:17.169618] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-08T17:37:17.516345] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:17.617500] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-08T17:37:17.857207] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T17:37:17.959514] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T17:37:18.417551] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-08T17:37:18.754400] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T17:37:19.217618] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-08T17:37:19.732422] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T17:37:20.017521] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-08T17:37:20.161095] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T17:37:20.390200] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T17:37:20.390956] [INFO ] [REMOTE ] BHV: Full fetch complete (1377 records). [2025-10-08T17:37:20.391028] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-08T17:37:20.571123] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-08T17:37:20.571388] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:37:20.571478] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:37:20.571573] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-08T17:37:20.571680] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-08T17:37:20.571736] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-08T17:37:20.571808] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-08T17:37:20.571893] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BHV took 37.5s. Estimated remaining: 4h 44m 8s. Rate: 7.4 symbols/min [2025-10-08T17:37:20.742360] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:20.783354] [DEBUG] [LOCAL ] BIPC: Loaded 41252 existing records from primary storage. [2025-10-08T17:37:20.783738] [INFO ] [MAIN ] BIPC: Loaded 41252 existing records. [2025-10-08T17:37:20.822983] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-08T17:37:20.972948] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:20.973177] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-08T17:37:20.973222] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-08T17:37:20.973427] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-08T17:37:20.973482] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-08T17:37:21.329238] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:21.617500] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-08T17:37:22.009447] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:37:22.417589] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-08T17:37:23.143823] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:37:23.217499] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-08T17:37:24.017617] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-08T17:37:24.071347] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:37:24.665376] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T17:37:24.817585] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-08T17:37:25.156833] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T17:37:25.617565] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-08T17:37:26.417534] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-08T17:37:26.608738] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:37:26.993072] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:37:27.217626] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-08T17:37:27.441472] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T17:37:28.017625] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-08T17:37:28.179519] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T17:37:28.817622] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-08T17:37:29.617597] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-08T17:37:29.686624] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:37:30.327745] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T17:37:30.417542] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-08T17:37:30.877889] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:37:31.217583] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-08T17:37:31.714341] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:37:32.017576] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-08T17:37:32.801604] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T17:37:32.817489] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-08T17:37:33.617558] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-08T17:37:33.861064] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T17:37:34.417539] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-08T17:37:34.464164] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:37:34.584964] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T17:37:35.217568] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-08T17:37:36.017536] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-08T17:37:36.231581] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T17:37:36.758670] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T17:37:36.817578] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-08T17:37:37.262499] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T17:37:37.617567] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-08T17:37:37.854813] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:37:38.417535] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-08T17:37:39.047526] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T17:37:39.217541] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-08T17:37:40.017565] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-08T17:37:40.280058] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T17:37:40.733237] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T17:37:40.817528] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-08T17:37:41.597580] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T17:37:41.617496] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-08T17:37:41.994842] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T17:37:42.417575] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-08T17:37:42.622873] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T17:37:43.217520] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-08T17:37:43.533901] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T17:37:44.017613] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-08T17:37:44.534722] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T17:37:44.817568] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-08T17:37:45.518576] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T17:37:45.617521] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-08T17:37:45.676058] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T17:37:46.417571] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-08T17:37:46.939462] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T17:37:47.118770] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T17:37:47.120544] [INFO ] [REMOTE ] BIO: Full fetch complete (34093 records). [2025-10-08T17:37:47.120698] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-08T17:37:47.222608] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-08T17:37:47.518420] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-08T17:37:47.518546] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-08T17:37:47.519022] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-08T17:37:47.519089] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-08T17:37:47.519861] [DEBUG] [LOCAL ] BIO: Trimmed 34093 records to 24324 (keeping 200 days of data) [2025-10-08T17:37:47.669480] [DEBUG] [LOCAL ] BIO: Primary data saved (24324 records). [2025-10-08T17:37:47.669625] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-08T17:37:47.669749] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BIO took 35.6s. Estimated remaining: 4h 46m 24s. Rate: 7.3 symbols/min [2025-10-08T17:37:47.835720] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:47.840795] [DEBUG] [LOCAL ] BIPH: Loaded 2558 existing records from primary storage. [2025-10-08T17:37:47.840954] [INFO ] [MAIN ] BIPH: Loaded 2558 existing records. [2025-10-08T17:37:48.014613] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:48.014849] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-08T17:37:48.014897] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-08T17:37:48.015136] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-08T17:37:48.015211] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-08T17:37:48.026233] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-08T17:37:48.390357] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:48.632831] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T17:37:48.636112] [INFO ] [REMOTE ] BIPC: Full fetch complete (60012 records). [2025-10-08T17:37:48.636207] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-08T17:37:48.824902] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-08T17:37:49.029278] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-08T17:37:49.029368] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-08T17:37:49.030077] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-08T17:37:49.030142] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-08T17:37:49.031564] [DEBUG] [LOCAL ] BIPC: Trimmed 60012 records to 41294 (keeping 200 days of data) [2025-10-08T17:37:49.281845] [DEBUG] [LOCAL ] BIPC: Primary data saved (41294 records). [2025-10-08T17:37:49.281980] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-08T17:37:49.282060] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIPC took 28.7s. Estimated remaining: 4h 45m 26s. Rate: 7.3 symbols/min [2025-10-08T17:37:49.617526] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-08T17:37:49.784227] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T17:37:49.788782] [INFO ] [REMOTE ] BILL: Full fetch complete (75889 records). [2025-10-08T17:37:49.788905] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-08T17:37:50.182350] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-08T17:37:50.182534] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-08T17:37:50.183386] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-08T17:37:50.183455] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-08T17:37:50.185177] [DEBUG] [LOCAL ] BILL: Trimmed 75889 records to 52405 (keeping 200 days of data) [2025-10-08T17:37:50.483424] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T17:37:50.489854] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-08T17:37:50.517553] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T17:37:50.540898] [DEBUG] [LOCAL ] BILL: Primary data saved (52405 records). [2025-10-08T17:37:50.541041] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-08T17:37:50.541147] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BILL took 43.3s. Estimated remaining: 4h 44m 26s. Rate: 7.4 symbols/min [2025-10-08T17:37:51.092233] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T17:37:51.217543] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-08T17:37:51.660639] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T17:37:52.017577] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-08T17:37:52.418176] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-08T17:37:52.817605] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-08T17:37:53.617579] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-08T17:37:54.271185] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:37:54.274468] [INFO ] [REMOTE ] BIP: Full fetch complete (57013 records). [2025-10-08T17:37:54.274589] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-08T17:37:54.384311] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T17:37:54.426478] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-08T17:37:54.675718] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-08T17:37:54.675801] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-08T17:37:54.676427] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-08T17:37:54.676467] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-08T17:37:54.677549] [DEBUG] [LOCAL ] BIP: Trimmed 57013 records to 39333 (keeping 200 days of data) [2025-10-08T17:37:54.920391] [DEBUG] [LOCAL ] BIP: Primary data saved (39333 records). [2025-10-08T17:37:54.920561] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-08T17:37:54.920691] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIP took 38.2s. Estimated remaining: 4h 43m 49s. Rate: 7.4 symbols/min [2025-10-08T17:37:55.014939] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T17:37:55.217572] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-08T17:37:55.668283] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T17:37:56.017634] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-08T17:37:56.445190] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T17:37:56.817556] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-08T17:37:57.269433] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T17:37:57.617612] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-08T17:37:58.064439] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T17:37:58.417546] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-08T17:37:58.873719] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T17:37:58.874626] [INFO ] [REMOTE ] BIPH: Full fetch complete (4200 records). [2025-10-08T17:37:58.874728] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-08T17:37:59.275512] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-08T17:37:59.275592] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-08T17:37:59.275739] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-08T17:37:59.275800] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-08T17:37:59.276153] [DEBUG] [LOCAL ] BIPH: Trimmed 4200 records to 2566 (keeping 200 days of data) [2025-10-08T17:37:59.292217] [DEBUG] [LOCAL ] BIPH: Primary data saved (2566 records). [2025-10-08T17:37:59.292312] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-08T17:37:59.292387] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPH took 11.6s. Estimated remaining: 4h 43m 13s. Rate: 7.4 symbols/min [2025-10-08T17:37:59.908223] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:59.965444] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:59.992758] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:00.048853] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:00.052261] [DEBUG] [LOCAL ] BIPJ: Loaded 3146 existing records from primary storage. [2025-10-08T17:38:00.052792] [INFO ] [MAIN ] BIPJ: Loaded 3146 existing records. [2025-10-08T17:38:00.130735] [DEBUG] [LOCAL ] BIPI: Loaded 3159 existing records from primary storage. [2025-10-08T17:38:00.165169] [INFO ] [MAIN ] BIPI: Loaded 3159 existing records. [2025-10-08T17:38:00.199457] [DEBUG] [LOCAL ] BIT: Loaded 23137 existing records from primary storage. [2025-10-08T17:38:00.266484] [INFO ] [MAIN ] BIT: Loaded 23137 existing records. [2025-10-08T17:38:00.349086] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:00.416960] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-08T17:38:00.431103] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-08T17:38:00.480354] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-08T17:38:00.508219] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-08T17:38:00.629508] [DEBUG] [LOCAL ] BIRK: Loaded 50954 existing records from primary storage. [2025-10-08T17:38:00.592680] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:00.683383] [INFO ] [MAIN ] BIRK: Loaded 50954 existing records. [2025-10-08T17:38:00.683493] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-08T17:38:00.694607] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-08T17:38:00.763269] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-08T17:38:00.815542] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:00.805864] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-08T17:38:00.844024] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-08T17:38:00.849301] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-08T17:38:00.961519] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-08T17:38:01.011229] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-08T17:38:01.274625] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:01.334542] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-08T17:38:01.398375] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-08T17:38:01.468700] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-08T17:38:01.563978] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-08T17:38:01.718498] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:01.789698] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-08T17:38:02.085433] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:02.090574] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-08T17:38:02.271134] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:02.328752] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-08T17:38:02.482150] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:02.482769] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-08T17:38:02.626703] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:38:02.629089] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-08T17:38:03.084071] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T17:38:03.093032] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T17:38:03.217623] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-08T17:38:03.540814] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T17:38:03.682956] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T17:38:04.017543] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-08T17:38:04.384438] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-08T17:38:04.620210] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-08T17:38:04.817548] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-08T17:38:05.617592] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-08T17:38:05.678814] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:38:06.186801] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T17:38:06.417574] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-08T17:38:06.912132] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T17:38:07.217558] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-08T17:38:07.833263] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T17:38:08.017565] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-08T17:38:08.817532] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-08T17:38:08.993002] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T17:38:09.206721] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T17:38:09.617570] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-08T17:38:10.417589] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-08T17:38:10.982465] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:38:11.041032] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:38:11.217589] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-08T17:38:11.778227] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T17:38:12.017550] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-08T17:38:12.817530] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-08T17:38:13.378207] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T17:38:13.543440] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T17:38:13.617596] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-08T17:38:14.271044] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T17:38:14.417573] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-08T17:38:15.217571] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-08T17:38:15.609581] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T17:38:15.765725] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:38:16.017605] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-08T17:38:16.817588] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-08T17:38:17.060321] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T17:38:17.307765] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:38:17.308582] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4367 records). [2025-10-08T17:38:17.308678] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-08T17:38:17.619483] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-08T17:38:17.713856] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-08T17:38:17.713969] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-08T17:38:17.714132] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-08T17:38:17.714175] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-08T17:38:17.714561] [DEBUG] [LOCAL ] BIPJ: Trimmed 4367 records to 3153 (keeping 200 days of data) [2025-10-08T17:38:17.734868] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3153 records). [2025-10-08T17:38:17.734994] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-08T17:38:17.735096] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 18.4s. Estimated remaining: 4h 44m 21s. Rate: 7.3 symbols/min [2025-10-08T17:38:17.924199] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:17.974986] [DEBUG] [LOCAL ] BJ: Loaded 51495 existing records from primary storage. [2025-10-08T17:38:17.975324] [INFO ] [MAIN ] BJ: Loaded 51495 existing records. [2025-10-08T17:38:18.147240] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:18.147499] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-08T17:38:18.147556] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-08T17:38:18.147798] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-08T17:38:18.147855] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-08T17:38:18.422875] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-08T17:38:18.493812] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:19.216850] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T17:38:19.217680] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-08T17:38:19.217779] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-08T17:38:20.017577] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-08T17:38:20.043901] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T17:38:20.817565] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-08T17:38:21.271551] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T17:38:21.543367] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:38:21.617563] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-08T17:38:22.417621] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-08T17:38:23.060518] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T17:38:23.217545] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-08T17:38:23.462788] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:38:24.017553] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-08T17:38:24.400873] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T17:38:24.817800] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-08T17:38:24.887579] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T17:38:25.617553] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-08T17:38:26.417550] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-08T17:38:26.527327] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T17:38:27.111529] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:38:27.113748] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:38:27.217502] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-08T17:38:28.017567] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-08T17:38:28.817624] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-08T17:38:28.938870] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T17:38:29.466552] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T17:38:29.617589] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-08T17:38:29.801762] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T17:38:30.417582] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-08T17:38:31.174832] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:38:31.217563] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-08T17:38:31.475264] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T17:38:32.017563] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-08T17:38:32.803618] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T17:38:32.817490] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-08T17:38:33.392136] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T17:38:33.617553] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-08T17:38:34.417541] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-08T17:38:34.482315] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T17:38:34.721149] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T17:38:34.731884] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-08T17:38:35.217562] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-08T17:38:35.719763] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T17:38:35.720842] [INFO ] [REMOTE ] BIPI: Full fetch complete (5000 records). [2025-10-08T17:38:35.720925] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-08T17:38:36.022696] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-08T17:38:36.115731] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-08T17:38:36.115833] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-08T17:38:36.115999] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-08T17:38:36.116038] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-08T17:38:36.116741] [DEBUG] [LOCAL ] BIPI: Trimmed 5000 records to 3152 (keeping 200 days of data) [2025-10-08T17:38:36.138111] [DEBUG] [LOCAL ] BIPI: Primary data saved (3152 records). [2025-10-08T17:38:36.138261] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-08T17:38:36.138365] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 36.8s. Estimated remaining: 4h 45m 29s. Rate: 7.3 symbols/min [2025-10-08T17:38:36.320409] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:36.373776] [DEBUG] [LOCAL ] BK: Loaded 53536 existing records from primary storage. [2025-10-08T17:38:36.374206] [INFO ] [MAIN ] BK: Loaded 53536 existing records. [2025-10-08T17:38:36.568210] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:36.568453] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-08T17:38:36.568541] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-08T17:38:36.568883] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-08T17:38:36.568943] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-08T17:38:36.823608] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-08T17:38:36.959749] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:37.506608] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T17:38:37.617597] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-08T17:38:38.128132] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:38:38.417576] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-08T17:38:38.809242] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T17:38:38.811821] [INFO ] [REMOTE ] BIT: Full fetch complete (31947 records). [2025-10-08T17:38:38.811897] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-08T17:38:39.176380] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-08T17:38:39.176466] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-08T17:38:39.176901] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-08T17:38:39.176963] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-08T17:38:39.177785] [DEBUG] [LOCAL ] BIT: Trimmed 31947 records to 23233 (keeping 200 days of data) [2025-10-08T17:38:39.230802] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-08T17:38:39.328954] [DEBUG] [LOCAL ] BIT: Primary data saved (23233 records). [2025-10-08T17:38:39.329103] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-08T17:38:39.329205] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 40.0s. Estimated remaining: 4h 44m 44s. Rate: 7.3 symbols/min [2025-10-08T17:38:39.495447] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:39.541549] [DEBUG] [LOCAL ] BKD: Loaded 50321 existing records from primary storage. [2025-10-08T17:38:39.541892] [INFO ] [MAIN ] BKD: Loaded 50321 existing records. [2025-10-08T17:38:39.718087] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:39.718319] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-08T17:38:39.718366] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-08T17:38:39.718952] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-08T17:38:39.719011] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-08T17:38:40.020758] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-08T17:38:40.096124] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:40.128785] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:38:40.817512] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-08T17:38:40.964277] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T17:38:40.968790] [INFO ] [REMOTE ] BIRK: Full fetch complete (73058 records). [2025-10-08T17:38:40.968927] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-08T17:38:41.445357] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-08T17:38:41.445485] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-08T17:38:41.446455] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-08T17:38:41.446524] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-08T17:38:41.448343] [DEBUG] [LOCAL ] BIRK: Trimmed 73058 records to 50994 (keeping 200 days of data) [2025-10-08T17:38:41.641480] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-08T17:38:41.789944] [DEBUG] [LOCAL ] BIRK: Primary data saved (50994 records). [2025-10-08T17:38:41.790148] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-08T17:38:41.790276] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 42.5s. Estimated remaining: 4h 43m 54s. Rate: 7.4 symbols/min [2025-10-08T17:38:41.965785] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:42.002213] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T17:38:42.044749] [DEBUG] [LOCAL ] BKE: Loaded 34102 existing records from primary storage. [2025-10-08T17:38:42.045088] [INFO ] [MAIN ] BKE: Loaded 34102 existing records. [2025-10-08T17:38:42.229520] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:42.229879] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-08T17:38:42.230008] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-08T17:38:42.230424] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-08T17:38:42.230504] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-08T17:38:42.418382] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-08T17:38:42.548800] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T17:38:42.640919] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:43.114369] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T17:38:43.217559] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-08T17:38:44.017521] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-08T17:38:44.259681] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T17:38:44.760471] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:38:44.817540] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-08T17:38:45.617585] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-08T17:38:45.743747] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T17:38:46.006181] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:38:46.417631] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-08T17:38:47.034078] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T17:38:47.217555] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-08T17:38:47.887597] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T17:38:48.017575] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-08T17:38:48.817546] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-08T17:38:49.031005] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T17:38:49.617585] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-08T17:38:49.680906] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:38:49.870965] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:38:50.417711] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-08T17:38:51.217581] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-08T17:38:51.351122] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:38:51.422275] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:38:52.017528] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-08T17:38:52.817574] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-08T17:38:53.379612] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T17:38:53.452449] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:38:53.617549] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-08T17:38:54.388443] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T17:38:54.393028] [INFO ] [REMOTE ] BJ: Full fetch complete (74006 records). [2025-10-08T17:38:54.393183] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-08T17:38:54.422800] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-08T17:38:54.804235] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-08T17:38:54.804333] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-08T17:38:54.805140] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-08T17:38:54.805209] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-08T17:38:54.806840] [DEBUG] [LOCAL ] BJ: Trimmed 74006 records to 51508 (keeping 200 days of data) [2025-10-08T17:38:55.118944] [DEBUG] [LOCAL ] BJ: Primary data saved (51508 records). [2025-10-08T17:38:55.119116] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-08T17:38:55.119210] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 37.4s. Estimated remaining: 4h 44m 23s. Rate: 7.3 symbols/min [2025-10-08T17:38:55.220083] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-08T17:38:55.325434] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:55.359508] [DEBUG] [LOCAL ] BKH: Loaded 36861 existing records from primary storage. [2025-10-08T17:38:55.386949] [INFO ] [MAIN ] BKH: Loaded 36861 existing records. [2025-10-08T17:38:55.486898] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:38:55.591362] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:55.591918] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-08T17:38:55.592096] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-08T17:38:55.592507] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-08T17:38:55.592756] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-08T17:38:55.794326] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T17:38:55.982726] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:56.017498] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-08T17:38:56.658811] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T17:38:56.817515] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-08T17:38:57.487260] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T17:38:57.617520] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-08T17:38:58.263373] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T17:38:58.417537] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-08T17:38:59.118049] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T17:38:59.217544] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-08T17:38:59.403854] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T17:39:00.017588] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-08T17:39:00.817581] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-08T17:39:00.872367] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T17:39:01.582287] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T17:39:01.617546] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-08T17:39:02.210261] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:39:02.417549] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-08T17:39:03.217607] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-08T17:39:03.308356] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T17:39:03.930490] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:39:04.017570] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-08T17:39:04.461181] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T17:39:04.817556] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-08T17:39:05.617560] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-08T17:39:05.908412] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:39:06.041436] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T17:39:06.417537] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-08T17:39:06.958553] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:39:07.217548] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-08T17:39:08.017577] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-08T17:39:08.184569] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T17:39:08.817555] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-08T17:39:08.993298] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T17:39:09.623247] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-08T17:39:09.637339] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T17:39:10.099069] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T17:39:10.417553] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-08T17:39:11.080890] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T17:39:11.084933] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-10-08T17:39:11.085090] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-08T17:39:11.227867] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-08T17:39:11.531371] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-08T17:39:11.531505] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-08T17:39:11.532383] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-08T17:39:11.532513] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-08T17:39:11.534282] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 53532 (keeping 200 days of data) [2025-10-08T17:39:11.790411] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T17:39:11.908417] [DEBUG] [LOCAL ] BK: Primary data saved (53532 records). [2025-10-08T17:39:11.908611] [INFO ] [MAIN ] BK: Full history saved. [2025-10-08T17:39:11.908734] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 35.8s. Estimated remaining: 4h 45m 18s. Rate: 7.3 symbols/min [2025-10-08T17:39:12.022742] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-08T17:39:12.091543] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:12.126109] [DEBUG] [LOCAL ] BKKT: Loaded 35633 existing records from primary storage. [2025-10-08T17:39:12.126445] [INFO ] [MAIN ] BKKT: Loaded 35633 existing records. [2025-10-08T17:39:12.307298] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:12.307580] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-08T17:39:12.307626] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-08T17:39:12.308589] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-08T17:39:12.308688] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-08T17:39:12.674317] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:12.698606] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T17:39:12.817549] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-08T17:39:13.015306] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T17:39:13.018320] [INFO ] [REMOTE ] BKE: Full fetch complete (50120 records). [2025-10-08T17:39:13.018425] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-08T17:39:13.464517] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-08T17:39:13.464863] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-08T17:39:13.465445] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-08T17:39:13.465508] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-08T17:39:13.466563] [DEBUG] [LOCAL ] BKE: Trimmed 50120 records to 33971 (keeping 200 days of data) [2025-10-08T17:39:13.622771] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-08T17:39:13.672216] [DEBUG] [LOCAL ] BKE: Primary data saved (33971 records). [2025-10-08T17:39:13.672373] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-08T17:39:13.672465] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKE took 31.9s. Estimated remaining: 4h 44m 23s. Rate: 7.3 symbols/min [2025-10-08T17:39:13.840673] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:13.851924] [DEBUG] [LOCAL ] BKN: Loaded 7685 existing records from primary storage. [2025-10-08T17:39:13.852152] [INFO ] [MAIN ] BKN: Loaded 7685 existing records. [2025-10-08T17:39:14.071095] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:14.071457] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-08T17:39:14.071514] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-08T17:39:14.071892] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-08T17:39:14.071958] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-08T17:39:14.430708] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-08T17:39:14.479899] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T17:39:14.556186] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:15.217565] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-08T17:39:15.658805] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T17:39:15.726895] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:39:15.730835] [INFO ] [REMOTE ] BKD: Full fetch complete (71771 records). [2025-10-08T17:39:15.730982] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-08T17:39:15.947526] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:39:16.022839] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-08T17:39:16.160780] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-08T17:39:16.160859] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-08T17:39:16.161723] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-08T17:39:16.161792] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-08T17:39:16.163293] [DEBUG] [LOCAL ] BKD: Trimmed 71771 records to 50322 (keeping 200 days of data) [2025-10-08T17:39:16.452174] [DEBUG] [LOCAL ] BKD: Primary data saved (50322 records). [2025-10-08T17:39:16.452346] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-08T17:39:16.452453] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKD took 37.1s. Estimated remaining: 4h 43m 36s. Rate: 7.3 symbols/min [2025-10-08T17:39:16.623761] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:16.672038] [DEBUG] [LOCAL ] BKSY: Loaded 48400 existing records from primary storage. [2025-10-08T17:39:16.672416] [INFO ] [MAIN ] BKSY: Loaded 48400 existing records. [2025-10-08T17:39:16.822699] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-08T17:39:16.862252] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:16.862639] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-08T17:39:16.862732] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-08T17:39:16.862983] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-08T17:39:16.863058] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-08T17:39:16.982385] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:39:17.249314] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:17.617597] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-08T17:39:18.123819] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T17:39:18.189391] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T17:39:18.417616] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-08T17:39:19.217590] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-08T17:39:20.017603] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-08T17:39:20.089311] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T17:39:20.817618] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-08T17:39:21.051248] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T17:39:21.617524] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-08T17:39:21.728139] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:39:21.787043] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T17:39:22.281822] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-08T17:39:22.417599] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-08T17:39:23.217595] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-08T17:39:24.017518] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-08T17:39:24.163386] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T17:39:24.801855] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T17:39:24.817500] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-08T17:39:25.288862] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T17:39:25.617541] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-08T17:39:25.924185] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T17:39:26.417591] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-08T17:39:27.217530] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-08T17:39:27.400710] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T17:39:27.600538] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T17:39:28.017570] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-08T17:39:28.221989] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T17:39:28.224986] [INFO ] [REMOTE ] BKH: Full fetch complete (52526 records). [2025-10-08T17:39:28.225107] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-08T17:39:28.606105] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-08T17:39:28.606196] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-08T17:39:28.606815] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-08T17:39:28.606876] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-08T17:39:28.608015] [DEBUG] [LOCAL ] BKH: Trimmed 52526 records to 36923 (keeping 200 days of data) [2025-10-08T17:39:28.821393] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-08T17:39:28.831936] [DEBUG] [LOCAL ] BKH: Primary data saved (36923 records). [2025-10-08T17:39:28.832037] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-08T17:39:28.832117] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 33.7s. Estimated remaining: 4h 43m 58s. Rate: 7.3 symbols/min [2025-10-08T17:39:29.000217] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:29.000393] [DEBUG] [LOCAL ] BKT: No existing data file found in primary storage. [2025-10-08T17:39:29.000429] [WARN ] [MAIN ] BKT: No existing data found, performing full refresh instead. [2025-10-08T17:39:29.000553] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-08T17:39:29.000593] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-08T17:39:29.000633] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-10-08T17:39:29.000704] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-08T17:39:29.356902] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:29.588554] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T17:39:29.617492] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-08T17:39:29.761065] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T17:39:30.212120] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-08T17:39:30.417565] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-08T17:39:31.172224] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T17:39:31.217548] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-08T17:39:32.017614] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-08T17:39:32.122582] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T17:39:32.817614] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-08T17:39:33.178078] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:39:33.617554] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-08T17:39:34.327366] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T17:39:34.417612] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-08T17:39:34.673859] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:39:35.108024] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T17:39:35.217582] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-08T17:39:36.017572] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-08T17:39:36.574795] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T17:39:36.727338] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T17:39:36.817575] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-08T17:39:37.617549] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-08T17:39:38.417532] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-08T17:39:38.790798] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T17:39:39.164324] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T17:39:39.165369] [INFO ] [REMOTE ] BKN: Full fetch complete (11703 records). [2025-10-08T17:39:39.165440] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-08T17:39:39.228077] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-08T17:39:39.585696] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-08T17:39:39.586396] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-08T17:39:39.586900] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-08T17:39:39.587968] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-08T17:39:39.587884] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:39:39.598301] [DEBUG] [LOCAL ] BKN: Trimmed 11703 records to 7681 (keeping 200 days of data) [2025-10-08T17:39:39.648547] [DEBUG] [LOCAL ] BKN: Primary data saved (7681 records). [2025-10-08T17:39:39.648789] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-08T17:39:39.648893] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 26.0s. Estimated remaining: 4h 44m 9s. Rate: 7.3 symbols/min [2025-10-08T17:39:39.766859] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T17:39:39.827769] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:39.872471] [DEBUG] [LOCAL ] BKU: Loaded 41591 existing records from primary storage. [2025-10-08T17:39:39.872831] [INFO ] [MAIN ] BKU: Loaded 41591 existing records. [2025-10-08T17:39:40.022698] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-08T17:39:40.053024] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:40.053274] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-08T17:39:40.053323] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-08T17:39:40.053612] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-08T17:39:40.053699] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-08T17:39:40.429784] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:40.721623] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T17:39:40.817563] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-08T17:39:41.397236] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T17:39:41.617561] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-08T17:39:42.417544] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-08T17:39:43.217592] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-08T17:39:43.726963] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-08T17:39:43.909489] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T17:39:44.017499] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-08T17:39:44.344979] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T17:39:44.739284] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T17:39:44.817559] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-08T17:39:45.617512] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-08T17:39:45.676946] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T17:39:46.417559] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-08T17:39:46.963251] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:39:47.162673] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T17:39:47.217517] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-08T17:39:48.017604] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-08T17:39:48.812019] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T17:39:48.817486] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-08T17:39:49.617555] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-08T17:39:49.780087] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-08T17:39:49.901211] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T17:39:50.417606] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-08T17:39:50.804560] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T17:39:51.217565] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-08T17:39:52.017564] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-08T17:39:52.176517] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T17:39:52.178426] [INFO ] [REMOTE ] BKT: Full fetch complete (15835 records). [2025-10-08T17:39:52.178540] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-08T17:39:52.581510] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-08T17:39:52.581636] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-08T17:39:52.581985] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-08T17:39:52.582028] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-08T17:39:52.582662] [DEBUG] [LOCAL ] BKT: Trimmed 15835 records to 11941 (keeping 200 days of data) [2025-10-08T17:39:52.665111] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-08T17:39:52.695008] [DEBUG] [LOCAL ] BKT: Primary data saved (11941 records). [2025-10-08T17:39:52.695128] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-08T17:39:52.695207] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKT took 23.9s. Estimated remaining: 4h 44m 35s. Rate: 7.3 symbols/min [2025-10-08T17:39:52.833098] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-08T17:39:52.863933] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:52.892062] [DEBUG] [LOCAL ] BKV: Loaded 29802 existing records from primary storage. [2025-10-08T17:39:52.892332] [INFO ] [MAIN ] BKV: Loaded 29802 existing records. [2025-10-08T17:39:53.073946] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:53.074192] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-08T17:39:53.074244] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-08T17:39:53.074421] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-08T17:39:53.074476] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-08T17:39:53.421183] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:53.617492] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-08T17:39:53.894113] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T17:39:54.417517] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-08T17:39:54.697686] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T17:39:55.023555] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:39:55.217602] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-08T17:39:56.017580] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-08T17:39:56.366061] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-08T17:39:56.370975] [INFO ] [REMOTE ] BKKT: Full fetch complete (50619 records). [2025-10-08T17:39:56.371382] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-08T17:39:56.822171] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-08T17:39:56.822594] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-08T17:39:56.823831] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-08T17:39:56.824578] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-08T17:39:56.824666] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-08T17:39:56.826074] [DEBUG] [LOCAL ] BKKT: Trimmed 50619 records to 35721 (keeping 200 days of data) [2025-10-08T17:39:57.038453] [DEBUG] [LOCAL ] BKKT: Primary data saved (35721 records). [2025-10-08T17:39:57.038633] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-08T17:39:57.038762] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKKT took 45.1s. Estimated remaining: 4h 43m 59s. Rate: 7.3 symbols/min [2025-10-08T17:39:57.229384] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-08T17:39:57.232997] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:57.238129] [INFO ] [REMOTE ] BKSY: Full fetch complete (69959 records). [2025-10-08T17:39:57.238256] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-08T17:39:57.518946] [DEBUG] [LOCAL ] BLCO: Loaded 35528 existing records from primary storage. [2025-10-08T17:39:57.556215] [INFO ] [MAIN ] BLCO: Loaded 35528 existing records. [2025-10-08T17:39:57.771103] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T17:39:57.888333] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-08T17:39:57.908889] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-08T17:39:57.917606] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:57.918183] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-08T17:39:57.920848] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-08T17:39:57.919103] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-08T17:39:57.921232] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-08T17:39:57.921139] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-08T17:39:57.922015] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-08T17:39:57.922242] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-08T17:39:58.058185] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T17:39:58.051118] [DEBUG] [LOCAL ] BKSY: Trimmed 69959 records to 48470 (keeping 200 days of data) [2025-10-08T17:39:58.424985] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-08T17:39:58.460677] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:58.685104] [DEBUG] [LOCAL ] BKSY: Primary data saved (48470 records). [2025-10-08T17:39:58.685493] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-08T17:39:58.685691] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 42.2s. Estimated remaining: 4h 43m 5s. Rate: 7.3 symbols/min [2025-10-08T17:39:58.879636] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:58.912328] [DEBUG] [LOCAL ] BLD: Loaded 27585 existing records from primary storage. [2025-10-08T17:39:58.912939] [INFO ] [MAIN ] BLD: Loaded 27585 existing records. [2025-10-08T17:39:59.110240] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:59.110883] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-08T17:39:59.111013] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-08T17:39:59.111294] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-08T17:39:59.111357] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-08T17:39:59.218282] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-08T17:39:59.520169] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:59.547851] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:39:59.590405] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T17:40:00.017608] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-08T17:40:00.550301] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T17:40:00.817558] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-08T17:40:01.390471] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T17:40:01.617546] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-08T17:40:01.965289] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T17:40:02.417562] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-08T17:40:02.957913] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T17:40:03.217556] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-08T17:40:03.654396] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T17:40:04.017555] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-08T17:40:04.638958] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:40:04.817556] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-08T17:40:05.479077] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:40:05.617560] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-08T17:40:06.047712] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T17:40:06.417612] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-08T17:40:06.782914] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T17:40:07.217570] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-08T17:40:07.335981] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:40:08.017581] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-08T17:40:08.538966] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T17:40:08.817574] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-08T17:40:09.418407] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T17:40:09.617570] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-08T17:40:10.417548] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-08T17:40:10.551797] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T17:40:10.889719] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T17:40:11.217575] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-08T17:40:11.807095] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T17:40:12.017611] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-08T17:40:12.823029] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-08T17:40:12.830843] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T17:40:13.479325] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T17:40:13.617578] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-08T17:40:14.083542] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:40:14.417568] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-08T17:40:15.008594] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:40:15.217533] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-08T17:40:15.658099] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T17:40:16.017565] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-08T17:40:16.433708] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:40:16.817570] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-08T17:40:17.202350] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T17:40:17.617557] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-08T17:40:18.185763] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T17:40:18.189407] [INFO ] [REMOTE ] BKU: Full fetch complete (60161 records). [2025-10-08T17:40:18.189500] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-08T17:40:18.421243] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-08T17:40:18.582293] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-08T17:40:18.582437] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-08T17:40:18.583111] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-08T17:40:18.583174] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-08T17:40:18.584361] [DEBUG] [LOCAL ] BKU: Trimmed 60161 records to 41680 (keeping 200 days of data) [2025-10-08T17:40:18.841975] [DEBUG] [LOCAL ] BKU: Primary data saved (41680 records). [2025-10-08T17:40:18.842122] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-08T17:40:18.842217] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKU took 39.2s. Estimated remaining: 4h 44m 21s. Rate: 7.3 symbols/min [2025-10-08T17:40:18.968258] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T17:40:19.048874] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:19.098444] [DEBUG] [LOCAL ] BLDR: Loaded 51691 existing records from primary storage. [2025-10-08T17:40:19.098847] [INFO ] [MAIN ] BLDR: Loaded 51691 existing records. [2025-10-08T17:40:19.222775] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-08T17:40:19.285366] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:19.285586] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-08T17:40:19.285676] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-08T17:40:19.285902] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-08T17:40:19.285960] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-08T17:40:19.659304] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:19.673632] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T17:40:20.017561] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-08T17:40:20.251309] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T17:40:20.817584] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-08T17:40:21.617516] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-08T17:40:21.859356] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T17:40:21.991269] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T17:40:22.417584] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-08T17:40:23.085674] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T17:40:23.217566] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-08T17:40:23.654686] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:40:23.657307] [INFO ] [REMOTE ] BKV: Full fetch complete (44813 records). [2025-10-08T17:40:23.657389] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-08T17:40:24.024881] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-08T17:40:24.024147] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-08T17:40:24.025138] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-08T17:40:24.026319] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-08T17:40:24.026383] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-08T17:40:24.027502] [DEBUG] [LOCAL ] BKV: Trimmed 44813 records to 29885 (keeping 200 days of data) [2025-10-08T17:40:24.213804] [DEBUG] [LOCAL ] BKV: Primary data saved (29885 records). [2025-10-08T17:40:24.213982] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-08T17:40:24.214107] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 31.5s. Estimated remaining: 4h 43m 53s. Rate: 7.3 symbols/min [2025-10-08T17:40:24.398543] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:24.414860] [DEBUG] [LOCAL ] BLE: Loaded 14063 existing records from primary storage. [2025-10-08T17:40:24.415136] [INFO ] [MAIN ] BLE: Loaded 14063 existing records. [2025-10-08T17:40:24.542075] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:40:24.628902] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:24.629183] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-08T17:40:24.629238] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-08T17:40:24.629415] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-08T17:40:24.629471] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-08T17:40:24.827430] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-08T17:40:24.996462] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:25.617602] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-08T17:40:25.675635] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T17:40:26.415409] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:40:26.421515] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-08T17:40:26.750997] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T17:40:27.217594] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-08T17:40:27.323088] [DEBUG] [REMOTE ] BLD: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T17:40:27.323373] [WARN ] [REMOTE ] BLD: No data returned for month 2025-09 [2025-10-08T17:40:27.323462] [FATAL] [REMOTE ] BLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:40:27.323544] [FATAL] [MAIN ] BLD: Failed to fetch primary data. [2025-10-08T17:40:27.323609] [WARN ] [MAIN ] BLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:40:27.323705] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-08T17:40:27.323802] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-08T17:40:27.323871] [INFO ] [LOCAL ] BLD: Starting deletion of derivative data. [2025-10-08T17:40:27.324172] [DEBUG] [LOCAL ] BLD: Deleted derivative data file. [2025-10-08T17:40:27.324272] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLD took 28.6s. Estimated remaining: 4h 43m 9s. Rate: 7.3 symbols/min [2025-10-08T17:40:27.497458] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:27.533820] [DEBUG] [LOCAL ] BLK: Loaded 34141 existing records from primary storage. [2025-10-08T17:40:27.534148] [INFO ] [MAIN ] BLK: Loaded 34141 existing records. [2025-10-08T17:40:27.732247] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:27.732679] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-08T17:40:27.732755] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-08T17:40:27.733057] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-08T17:40:27.733129] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-08T17:40:28.022733] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-08T17:40:28.118043] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:28.154685] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T17:40:28.741449] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T17:40:28.817572] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-08T17:40:29.570542] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T17:40:29.617574] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-08T17:40:30.417573] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-08T17:40:31.217554] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-08T17:40:31.405736] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:40:31.853933] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T17:40:32.017579] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-08T17:40:32.160524] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:40:32.817611] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-08T17:40:33.567687] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:40:33.617502] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-08T17:40:34.238205] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:40:34.417746] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-08T17:40:34.646690] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T17:40:35.217567] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-08T17:40:36.017555] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-08T17:40:36.169247] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:40:36.817508] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-08T17:40:36.850697] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T17:40:37.306759] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-08T17:40:37.617561] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-08T17:40:38.417551] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-08T17:40:38.789372] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:40:38.827678] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T17:40:39.217560] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-08T17:40:40.017524] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-08T17:40:40.083402] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T17:40:40.124676] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T17:40:40.817528] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-08T17:40:41.178291] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T17:40:41.180915] [INFO ] [REMOTE ] BLCO: Full fetch complete (52264 records). [2025-10-08T17:40:41.181003] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-08T17:40:41.557985] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-08T17:40:41.558074] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-08T17:40:41.558694] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-08T17:40:41.558755] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-08T17:40:41.559769] [DEBUG] [LOCAL ] BLCO: Trimmed 52264 records to 35542 (keeping 200 days of data) [2025-10-08T17:40:41.642597] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-08T17:40:41.763340] [DEBUG] [LOCAL ] BLCO: Primary data saved (35542 records). [2025-10-08T17:40:41.763474] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-08T17:40:41.763560] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLCO took 44.7s. Estimated remaining: 4h 43m 44s. Rate: 7.3 symbols/min [2025-10-08T17:40:41.933560] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:41.987019] [DEBUG] [LOCAL ] BLND: Loaded 49214 existing records from primary storage. [2025-10-08T17:40:41.987360] [INFO ] [MAIN ] BLND: Loaded 49214 existing records. [2025-10-08T17:40:42.160982] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:42.161238] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-08T17:40:42.161285] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-08T17:40:42.161504] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-08T17:40:42.161562] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-08T17:40:42.426282] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-08T17:40:42.518629] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:42.683224] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T17:40:43.217611] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-08T17:40:43.449365] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T17:40:43.493712] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:40:44.017693] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-08T17:40:44.731640] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:40:44.806407] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T17:40:44.817501] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-08T17:40:45.617586] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-08T17:40:46.318360] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T17:40:46.355971] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:40:46.417544] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-08T17:40:47.217619] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-08T17:40:47.900275] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T17:40:48.016682] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T17:40:48.019479] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-08T17:40:48.817556] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-08T17:40:49.617565] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-08T17:40:49.800452] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:40:49.801845] [INFO ] [REMOTE ] BLE: Full fetch complete (20099 records). [2025-10-08T17:40:49.801920] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-08T17:40:49.955157] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T17:40:50.198057] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-08T17:40:50.198137] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-08T17:40:50.198542] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-08T17:40:50.198617] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-08T17:40:50.199220] [DEBUG] [LOCAL ] BLE: Trimmed 20099 records to 14063 (keeping 200 days of data) [2025-10-08T17:40:50.283974] [DEBUG] [LOCAL ] BLE: Primary data saved (14063 records). [2025-10-08T17:40:50.284135] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-08T17:40:50.284223] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 26.1s. Estimated remaining: 4h 43m 38s. Rate: 7.3 symbols/min [2025-10-08T17:40:50.425813] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-08T17:40:50.464307] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:50.464585] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-08T17:40:50.464725] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-08T17:40:50.464877] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-08T17:40:50.464949] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-08T17:40:50.465036] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-08T17:40:50.465125] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-08T17:40:50.871834] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:51.086628] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:40:51.217572] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-08T17:40:51.422489] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:40:51.422975] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-08T17:40:51.423077] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:40:51.423127] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-08T17:40:51.423161] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:40:51.423201] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-08T17:40:51.423513] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-08T17:40:51.423793] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-08T17:40:51.423855] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-08T17:40:51.423924] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLSH took 1.1s. Estimated remaining: 4h 42m 41s. Rate: 7.3 symbols/min [2025-10-08T17:40:51.604073] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:51.620379] [DEBUG] [LOCAL ] BLW: Loaded 13323 existing records from primary storage. [2025-10-08T17:40:51.620705] [INFO ] [MAIN ] BLW: Loaded 13323 existing records. [2025-10-08T17:40:51.833440] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:51.833784] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-08T17:40:51.833850] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-08T17:40:51.834111] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-08T17:40:51.834182] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-08T17:40:52.021877] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-08T17:40:52.225305] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:52.462335] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T17:40:52.817562] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-08T17:40:53.617690] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-08T17:40:53.646041] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T17:40:53.700671] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T17:40:54.417577] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-08T17:40:55.217566] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-08T17:40:55.503009] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:40:55.522843] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T17:40:56.017559] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-08T17:40:56.817592] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-08T17:40:56.873524] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T17:40:57.617525] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-08T17:40:57.710535] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T17:40:57.862245] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:40:58.417545] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-08T17:40:59.056538] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T17:40:59.217555] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-08T17:40:59.905197] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T17:40:59.909247] [INFO ] [REMOTE ] BLDR: Full fetch complete (74506 records). [2025-10-08T17:40:59.909366] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-08T17:41:00.022629] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-08T17:41:00.315674] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-08T17:41:00.315786] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-08T17:41:00.316568] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-08T17:41:00.316613] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-08T17:41:00.318223] [DEBUG] [LOCAL ] BLDR: Trimmed 74506 records to 51707 (keeping 200 days of data) [2025-10-08T17:41:00.662292] [DEBUG] [LOCAL ] BLDR: Primary data saved (51707 records). [2025-10-08T17:41:00.662483] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-08T17:41:00.662585] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLDR took 41.8s. Estimated remaining: 4h 42m 40s. Rate: 7.3 symbols/min [2025-10-08T17:41:00.819903] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-08T17:41:00.840390] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:00.863469] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T17:41:00.883989] [DEBUG] [LOCAL ] BLX: Loaded 15607 existing records from primary storage. [2025-10-08T17:41:00.884377] [INFO ] [MAIN ] BLX: Loaded 15607 existing records. [2025-10-08T17:41:01.050469] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T17:41:01.132813] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:01.133049] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-08T17:41:01.133098] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-08T17:41:01.133291] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-08T17:41:01.133349] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-08T17:41:01.510048] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:01.617605] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-08T17:41:02.417578] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-08T17:41:02.573535] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:41:02.749495] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T17:41:03.217589] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-08T17:41:03.734371] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:41:03.737235] [INFO ] [REMOTE ] BLK: Full fetch complete (52504 records). [2025-10-08T17:41:03.737377] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-08T17:41:04.022612] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-08T17:41:04.080933] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:41:04.185687] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-08T17:41:04.185795] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-08T17:41:04.186490] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-08T17:41:04.186534] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-08T17:41:04.187944] [DEBUG] [LOCAL ] BLK: Trimmed 52504 records to 34039 (keeping 200 days of data) [2025-10-08T17:41:04.417796] [DEBUG] [LOCAL ] BLK: Primary data saved (34039 records). [2025-10-08T17:41:04.417956] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-08T17:41:04.418043] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLK took 37.1s. Estimated remaining: 4h 42m 2s. Rate: 7.3 symbols/min [2025-10-08T17:41:04.588240] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:04.639304] [DEBUG] [LOCAL ] BMA: Loaded 35599 existing records from primary storage. [2025-10-08T17:41:04.639623] [INFO ] [MAIN ] BMA: Loaded 35599 existing records. [2025-10-08T17:41:04.831795] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-08T17:41:04.839512] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:04.840070] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-08T17:41:04.840136] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-08T17:41:04.841176] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-08T17:41:04.841237] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-08T17:41:05.359071] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:05.605179] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T17:41:05.620113] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-08T17:41:05.828302] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:41:06.417614] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-08T17:41:06.482112] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T17:41:07.217593] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-08T17:41:08.019816] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-08T17:41:08.025500] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:41:08.419256] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:41:08.817580] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-08T17:41:08.932958] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T17:41:09.617553] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-08T17:41:10.292495] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:41:10.417517] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-08T17:41:10.640694] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T17:41:11.217553] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-08T17:41:11.960216] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T17:41:11.984077] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T17:41:12.017531] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-08T17:41:12.781825] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T17:41:12.817508] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-08T17:41:13.617618] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-08T17:41:13.720163] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T17:41:14.417567] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-08T17:41:14.812436] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T17:41:15.220262] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-08T17:41:15.221467] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T17:41:16.017549] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-08T17:41:16.241984] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T17:41:16.817562] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-08T17:41:17.149880] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T17:41:17.151793] [INFO ] [REMOTE ] BLW: Full fetch complete (19446 records). [2025-10-08T17:41:17.151868] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-08T17:41:17.528574] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-08T17:41:17.528735] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-08T17:41:17.529315] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-08T17:41:17.529505] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-08T17:41:17.540768] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T17:41:17.540975] [DEBUG] [LOCAL ] BLW: Trimmed 19446 records to 13372 (keeping 200 days of data) [2025-10-08T17:41:17.617606] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-08T17:41:17.627760] [DEBUG] [LOCAL ] BLW: Primary data saved (13372 records). [2025-10-08T17:41:17.627859] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-08T17:41:17.627936] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLW took 26.2s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-08T17:41:17.793845] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:17.806569] [DEBUG] [LOCAL ] BME: Loaded 11037 existing records from primary storage. [2025-10-08T17:41:17.806818] [INFO ] [MAIN ] BME: Loaded 11037 existing records. [2025-10-08T17:41:17.983542] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:17.983817] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-08T17:41:17.983874] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-08T17:41:17.984218] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-08T17:41:17.984276] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-08T17:41:18.349809] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:18.420189] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-08T17:41:18.422196] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T17:41:19.217598] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-08T17:41:20.017579] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-08T17:41:20.056146] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:41:20.076484] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T17:41:20.817580] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-08T17:41:21.556296] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:41:21.617547] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-08T17:41:22.417564] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-08T17:41:22.508332] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:41:22.512423] [INFO ] [REMOTE ] BLND: Full fetch complete (72221 records). [2025-10-08T17:41:22.512558] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-08T17:41:22.922880] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-08T17:41:22.923014] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-08T17:41:22.923800] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-08T17:41:22.923948] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-08T17:41:22.944921] [DEBUG] [LOCAL ] BLND: Trimmed 72221 records to 49201 (keeping 200 days of data) [2025-10-08T17:41:22.944784] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T17:41:23.065495] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T17:41:23.225040] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-08T17:41:23.245396] [DEBUG] [LOCAL ] BLND: Primary data saved (49201 records). [2025-10-08T17:41:23.245558] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-08T17:41:23.246382] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLND took 41.5s. Estimated remaining: 4h 42m 2s. Rate: 7.3 symbols/min [2025-10-08T17:41:23.425384] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:23.454264] [DEBUG] [LOCAL ] BMEZ: Loaded 26653 existing records from primary storage. [2025-10-08T17:41:23.454515] [INFO ] [MAIN ] BMEZ: Loaded 26653 existing records. [2025-10-08T17:41:23.643077] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:23.643334] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-08T17:41:23.643383] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-08T17:41:23.643679] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-08T17:41:23.643744] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-08T17:41:24.043266] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:24.031038] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-08T17:41:24.044114] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T17:41:24.817544] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-08T17:41:25.390288] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T17:41:25.600933] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T17:41:25.617522] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-08T17:41:26.417683] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-08T17:41:27.108375] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T17:41:27.217548] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-08T17:41:27.559784] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T17:41:28.017586] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-08T17:41:28.548957] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T17:41:28.817598] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-08T17:41:29.076198] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T17:41:29.617543] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-08T17:41:30.264144] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:41:30.417536] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-08T17:41:30.772620] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T17:41:30.774586] [INFO ] [REMOTE ] BLX: Full fetch complete (22566 records). [2025-10-08T17:41:30.774774] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-08T17:41:31.178364] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T17:41:31.178012] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-08T17:41:31.178559] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-08T17:41:31.182096] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-08T17:41:31.182503] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-08T17:41:31.183264] [DEBUG] [LOCAL ] BLX: Trimmed 22566 records to 15620 (keeping 200 days of data) [2025-10-08T17:41:31.230834] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-08T17:41:31.294882] [DEBUG] [LOCAL ] BLX: Primary data saved (15620 records). [2025-10-08T17:41:31.295078] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-08T17:41:31.295186] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 30.6s. Estimated remaining: 4h 41m 53s. Rate: 7.3 symbols/min [2025-10-08T17:41:31.481617] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:31.507777] [DEBUG] [LOCAL ] BMI: Loaded 24368 existing records from primary storage. [2025-10-08T17:41:31.508108] [INFO ] [MAIN ] BMI: Loaded 24368 existing records. [2025-10-08T17:41:31.694985] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:31.695247] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-08T17:41:31.695302] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-08T17:41:31.695527] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-08T17:41:31.695584] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-08T17:41:32.022187] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-08T17:41:32.081384] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:32.090699] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T17:41:32.817583] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-08T17:41:33.300462] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:41:33.573898] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T17:41:33.617607] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-08T17:41:34.417566] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-08T17:41:34.833708] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T17:41:35.217580] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-08T17:41:35.352680] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T17:41:35.973532] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T17:41:36.017555] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-08T17:41:36.817582] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-08T17:41:37.617835] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-08T17:41:37.617763] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T17:41:38.161899] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:41:38.417529] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-08T17:41:38.550356] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T17:41:39.211947] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T17:41:39.217492] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-08T17:41:40.017542] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-08T17:41:40.145926] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T17:41:40.817561] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-08T17:41:41.072779] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:41:41.617524] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-08T17:41:41.987000] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T17:41:42.417563] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-08T17:41:42.667405] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T17:41:43.217583] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-08T17:41:43.888117] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:41:44.017555] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-08T17:41:44.376550] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:41:44.817583] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-08T17:41:45.350249] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:41:45.617592] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-08T17:41:45.986695] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:41:46.401023] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T17:41:46.417510] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-08T17:41:47.217568] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-08T17:41:47.311574] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T17:41:47.313044] [INFO ] [REMOTE ] BME: Full fetch complete (16032 records). [2025-10-08T17:41:47.313137] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-08T17:41:47.677411] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-08T17:41:47.677497] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-08T17:41:47.677908] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-08T17:41:47.677972] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-08T17:41:47.678524] [DEBUG] [LOCAL ] BME: Trimmed 16032 records to 11075 (keeping 200 days of data) [2025-10-08T17:41:47.749478] [DEBUG] [LOCAL ] BME: Primary data saved (11075 records). [2025-10-08T17:41:47.749626] [INFO ] [MAIN ] BME: Full history saved. [2025-10-08T17:41:47.749759] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BME took 30.1s. Estimated remaining: 4h 42m 41s. Rate: 7.3 symbols/min [2025-10-08T17:41:47.926329] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:47.931582] [DEBUG] [LOCAL ] BMN: Loaded 2582 existing records from primary storage. [2025-10-08T17:41:47.931789] [INFO ] [MAIN ] BMN: Loaded 2582 existing records. [2025-10-08T17:41:48.022634] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-08T17:41:48.117637] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:48.117912] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-08T17:41:48.118046] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-08T17:41:48.118288] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-08T17:41:48.118358] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-08T17:41:48.489927] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:48.754893] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:41:48.817516] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-08T17:41:49.145615] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T17:41:49.617507] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-08T17:41:49.642362] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T17:41:50.417551] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-08T17:41:51.192314] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T17:41:51.195496] [INFO ] [REMOTE ] BMA: Full fetch complete (51400 records). [2025-10-08T17:41:51.195600] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-08T17:41:51.226562] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-08T17:41:51.582955] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-08T17:41:51.583051] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-08T17:41:51.583681] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-08T17:41:51.583745] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-08T17:41:51.584998] [DEBUG] [LOCAL ] BMA: Trimmed 51400 records to 35575 (keeping 200 days of data) [2025-10-08T17:41:51.697594] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T17:41:51.832152] [DEBUG] [LOCAL ] BMA: Primary data saved (35575 records). [2025-10-08T17:41:51.832323] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-08T17:41:51.832426] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BMA took 47.4s. Estimated remaining: 4h 42m 5s. Rate: 7.3 symbols/min [2025-10-08T17:41:51.944824] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T17:41:52.022157] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-08T17:41:52.022075] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:52.070349] [DEBUG] [LOCAL ] BMO: Loaded 41146 existing records from primary storage. [2025-10-08T17:41:52.070699] [INFO ] [MAIN ] BMO: Loaded 41146 existing records. [2025-10-08T17:41:52.254849] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:52.255111] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-08T17:41:52.255175] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-08T17:41:52.255435] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-08T17:41:52.255513] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-08T17:41:52.553605] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T17:41:52.632178] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:52.817554] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-08T17:41:53.227058] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T17:41:53.617559] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-08T17:41:54.050743] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-08T17:41:54.417569] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-08T17:41:55.217583] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-08T17:41:55.700057] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:41:56.017505] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-08T17:41:56.089441] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:41:56.558577] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T17:41:56.817733] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-08T17:41:57.617636] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-08T17:41:57.840335] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T17:41:58.089685] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T17:41:58.417553] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-08T17:41:58.797877] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T17:41:59.217576] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-08T17:42:00.017618] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-08T17:42:00.466866] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T17:42:00.470516] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40788 records). [2025-10-08T17:42:00.470709] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-08T17:42:00.818914] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-08T17:42:00.852477] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-08T17:42:00.852570] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-08T17:42:00.853273] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-08T17:42:00.853339] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-08T17:42:00.854339] [DEBUG] [LOCAL ] BMEZ: Trimmed 40788 records to 26610 (keeping 200 days of data) [2025-10-08T17:42:01.019573] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26610 records). [2025-10-08T17:42:01.019746] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-08T17:42:01.019840] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 37.8s. Estimated remaining: 4h 42m 3s. Rate: 7.3 symbols/min [2025-10-08T17:42:01.196557] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:01.250250] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-08T17:42:01.250587] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-08T17:42:01.437056] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T17:42:01.442437] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:01.445009] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-08T17:42:01.445086] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-08T17:42:01.445307] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-08T17:42:01.445365] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-08T17:42:01.618376] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-08T17:42:01.806504] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:01.840866] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T17:42:02.281353] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T17:42:02.417611] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-08T17:42:03.217618] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-08T17:42:03.635946] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T17:42:03.893369] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T17:42:04.017547] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-08T17:42:04.817606] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-08T17:42:05.453957] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T17:42:05.617588] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-08T17:42:06.060042] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T17:42:06.417608] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-08T17:42:06.976192] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T17:42:06.977025] [INFO ] [REMOTE ] BMN: Full fetch complete (3716 records). [2025-10-08T17:42:06.977095] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-08T17:42:07.229686] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-08T17:42:07.404058] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-08T17:42:07.404171] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-08T17:42:07.404354] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-08T17:42:07.404441] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-08T17:42:07.405038] [DEBUG] [LOCAL ] BMN: Trimmed 3716 records to 2586 (keeping 200 days of data) [2025-10-08T17:42:07.424223] [DEBUG] [LOCAL ] BMN: Primary data saved (2586 records). [2025-10-08T17:42:07.424426] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-08T17:42:07.424569] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 19.7s. Estimated remaining: 4h 41m 43s. Rate: 7.3 symbols/min [2025-10-08T17:42:07.603028] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:07.699898] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-08T17:42:07.712820] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-08T17:42:07.714142] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-10-08T17:42:07.907886] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:07.908162] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-08T17:42:07.908215] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-08T17:42:07.908525] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-08T17:42:07.908586] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-08T17:42:08.022681] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-08T17:42:08.259198] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:08.817543] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-08T17:42:09.009790] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T17:42:09.617531] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-08T17:42:09.730607] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:42:10.417516] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-08T17:42:10.515491] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:42:10.978372] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T17:42:11.217568] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-08T17:42:12.017549] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-08T17:42:12.170473] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:42:12.364947] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:42:12.367014] [INFO ] [REMOTE ] BMI: Full fetch complete (33019 records). [2025-10-08T17:42:12.367094] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-08T17:42:12.743061] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-08T17:42:12.743162] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-08T17:42:12.743687] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-08T17:42:12.743750] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-08T17:42:12.744518] [DEBUG] [LOCAL ] BMI: Trimmed 33019 records to 24334 (keeping 200 days of data) [2025-10-08T17:42:12.836868] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-08T17:42:12.898986] [DEBUG] [LOCAL ] BMI: Primary data saved (24334 records). [2025-10-08T17:42:12.899119] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-08T17:42:12.899214] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMI took 41.6s. Estimated remaining: 4h 41m 17s. Rate: 7.3 symbols/min [2025-10-08T17:42:13.067210] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:13.095086] [DEBUG] [LOCAL ] BNED: Loaded 29337 existing records from primary storage. [2025-10-08T17:42:13.095389] [INFO ] [MAIN ] BNED: Loaded 29337 existing records. [2025-10-08T17:42:13.275994] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:13.276241] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-08T17:42:13.276319] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-08T17:42:13.276585] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-08T17:42:13.276687] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-08T17:42:13.620081] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-08T17:42:13.646172] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:13.879598] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T17:42:14.220680] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:42:14.417606] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-08T17:42:15.217550] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-08T17:42:15.246585] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T17:42:15.975777] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:42:16.017586] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-08T17:42:16.817527] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-08T17:42:17.352308] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T17:42:17.432057] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:42:17.617564] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-08T17:42:17.815313] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T17:42:18.417596] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-08T17:42:18.923127] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T17:42:19.217605] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-08T17:42:19.721805] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:42:20.017599] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-08T17:42:20.817563] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-08T17:42:21.266567] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T17:42:21.539754] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T17:42:21.617559] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-08T17:42:22.114132] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:42:22.417572] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-08T17:42:23.217601] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-08T17:42:23.598955] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T17:42:24.017859] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-08T17:42:24.093858] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T17:42:24.587633] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:42:24.817570] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-08T17:42:25.617616] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-08T17:42:25.953078] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T17:42:26.234307] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:42:26.417545] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-08T17:42:26.945339] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T17:42:27.217555] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-08T17:42:28.017731] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-08T17:42:28.183681] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:42:28.817534] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-08T17:42:28.860978] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T17:42:28.923128] [DEBUG] [REMOTE ] BN: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-08T17:42:28.923443] [WARN ] [REMOTE ] BN: No data returned for month 2025-06 [2025-10-08T17:42:28.923537] [FATAL] [REMOTE ] BN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:42:28.923611] [FATAL] [MAIN ] BN: Failed to fetch primary data. [2025-10-08T17:42:28.923711] [WARN ] [MAIN ] BN: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:42:28.923787] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-08T17:42:28.923893] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-08T17:42:28.923949] [INFO ] [LOCAL ] BN: Starting deletion of derivative data. [2025-10-08T17:42:28.924206] [DEBUG] [LOCAL ] BN: Deleted derivative data file. [2025-10-08T17:42:28.924294] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BN took 21.5s. Estimated remaining: 4h 42m 1s. Rate: 7.3 symbols/min [2025-10-08T17:42:29.103310] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:29.126408] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T17:42:29.141431] [DEBUG] [LOCAL ] BNH: Loaded 5256 existing records from primary storage. [2025-10-08T17:42:29.141745] [INFO ] [MAIN ] BNH: Loaded 5256 existing records. [2025-10-08T17:42:29.318560] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:29.318814] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-08T17:42:29.318885] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-08T17:42:29.319100] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-08T17:42:29.319158] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-08T17:42:29.622916] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-08T17:42:29.683041] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:30.417586] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-08T17:42:31.151165] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:42:31.217534] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-08T17:42:31.307495] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:42:31.310751] [INFO ] [REMOTE ] BMO: Full fetch complete (59697 records). [2025-10-08T17:42:31.310844] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-08T17:42:31.699776] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-08T17:42:31.699901] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-08T17:42:31.700609] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-08T17:42:31.700680] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-08T17:42:31.701968] [DEBUG] [LOCAL ] BMO: Trimmed 59697 records to 41139 (keeping 200 days of data) [2025-10-08T17:42:31.799511] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T17:42:31.975892] [DEBUG] [LOCAL ] BMO: Primary data saved (41139 records). [2025-10-08T17:42:31.976027] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-08T17:42:31.976121] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMO took 40.1s. Estimated remaining: 4h 41m 18s. Rate: 7.3 symbols/min [2025-10-08T17:42:32.022680] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-08T17:42:32.149153] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:32.154220] [DEBUG] [LOCAL ] BNJ: Loaded 2661 existing records from primary storage. [2025-10-08T17:42:32.154394] [INFO ] [MAIN ] BNJ: Loaded 2661 existing records. [2025-10-08T17:42:32.332254] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:32.332513] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-08T17:42:32.332568] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-08T17:42:32.332758] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-08T17:42:32.332817] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-08T17:42:32.435972] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T17:42:32.691382] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:32.817519] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-08T17:42:33.366106] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T17:42:33.617594] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-08T17:42:34.215466] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T17:42:34.417602] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-08T17:42:35.217600] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-08T17:42:35.534623] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T17:42:35.773151] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:42:36.017541] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-08T17:42:36.817531] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-08T17:42:37.207347] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T17:42:37.617571] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-08T17:42:38.369169] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T17:42:38.417570] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-08T17:42:38.715671] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:42:38.899180] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T17:42:39.217605] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-08T17:42:40.017568] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-08T17:42:40.817582] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-08T17:42:41.084779] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T17:42:41.136322] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T17:42:41.488973] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T17:42:41.617583] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-08T17:42:42.181056] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T17:42:42.417588] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-08T17:42:43.217573] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-08T17:42:44.017518] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-08T17:42:44.101560] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T17:42:44.106086] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-08T17:42:44.106258] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-08T17:42:44.562557] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-08T17:42:44.563296] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-08T17:42:44.565095] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-08T17:42:44.564209] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-08T17:42:44.565244] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-08T17:42:44.573481] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-10-08T17:42:44.810262] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:42:44.817540] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-08T17:42:44.924057] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-08T17:42:44.924282] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-08T17:42:44.924867] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BMY took 43.9s. Estimated remaining: 4h 41m 42s. Rate: 7.3 symbols/min [2025-10-08T17:42:45.104418] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:45.167612] [DEBUG] [LOCAL ] BNL: Loaded 47159 existing records from primary storage. [2025-10-08T17:42:45.168019] [INFO ] [MAIN ] BNL: Loaded 47159 existing records. [2025-10-08T17:42:45.347362] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:45.347593] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-08T17:42:45.347697] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-08T17:42:45.347997] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-08T17:42:45.348070] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-08T17:42:45.622705] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-08T17:42:45.725136] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:45.826896] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T17:42:46.230890] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:42:46.417552] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-08T17:42:47.217560] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-08T17:42:47.510013] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:42:47.513019] [INFO ] [REMOTE ] BNED: Full fetch complete (43294 records). [2025-10-08T17:42:47.513149] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-08T17:42:47.640243] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T17:42:47.915850] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-08T17:42:47.915949] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-08T17:42:47.916480] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-08T17:42:47.916532] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-08T17:42:47.917705] [DEBUG] [LOCAL ] BNED: Trimmed 43294 records to 29154 (keeping 200 days of data) [2025-10-08T17:42:48.017633] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-08T17:42:48.088101] [DEBUG] [LOCAL ] BNED: Primary data saved (29154 records). [2025-10-08T17:42:48.088259] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-08T17:42:48.088347] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BNED took 35.2s. Estimated remaining: 4h 41m 0s. Rate: 7.3 symbols/min [2025-10-08T17:42:48.260134] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:48.317845] [DEBUG] [LOCAL ] BNS: Loaded 51478 existing records from primary storage. [2025-10-08T17:42:48.318278] [INFO ] [MAIN ] BNS: Loaded 51478 existing records. [2025-10-08T17:42:48.536617] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:48.536935] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-08T17:42:48.536994] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-08T17:42:48.537289] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-08T17:42:48.537353] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-08T17:42:48.822718] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-08T17:42:48.895689] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:49.589520] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:42:49.617569] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-08T17:42:49.723444] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T17:42:50.417560] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-08T17:42:51.015580] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T17:42:51.017713] [INFO ] [REMOTE ] BNH: Full fetch complete (6960 records). [2025-10-08T17:42:51.017968] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-08T17:42:51.218764] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-08T17:42:51.425436] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-08T17:42:51.425539] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-08T17:42:51.425774] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-08T17:42:51.425952] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-08T17:42:51.426576] [DEBUG] [LOCAL ] BNH: Trimmed 6960 records to 5238 (keeping 200 days of data) [2025-10-08T17:42:51.487745] [DEBUG] [LOCAL ] BNH: Primary data saved (5238 records). [2025-10-08T17:42:51.487959] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-08T17:42:51.488092] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNH took 22.6s. Estimated remaining: 4h 40m 21s. Rate: 7.3 symbols/min [2025-10-08T17:42:51.565668] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T17:42:51.680191] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:51.686280] [DEBUG] [LOCAL ] BNT: Loaded 3349 existing records from primary storage. [2025-10-08T17:42:51.686468] [INFO ] [MAIN ] BNT: Loaded 3349 existing records. [2025-10-08T17:42:51.881669] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:51.882028] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-08T17:42:51.882101] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-08T17:42:51.885792] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-08T17:42:51.885754] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T17:42:51.885948] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-08T17:42:52.027763] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-08T17:42:52.259598] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:52.817607] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-08T17:42:53.359293] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T17:42:53.617565] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-08T17:42:54.417588] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-08T17:42:54.496688] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T17:42:55.064998] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T17:42:55.092017] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:42:55.217562] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-08T17:42:55.638125] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-08T17:42:56.017588] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-08T17:42:56.476420] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:42:56.817623] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-08T17:42:57.617633] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-08T17:42:58.072758] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T17:42:58.417525] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-08T17:42:58.521854] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:42:59.217540] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-08T17:43:00.017598] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-08T17:43:00.261999] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T17:43:00.798549] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T17:43:00.817554] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-08T17:43:01.008867] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:43:01.249383] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T17:43:01.617617] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-08T17:43:02.184967] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T17:43:02.417618] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-08T17:43:02.961533] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T17:43:03.217604] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-08T17:43:04.017554] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-08T17:43:04.817620] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-08T17:43:05.039011] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T17:43:05.251792] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:43:05.612983] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T17:43:05.617489] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-08T17:43:06.176212] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:43:06.417559] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-08T17:43:07.217597] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-08T17:43:07.794069] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T17:43:08.017548] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-08T17:43:08.069879] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T17:43:08.817608] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-08T17:43:09.597781] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T17:43:09.617519] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-08T17:43:10.426105] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-08T17:43:10.433372] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T17:43:11.070630] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T17:43:11.173620] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T17:43:11.174479] [INFO ] [REMOTE ] BNJ: Full fetch complete (4234 records). [2025-10-08T17:43:11.174548] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-08T17:43:11.227857] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-08T17:43:11.544763] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-08T17:43:11.544845] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-08T17:43:11.544978] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-08T17:43:11.545021] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-08T17:43:11.545371] [DEBUG] [LOCAL ] BNJ: Trimmed 4234 records to 2673 (keeping 200 days of data) [2025-10-08T17:43:11.563905] [DEBUG] [LOCAL ] BNJ: Primary data saved (2673 records). [2025-10-08T17:43:11.564050] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-08T17:43:11.564141] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 39.6s. Estimated remaining: 4h 41m 30s. Rate: 7.3 symbols/min [2025-10-08T17:43:11.740840] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:11.750265] [DEBUG] [LOCAL ] BNY: Loaded 7242 existing records from primary storage. [2025-10-08T17:43:11.750514] [INFO ] [MAIN ] BNY: Loaded 7242 existing records. [2025-10-08T17:43:11.931736] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:11.931955] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-08T17:43:11.932001] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-08T17:43:11.932155] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-08T17:43:11.932193] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-08T17:43:12.023420] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-08T17:43:12.307479] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:12.472469] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T17:43:12.750059] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T17:43:12.817616] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-08T17:43:13.617557] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-08T17:43:14.309265] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T17:43:14.417531] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-08T17:43:15.217551] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-08T17:43:15.343033] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T17:43:15.693935] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T17:43:16.017586] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-08T17:43:16.330568] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T17:43:16.356060] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T17:43:16.817573] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-08T17:43:17.617614] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-08T17:43:18.367496] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T17:43:18.371268] [INFO ] [REMOTE ] BNS: Full fetch complete (73977 records). [2025-10-08T17:43:18.371386] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-08T17:43:18.372217] [FATAL] [VALIDATOR ] BNS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:43:18.372363] [FATAL] [MAIN ] BNS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:43:18.372408] [WARN ] [MAIN ] BNS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:43:18.372447] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-08T17:43:18.372505] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-10-08T17:43:18.372539] [INFO ] [LOCAL ] BNS: Starting deletion of derivative data. [2025-10-08T17:43:18.372844] [DEBUG] [LOCAL ] BNS: Deleted derivative data file. [2025-10-08T17:43:18.372939] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNS took 30.3s. Estimated remaining: 4h 41m 13s. Rate: 7.3 symbols/min [2025-10-08T17:43:18.428737] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-08T17:43:18.579871] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:18.598218] [DEBUG] [LOCAL ] BOC: Loaded 18321 existing records from primary storage. [2025-10-08T17:43:18.598461] [INFO ] [MAIN ] BOC: Loaded 18321 existing records. [2025-10-08T17:43:18.774903] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:18.775308] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-08T17:43:18.775356] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-08T17:43:18.775599] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-08T17:43:18.775690] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-08T17:43:19.148390] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:19.189526] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T17:43:19.217508] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-08T17:43:19.265735] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:43:20.017568] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-08T17:43:20.246443] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:43:20.755871] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T17:43:20.817583] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-08T17:43:21.617557] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-08T17:43:22.149120] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T17:43:22.150041] [INFO ] [REMOTE ] BNT: Full fetch complete (4522 records). [2025-10-08T17:43:22.150111] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-08T17:43:22.427853] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-08T17:43:22.556327] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-08T17:43:22.556502] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-08T17:43:22.556747] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-08T17:43:22.556907] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-08T17:43:22.557858] [DEBUG] [LOCAL ] BNT: Trimmed 4522 records to 3347 (keeping 200 days of data) [2025-10-08T17:43:22.605699] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T17:43:22.621270] [DEBUG] [LOCAL ] BNT: Primary data saved (3347 records). [2025-10-08T17:43:22.621388] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-08T17:43:22.621480] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 31.1s. Estimated remaining: 4h 40m 39s. Rate: 7.3 symbols/min [2025-10-08T17:43:23.217501] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-08T17:43:23.304921] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T17:43:23.827705] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T17:43:24.017605] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-08T17:43:24.817598] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-08T17:43:25.400438] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T17:43:25.487734] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T17:43:25.491494] [INFO ] [REMOTE ] BNL: Full fetch complete (67123 records). [2025-10-08T17:43:25.491594] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-08T17:43:25.630998] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-08T17:43:25.886925] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-08T17:43:25.887105] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-08T17:43:25.888019] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-08T17:43:25.888094] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-08T17:43:25.889770] [DEBUG] [LOCAL ] BNL: Trimmed 67123 records to 47176 (keeping 200 days of data) [2025-10-08T17:43:26.199059] [DEBUG] [LOCAL ] BNL: Primary data saved (47176 records). [2025-10-08T17:43:26.199225] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-08T17:43:26.199332] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNL took 41.3s. Estimated remaining: 4h 40m 1s. Rate: 7.3 symbols/min [2025-10-08T17:43:26.417561] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-08T17:43:26.536186] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:43:27.217598] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-08T17:43:27.314829] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T17:43:28.017611] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-08T17:43:28.461000] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T17:43:28.734595] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T17:43:28.817567] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-08T17:43:29.617561] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-08T17:43:29.850807] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T17:43:30.417572] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-08T17:43:30.577354] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T17:43:31.217524] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-08T17:43:31.395067] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:43:31.616960] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T17:43:32.017548] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-08T17:43:32.817603] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-08T17:43:32.968892] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T17:43:33.522162] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T17:43:33.617537] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-08T17:43:34.384019] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T17:43:34.417493] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-08T17:43:35.217525] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-08T17:43:35.295599] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T17:43:36.017572] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-08T17:43:36.135399] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T17:43:36.799388] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T17:43:36.800841] [INFO ] [REMOTE ] BNY: Full fetch complete (10542 records). [2025-10-08T17:43:36.800914] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-08T17:43:36.836139] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-08T17:43:37.179250] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-08T17:43:37.179333] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-08T17:43:37.179599] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-08T17:43:37.179637] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-08T17:43:37.180182] [DEBUG] [LOCAL ] BNY: Trimmed 10542 records to 7144 (keeping 200 days of data) [2025-10-08T17:43:37.223612] [DEBUG] [LOCAL ] BNY: Primary data saved (7144 records). [2025-10-08T17:43:37.223796] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-08T17:43:37.223886] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNY took 25.7s. Estimated remaining: 4h 40m 11s. Rate: 7.3 symbols/min [2025-10-08T17:43:37.819795] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T17:43:37.824873] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-08T17:43:38.735796] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T17:43:38.740379] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-08T17:43:39.586592] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T17:43:39.588434] [INFO ] [REMOTE ] BOC: Full fetch complete (25706 records). [2025-10-08T17:43:39.588552] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-08T17:43:39.964998] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-08T17:43:39.965093] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-08T17:43:39.965579] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-08T17:43:39.965665] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-08T17:43:39.966412] [DEBUG] [LOCAL ] BOC: Trimmed 25706 records to 18353 (keeping 200 days of data) [2025-10-08T17:43:40.091141] [DEBUG] [LOCAL ] BOC: Primary data saved (18353 records). [2025-10-08T17:43:40.091626] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-08T17:43:40.091769] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 21.7s. Estimated remaining: 4h 39m 29s. Rate: 7.3 symbols/min [2025-10-08T17:43:40.735624] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:40.798574] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:40.860351] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:40.869144] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-10-08T17:43:40.869254] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-10-08T17:43:40.895076] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:40.895255] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-08T17:43:40.895335] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-08T17:43:40.895882] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-08T17:43:40.896166] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-08T17:43:41.139684] [DEBUG] [LOCAL ] BOH: Loaded 30506 existing records from primary storage. [2025-10-08T17:43:41.149529] [INFO ] [MAIN ] BOH: Loaded 30506 existing records. [2025-10-08T17:43:41.146610] [DEBUG] [LOCAL ] BOND: Loaded 32226 existing records from primary storage. [2025-10-08T17:43:41.147517] [DEBUG] [LOCAL ] BOOT: Loaded 40234 existing records from primary storage. [2025-10-08T17:43:41.202070] [INFO ] [MAIN ] BOOT: Loaded 40234 existing records. [2025-10-08T17:43:41.202456] [INFO ] [MAIN ] BOND: Loaded 32226 existing records. [2025-10-08T17:43:41.868802] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:41.943235] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-08T17:43:41.952241] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:41.972983] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-08T17:43:41.972776] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:41.998362] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-08T17:43:41.998077] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:41.999099] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-08T17:43:41.999035] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-08T17:43:41.999172] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-08T17:43:41.999310] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-08T17:43:41.999278] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-08T17:43:41.999476] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-08T17:43:42.004970] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-08T17:43:42.012123] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-08T17:43:42.012285] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-08T17:43:42.037332] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-08T17:43:43.088148] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:43.113131] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-08T17:43:43.209902] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:43.248118] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-08T17:43:43.253790] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:43.254410] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-08T17:43:43.270451] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T17:43:43.275697] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-08T17:43:44.391134] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:43:44.396190] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-08T17:43:44.489824] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:43:44.496300] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-08T17:43:44.603924] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:43:44.605439] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T17:43:44.817576] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-08T17:43:45.028000] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T17:43:45.617551] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-08T17:43:45.678276] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T17:43:46.364947] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T17:43:46.417517] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-08T17:43:46.447594] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T17:43:47.217628] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-08T17:43:47.775072] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:43:48.017586] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-08T17:43:48.426028] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:43:48.817520] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-08T17:43:49.052860] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T17:43:49.617564] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-08T17:43:50.159396] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:43:50.417558] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-08T17:43:51.052084] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:43:51.217589] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-08T17:43:51.654496] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T17:43:51.818198] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T17:43:52.017591] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-08T17:43:52.817602] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-08T17:43:53.622744] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-08T17:43:53.645035] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T17:43:53.675683] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T17:43:54.417564] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-08T17:43:55.034959] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T17:43:55.217549] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-08T17:43:56.017586] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-08T17:43:56.178621] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T17:43:56.344504] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T17:43:56.817544] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-08T17:43:56.843612] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T17:43:57.617571] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-08T17:43:58.134034] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T17:43:58.417595] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-08T17:43:58.526742] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T17:43:59.217707] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-08T17:43:59.723205] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T17:44:00.017613] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-08T17:44:00.572750] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T17:44:00.817600] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-08T17:44:01.301704] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T17:44:01.617607] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-08T17:44:02.005485] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T17:44:02.417582] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-08T17:44:03.120214] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T17:44:03.217565] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-08T17:44:03.813799] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:44:04.017570] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-08T17:44:04.322199] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T17:44:04.817718] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-08T17:44:05.435405] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T17:44:05.617703] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-08T17:44:05.993630] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T17:44:06.417560] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-08T17:44:06.741782] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T17:44:06.743931] [INFO ] [REMOTE ] BOE: Full fetch complete (26747 records). [2025-10-08T17:44:06.744066] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-08T17:44:07.214332] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-08T17:44:07.214459] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-08T17:44:07.215135] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-08T17:44:07.215232] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-08T17:44:07.216232] [DEBUG] [LOCAL ] BOE: Trimmed 26747 records to 18088 (keeping 200 days of data) [2025-10-08T17:44:07.217577] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-08T17:44:07.342115] [DEBUG] [LOCAL ] BOE: Primary data saved (18088 records). [2025-10-08T17:44:07.342283] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-08T17:44:07.342366] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOE took 27.2s. Estimated remaining: 4h 41m 22s. Rate: 7.3 symbols/min [2025-10-08T17:44:07.568868] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:07.628915] [DEBUG] [LOCAL ] BORR: Loaded 51100 existing records from primary storage. [2025-10-08T17:44:07.629364] [INFO ] [MAIN ] BORR: Loaded 51100 existing records. [2025-10-08T17:44:07.849249] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:07.849704] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-08T17:44:07.849794] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-08T17:44:07.850214] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-08T17:44:07.850270] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-08T17:44:08.022715] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-08T17:44:08.254669] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:44:08.274295] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:08.312770] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T17:44:08.817605] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-08T17:44:09.489258] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T17:44:09.617609] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-08T17:44:10.181980] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T17:44:10.184884] [INFO ] [REMOTE ] BOOT: Full fetch complete (60054 records). [2025-10-08T17:44:10.185007] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-08T17:44:10.422731] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-08T17:44:10.578762] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-08T17:44:10.578866] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-08T17:44:10.579601] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-08T17:44:10.579666] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-08T17:44:10.581095] [DEBUG] [LOCAL ] BOOT: Trimmed 60054 records to 40139 (keeping 200 days of data) [2025-10-08T17:44:10.827536] [DEBUG] [LOCAL ] BOOT: Primary data saved (40139 records). [2025-10-08T17:44:10.827693] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-08T17:44:10.827813] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOOT took 30.7s. Estimated remaining: 4h 40m 44s. Rate: 7.3 symbols/min [2025-10-08T17:44:10.994707] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:11.018783] [DEBUG] [LOCAL ] BOW: Loaded 23806 existing records from primary storage. [2025-10-08T17:44:11.019059] [INFO ] [MAIN ] BOW: Loaded 23806 existing records. [2025-10-08T17:44:11.197010] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:11.197271] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-08T17:44:11.197357] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-08T17:44:11.197638] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-08T17:44:11.197727] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-08T17:44:11.229841] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-08T17:44:11.571460] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:11.781710] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T17:44:11.963104] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T17:44:12.017528] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-08T17:44:12.593894] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T17:44:12.817540] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-08T17:44:13.335400] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T17:44:13.617628] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-08T17:44:13.965773] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T17:44:14.417708] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-08T17:44:15.217558] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-08T17:44:15.313400] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T17:44:15.516472] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T17:44:16.017789] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-08T17:44:16.699030] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T17:44:16.817512] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-08T17:44:16.918164] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T17:44:17.617579] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-08T17:44:18.043948] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T17:44:18.417725] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-08T17:44:18.629069] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:44:18.633182] [INFO ] [REMOTE ] BOND: Full fetch complete (46475 records). [2025-10-08T17:44:18.633356] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-08T17:44:19.071060] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-08T17:44:19.071144] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-08T17:44:19.071740] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-08T17:44:19.071805] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-08T17:44:19.072865] [DEBUG] [LOCAL ] BOND: Trimmed 46475 records to 32252 (keeping 200 days of data) [2025-10-08T17:44:19.237714] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-08T17:44:19.284969] [DEBUG] [LOCAL ] BOND: Primary data saved (32252 records). [2025-10-08T17:44:19.285095] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-08T17:44:19.285176] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 39.2s. Estimated remaining: 4h 40m 37s. Rate: 7.3 symbols/min [2025-10-08T17:44:19.464857] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:19.465094] [DEBUG] [LOCAL ] BOX: No existing data file found in primary storage. [2025-10-08T17:44:19.465145] [WARN ] [MAIN ] BOX: No existing data found, performing full refresh instead. [2025-10-08T17:44:19.465260] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-08T17:44:19.465318] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-08T17:44:19.465426] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-08T17:44:19.465477] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-08T17:44:19.849929] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:20.017542] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-08T17:44:20.134073] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T17:44:20.300846] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:44:20.817577] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-08T17:44:21.288526] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:44:21.291915] [INFO ] [REMOTE ] BOH: Full fetch complete (44722 records). [2025-10-08T17:44:21.292144] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-08T17:44:21.622938] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-08T17:44:21.716118] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-08T17:44:21.716277] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-08T17:44:21.717067] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-08T17:44:21.717152] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-08T17:44:21.718513] [DEBUG] [LOCAL ] BOH: Trimmed 44722 records to 30374 (keeping 200 days of data) [2025-10-08T17:44:21.847455] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T17:44:21.941250] [DEBUG] [LOCAL ] BOH: Primary data saved (30374 records). [2025-10-08T17:44:21.941427] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-08T17:44:21.941519] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOH took 41.8s. Estimated remaining: 4h 39m 54s. Rate: 7.3 symbols/min [2025-10-08T17:44:22.118702] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:22.172273] [DEBUG] [LOCAL ] BP: Loaded 53709 existing records from primary storage. [2025-10-08T17:44:22.172682] [INFO ] [MAIN ] BP: Loaded 53709 existing records. [2025-10-08T17:44:22.359740] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:22.359997] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-08T17:44:22.360046] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-08T17:44:22.360333] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-08T17:44:22.360392] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-08T17:44:22.422834] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-08T17:44:22.740854] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:23.217561] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-08T17:44:23.582705] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T17:44:24.017719] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-08T17:44:24.303727] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T17:44:24.817613] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-08T17:44:25.463423] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-08T17:44:25.505091] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T17:44:25.617588] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-08T17:44:25.724423] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T17:44:26.417566] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-08T17:44:27.049246] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:44:27.217551] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-08T17:44:27.986812] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T17:44:28.017508] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-08T17:44:28.792414] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T17:44:28.817492] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-08T17:44:29.273756] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T17:44:29.617554] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-08T17:44:30.417524] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-08T17:44:30.515209] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:44:31.217521] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-08T17:44:31.253851] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T17:44:31.676467] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-08T17:44:32.017575] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-08T17:44:32.803607] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T17:44:32.817793] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-08T17:44:33.617627] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-08T17:44:33.992717] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T17:44:34.324025] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T17:44:34.417576] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-08T17:44:35.217525] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-08T17:44:35.326342] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T17:44:35.503463] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:44:36.017563] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-08T17:44:36.587179] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T17:44:36.817518] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-08T17:44:36.855302] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T17:44:37.617566] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-08T17:44:38.417523] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-08T17:44:38.475772] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T17:44:39.217561] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-08T17:44:39.442750] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:44:40.017545] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-08T17:44:40.191411] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T17:44:40.496538] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:44:40.817614] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-08T17:44:41.617537] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-08T17:44:41.910884] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:44:41.914338] [INFO ] [REMOTE ] BOW: Full fetch complete (32015 records). [2025-10-08T17:44:41.914434] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-08T17:44:42.295224] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-08T17:44:42.295367] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-08T17:44:42.295883] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-08T17:44:42.295994] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-08T17:44:42.297064] [DEBUG] [LOCAL ] BOW: Trimmed 32015 records to 23766 (keeping 200 days of data) [2025-10-08T17:44:42.422121] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-08T17:44:42.417467] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-08T17:44:42.486090] [DEBUG] [LOCAL ] BOW: Primary data saved (23766 records). [2025-10-08T17:44:42.486239] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-08T17:44:42.486342] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 31.7s. Estimated remaining: 4h 41m 3s. Rate: 7.3 symbols/min [2025-10-08T17:44:42.652739] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:42.687030] [DEBUG] [LOCAL ] BR: Loaded 34891 existing records from primary storage. [2025-10-08T17:44:42.687335] [INFO ] [MAIN ] BR: Loaded 34891 existing records. [2025-10-08T17:44:42.873129] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:42.873418] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-08T17:44:42.873480] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-08T17:44:42.873764] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-08T17:44:42.873827] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-08T17:44:43.067028] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:44:43.157820] [INFO ] [REMOTE ] BORR: Full fetch complete (74575 records). [2025-10-08T17:44:43.183084] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-08T17:44:43.222911] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-08T17:44:43.393290] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:43.694754] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-08T17:44:43.694863] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-08T17:44:43.695789] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-08T17:44:43.695870] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-08T17:44:43.697913] [DEBUG] [LOCAL ] BORR: Trimmed 74575 records to 51092 (keeping 200 days of data) [2025-10-08T17:44:43.989846] [DEBUG] [LOCAL ] BORR: Primary data saved (51092 records). [2025-10-08T17:44:43.989999] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-08T17:44:43.990110] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 36.6s. Estimated remaining: 4h 40m 13s. Rate: 7.3 symbols/min [2025-10-08T17:44:44.022373] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-08T17:44:44.178318] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:44.213758] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T17:44:44.267331] [DEBUG] [LOCAL ] BRBR: Loaded 51420 existing records from primary storage. [2025-10-08T17:44:44.267739] [INFO ] [MAIN ] BRBR: Loaded 51420 existing records. [2025-10-08T17:44:44.450132] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:44.450385] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-08T17:44:44.450431] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-08T17:44:44.450676] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-08T17:44:44.450762] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-08T17:44:44.806435] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:44.817505] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-08T17:44:45.157669] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T17:44:45.367591] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:44:45.617593] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-08T17:44:46.359558] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:44:46.417509] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-08T17:44:46.597740] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T17:44:47.217597] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-08T17:44:47.897789] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T17:44:48.017508] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-08T17:44:48.060366] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T17:44:48.817604] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-08T17:44:49.617625] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-08T17:44:50.417531] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-08T17:44:50.467636] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-08T17:44:50.638096] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T17:44:51.079085] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:44:51.217597] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-08T17:44:51.352881] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T17:44:52.017637] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-08T17:44:52.817587] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-08T17:44:53.265113] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T17:44:53.534904] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:44:53.617621] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-08T17:44:54.195679] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T17:44:54.417544] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-08T17:44:55.217561] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-08T17:44:55.413251] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:44:55.583448] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:44:56.017599] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-08T17:44:56.411324] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T17:44:56.817602] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-08T17:44:57.236308] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:44:57.240110] [INFO ] [REMOTE ] BOX: Full fetch complete (72115 records). [2025-10-08T17:44:57.240217] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-08T17:44:57.642002] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-08T17:44:57.642169] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-08T17:44:57.620826] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-08T17:44:57.642980] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-08T17:44:57.644081] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-08T17:44:57.645972] [DEBUG] [LOCAL ] BOX: Trimmed 72115 records to 50230 (keeping 200 days of data) [2025-10-08T17:44:57.938264] [DEBUG] [LOCAL ] BOX: Primary data saved (50230 records). [2025-10-08T17:44:57.938404] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-08T17:44:57.938549] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 38.7s. Estimated remaining: 4h 40m 40s. Rate: 7.3 symbols/min [2025-10-08T17:44:58.108780] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:58.128079] [DEBUG] [LOCAL ] BRC: Loaded 18876 existing records from primary storage. [2025-10-08T17:44:58.128316] [INFO ] [MAIN ] BRC: Loaded 18876 existing records. [2025-10-08T17:44:58.308589] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:58.308818] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-08T17:44:58.308900] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-08T17:44:58.309153] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-08T17:44:58.309230] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-08T17:44:58.422703] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-08T17:44:58.675418] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:58.918659] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T17:44:59.013201] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:44:59.217554] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-08T17:45:00.025590] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-08T17:45:00.045543] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:45:00.482206] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T17:45:00.817588] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-08T17:45:01.236401] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T17:45:01.617597] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-08T17:45:01.958559] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T17:45:02.417579] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-08T17:45:02.796635] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T17:45:03.217581] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-08T17:45:04.026637] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-08T17:45:04.047728] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:45:04.817531] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-08T17:45:05.074332] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T17:45:05.336501] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-08T17:45:05.342460] [INFO ] [REMOTE ] BP: Full fetch complete (77761 records). [2025-10-08T17:45:05.342726] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-08T17:45:05.622594] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-08T17:45:05.747100] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-08T17:45:05.747200] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-08T17:45:05.748076] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-08T17:45:05.748147] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-08T17:45:05.749839] [DEBUG] [LOCAL ] BP: Trimmed 77761 records to 53709 (keeping 200 days of data) [2025-10-08T17:45:06.094092] [DEBUG] [LOCAL ] BP: Primary data saved (53709 records). [2025-10-08T17:45:06.094292] [INFO ] [MAIN ] BP: Full history saved. [2025-10-08T17:45:06.094396] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BP took 44.2s. Estimated remaining: 4h 40m 31s. Rate: 7.3 symbols/min [2025-10-08T17:45:06.305028] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:06.301292] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T17:45:06.352293] [DEBUG] [LOCAL ] BRCC: Loaded 40149 existing records from primary storage. [2025-10-08T17:45:06.352594] [INFO ] [MAIN ] BRCC: Loaded 40149 existing records. [2025-10-08T17:45:06.422679] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-08T17:45:06.533701] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:06.533926] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-08T17:45:06.533973] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-08T17:45:06.534228] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-08T17:45:06.534287] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-08T17:45:06.944232] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:07.217508] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-08T17:45:07.545302] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T17:45:07.669520] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T17:45:08.017569] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-08T17:45:08.757523] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:45:08.817566] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-08T17:45:09.080750] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:45:09.617629] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-08T17:45:10.417543] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-08T17:45:10.739473] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T17:45:10.943717] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:45:10.946508] [INFO ] [REMOTE ] BR: Full fetch complete (49457 records). [2025-10-08T17:45:10.946594] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-08T17:45:11.222748] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-08T17:45:11.423730] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-08T17:45:11.436533] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-08T17:45:11.437511] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-08T17:45:11.437615] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-08T17:45:11.439385] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T17:45:11.447238] [DEBUG] [LOCAL ] BR: Trimmed 49457 records to 34795 (keeping 200 days of data) [2025-10-08T17:45:11.674662] [DEBUG] [LOCAL ] BR: Primary data saved (34795 records). [2025-10-08T17:45:11.675030] [INFO ] [MAIN ] BR: Full history saved. [2025-10-08T17:45:11.675121] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 29.2s. Estimated remaining: 4h 40m 7s. Rate: 7.3 symbols/min [2025-10-08T17:45:11.851941] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:11.902381] [DEBUG] [LOCAL ] BRO: Loaded 51940 existing records from primary storage. [2025-10-08T17:45:11.902774] [INFO ] [MAIN ] BRO: Loaded 51940 existing records. [2025-10-08T17:45:12.022787] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-08T17:45:12.087109] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:12.087427] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-08T17:45:12.087478] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-08T17:45:12.087821] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-08T17:45:12.087882] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-08T17:45:12.488975] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:12.817594] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-08T17:45:12.884506] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T17:45:12.993163] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T17:45:13.617574] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-08T17:45:14.206991] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T17:45:14.417554] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-08T17:45:15.083459] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T17:45:15.091606] [INFO ] [REMOTE ] BRBR: Full fetch complete (72229 records). [2025-10-08T17:45:15.091900] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-08T17:45:15.222716] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-08T17:45:15.549831] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-08T17:45:15.549564] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T17:45:15.555009] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-08T17:45:15.556112] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-08T17:45:15.556218] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-08T17:45:15.557798] [DEBUG] [LOCAL ] BRBR: Trimmed 72229 records to 51454 (keeping 200 days of data) [2025-10-08T17:45:15.871069] [DEBUG] [LOCAL ] BRBR: Primary data saved (51454 records). [2025-10-08T17:45:15.871232] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-08T17:45:15.871323] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRBR took 31.9s. Estimated remaining: 4h 39m 34s. Rate: 7.3 symbols/min [2025-10-08T17:45:16.032173] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-08T17:45:16.068417] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:16.119319] [DEBUG] [LOCAL ] BROS: Loaded 53293 existing records from primary storage. [2025-10-08T17:45:16.119743] [INFO ] [MAIN ] BROS: Loaded 53293 existing records. [2025-10-08T17:45:16.329567] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:16.329753] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-08T17:45:16.329805] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-08T17:45:16.329975] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-08T17:45:16.330015] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-08T17:45:16.726991] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:16.817524] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-08T17:45:16.897782] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:45:16.935214] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T17:45:17.617606] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-08T17:45:18.417545] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-08T17:45:18.936421] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-08T17:45:19.100518] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T17:45:19.217564] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-08T17:45:19.667441] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T17:45:20.007247] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T17:45:20.009187] [INFO ] [REMOTE ] BRC: Full fetch complete (28818 records). [2025-10-08T17:45:20.009269] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-08T17:45:20.022711] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-08T17:45:20.394487] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-08T17:45:20.394609] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-08T17:45:20.395175] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-08T17:45:20.395281] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-08T17:45:20.396309] [DEBUG] [LOCAL ] BRC: Trimmed 28818 records to 18784 (keeping 200 days of data) [2025-10-08T17:45:20.518591] [DEBUG] [LOCAL ] BRC: Primary data saved (18784 records). [2025-10-08T17:45:20.518783] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-08T17:45:20.518881] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRC took 22.6s. Estimated remaining: 4h 39m 3s. Rate: 7.3 symbols/min [2025-10-08T17:45:20.717625] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:20.717874] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-08T17:45:20.717931] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-08T17:45:20.718049] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-08T17:45:20.718094] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-08T17:45:20.718136] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-08T17:45:20.718169] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-08T17:45:20.823808] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-08T17:45:21.138086] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:21.617536] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-08T17:45:21.817054] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:45:21.817563] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-08T17:45:21.817690] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:45:21.817749] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-08T17:45:21.817810] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:45:21.817886] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-08T17:45:21.817961] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-08T17:45:21.817999] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-08T17:45:21.818040] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-08T17:45:21.818092] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRSL took 1.3s. Estimated remaining: 4h 38m 13s. Rate: 7.3 symbols/min [2025-10-08T17:45:22.029995] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:22.070169] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-08T17:45:22.117008] [DEBUG] [LOCAL ] BRSP: Loaded 36656 existing records from primary storage. [2025-10-08T17:45:22.117325] [INFO ] [MAIN ] BRSP: Loaded 36656 existing records. [2025-10-08T17:45:22.328601] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:45:22.334707] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:22.335001] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-08T17:45:22.343167] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-08T17:45:22.344467] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-08T17:45:22.344530] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-08T17:45:22.422674] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-08T17:45:22.726197] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:23.217568] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-08T17:45:23.998521] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T17:45:24.017521] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-08T17:45:24.817529] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-08T17:45:25.096914] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:45:25.450900] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T17:45:25.617565] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-08T17:45:26.417552] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-08T17:45:26.668304] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T17:45:27.113432] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T17:45:27.217562] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-08T17:45:27.584839] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:45:28.017550] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-08T17:45:28.307914] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:45:28.817570] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-08T17:45:29.617558] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-08T17:45:30.097506] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-08T17:45:30.417521] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-08T17:45:30.730616] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T17:45:31.064251] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T17:45:31.217555] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-08T17:45:32.017511] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-08T17:45:32.107418] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:45:32.663561] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T17:45:32.817541] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-08T17:45:33.096401] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:45:33.617556] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-08T17:45:34.169322] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T17:45:34.417556] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-08T17:45:34.621346] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:45:35.217608] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-08T17:45:35.841449] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T17:45:35.844586] [INFO ] [REMOTE ] BRCC: Full fetch complete (57522 records). [2025-10-08T17:45:35.844770] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-08T17:45:36.027772] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-08T17:45:36.258316] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-08T17:45:36.258424] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-08T17:45:36.259278] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-08T17:45:36.259366] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-08T17:45:36.260813] [DEBUG] [LOCAL ] BRCC: Trimmed 57522 records to 40168 (keeping 200 days of data) [2025-10-08T17:45:36.530669] [DEBUG] [LOCAL ] BRCC: Primary data saved (40168 records). [2025-10-08T17:45:36.531136] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-08T17:45:36.531287] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRCC took 30.4s. Estimated remaining: 4h 38m 44s. Rate: 7.3 symbols/min [2025-10-08T17:45:36.729392] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:36.729817] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-08T17:45:36.730005] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-08T17:45:36.737575] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-08T17:45:36.751520] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-08T17:45:36.752230] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-08T17:45:36.752276] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-08T17:45:36.785574] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T17:45:36.818427] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-08T17:45:37.144559] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:37.617499] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-08T17:45:37.944171] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T17:45:38.417563] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-08T17:45:38.786812] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:45:39.178627] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T17:45:39.217533] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-08T17:45:40.017586] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-08T17:45:40.309309] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T17:45:40.396307] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T17:45:40.817573] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-08T17:45:41.617503] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-08T17:45:41.682458] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T17:45:41.702834] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T17:45:42.417571] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-08T17:45:42.927179] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T17:45:43.217610] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-08T17:45:44.017530] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-08T17:45:44.129443] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:45:44.691974] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T17:45:44.817635] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-08T17:45:45.547695] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T17:45:45.617613] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-08T17:45:46.121117] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T17:45:46.255105] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T17:45:46.417550] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-08T17:45:46.856171] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T17:45:47.217619] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-08T17:45:48.017580] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-08T17:45:48.817598] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-08T17:45:49.072191] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T17:45:49.416551] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T17:45:49.617566] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-08T17:45:49.787675] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T17:45:50.417550] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-08T17:45:50.919935] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:45:50.923787] [INFO ] [REMOTE ] BRO: Full fetch complete (74023 records). [2025-10-08T17:45:50.923911] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-08T17:45:50.924834] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:45:50.924932] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:45:50.924977] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:45:50.925018] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-08T17:45:50.925079] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-08T17:45:50.925115] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-10-08T17:45:50.925552] [DEBUG] [LOCAL ] BRO: Deleted derivative data file. [2025-10-08T17:45:50.925679] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 39.3s. Estimated remaining: 4h 39m 14s. Rate: 7.3 symbols/min [2025-10-08T17:45:51.144576] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:51.144805] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-08T17:45:51.144850] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-08T17:45:51.144965] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-08T17:45:51.145008] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-08T17:45:51.145050] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-08T17:45:51.145084] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-08T17:45:51.227803] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-08T17:45:51.524845] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:51.916462] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T17:45:52.017566] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-08T17:45:52.718174] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-08T17:45:52.817623] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-08T17:45:53.294629] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T17:45:53.617695] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-08T17:45:53.980781] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T17:45:54.073584] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:45:54.417568] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-08T17:45:54.863703] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T17:45:55.217581] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-08T17:45:56.017585] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-08T17:45:56.513155] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:45:56.547264] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T17:45:56.817614] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-08T17:45:57.617565] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-08T17:45:58.024185] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T17:45:58.417586] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-08T17:45:58.737111] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T17:45:58.740359] [INFO ] [REMOTE ] BRSP: Full fetch complete (54237 records). [2025-10-08T17:45:58.740487] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-08T17:45:59.060358] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T17:45:59.136596] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-08T17:45:59.136712] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-08T17:45:59.137335] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-08T17:45:59.137377] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-08T17:45:59.138445] [DEBUG] [LOCAL ] BRSP: Trimmed 54237 records to 36626 (keeping 200 days of data) [2025-10-08T17:45:59.223507] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-08T17:45:59.352491] [DEBUG] [LOCAL ] BRSP: Primary data saved (36626 records). [2025-10-08T17:45:59.352632] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-08T17:45:59.352752] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 37.5s. Estimated remaining: 4h 39m 7s. Rate: 7.3 symbols/min [2025-10-08T17:45:59.524449] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:59.577063] [DEBUG] [LOCAL ] BRX: Loaded 51770 existing records from primary storage. [2025-10-08T17:45:59.577414] [INFO ] [MAIN ] BRX: Loaded 51770 existing records. [2025-10-08T17:45:59.753796] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:59.754076] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-08T17:45:59.754138] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-08T17:45:59.754680] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-08T17:45:59.754740] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-08T17:46:00.027261] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-08T17:46:00.110795] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:00.668749] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T17:46:00.817574] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-08T17:46:01.435184] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T17:46:01.617508] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-08T17:46:01.850752] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T17:46:02.417586] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-08T17:46:02.546929] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T17:46:02.548038] [INFO ] [REMOTE ] BRT: Full fetch complete (6836 records). [2025-10-08T17:46:02.548112] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-08T17:46:02.912295] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-08T17:46:02.912375] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-08T17:46:02.912572] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-08T17:46:02.912610] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-08T17:46:02.913071] [DEBUG] [LOCAL ] BRT: Trimmed 6836 records to 4995 (keeping 200 days of data) [2025-10-08T17:46:02.944050] [DEBUG] [LOCAL ] BRT: Primary data saved (4995 records). [2025-10-08T17:46:02.944169] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-08T17:46:02.944241] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 26.4s. Estimated remaining: 4h 38m 31s. Rate: 7.3 symbols/min [2025-10-08T17:46:03.120896] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:03.154957] [DEBUG] [LOCAL ] BSAC: Loaded 32827 existing records from primary storage. [2025-10-08T17:46:03.155267] [INFO ] [MAIN ] BSAC: Loaded 32827 existing records. [2025-10-08T17:46:03.226091] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-08T17:46:03.383817] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:46:03.384087] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-08T17:46:03.384156] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-08T17:46:03.384466] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-08T17:46:03.384524] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-08T17:46:03.850237] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:04.017575] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-08T17:46:04.273667] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:46:04.321844] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:46:04.817610] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-08T17:46:05.149034] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T17:46:05.617572] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-08T17:46:06.417559] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-08T17:46:06.579439] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:46:06.900269] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-08T17:46:06.904356] [INFO ] [REMOTE ] BROS: Full fetch complete (77066 records). [2025-10-08T17:46:06.904494] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-08T17:46:07.245441] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-08T17:46:07.343306] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-08T17:46:07.343406] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-08T17:46:07.344258] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-08T17:46:07.344329] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-08T17:46:07.346113] [DEBUG] [LOCAL ] BROS: Trimmed 77066 records to 53299 (keeping 200 days of data) [2025-10-08T17:46:07.684983] [DEBUG] [LOCAL ] BROS: Primary data saved (53299 records). [2025-10-08T17:46:07.685138] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-08T17:46:07.685225] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BROS took 51.8s. Estimated remaining: 4h 38m 2s. Rate: 7.3 symbols/min [2025-10-08T17:46:07.857162] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:07.857331] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-10-08T17:46:07.857368] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-10-08T17:46:07.857476] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-08T17:46:07.857520] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-08T17:46:07.857576] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-08T17:46:07.857609] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-08T17:46:08.029870] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-08T17:46:08.216212] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:08.249453] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T17:46:08.486176] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:46:08.817597] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-08T17:46:08.942416] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T17:46:09.617565] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-08T17:46:09.920295] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:46:10.417542] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-08T17:46:10.933422] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T17:46:11.217555] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-08T17:46:12.022700] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-08T17:46:12.041673] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T17:46:12.228090] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T17:46:12.817553] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-08T17:46:12.908989] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T17:46:13.617575] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-08T17:46:14.139900] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T17:46:14.417559] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-08T17:46:14.909917] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T17:46:15.217590] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-08T17:46:16.017604] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-08T17:46:16.235545] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:46:16.284535] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:46:16.817602] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-08T17:46:17.602783] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:46:17.617508] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-08T17:46:18.417533] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-08T17:46:18.585255] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T17:46:18.767751] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:46:19.217600] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-08T17:46:19.563271] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T17:46:20.017572] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-08T17:46:20.670400] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T17:46:20.817559] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-08T17:46:21.298373] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T17:46:21.617509] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-08T17:46:22.424483] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-08T17:46:22.430540] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T17:46:22.489463] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T17:46:23.217561] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-08T17:46:23.736367] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T17:46:23.865493] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T17:46:24.017543] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-08T17:46:24.817554] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-08T17:46:25.278975] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T17:46:25.617519] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-08T17:46:25.708026] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T17:46:26.417531] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-08T17:46:26.898475] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:46:26.902052] [INFO ] [REMOTE ] BRW: Full fetch complete (30514 records). [2025-10-08T17:46:26.902153] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-08T17:46:27.222727] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-08T17:46:27.295457] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-08T17:46:27.295572] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-08T17:46:27.296042] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-08T17:46:27.296106] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-08T17:46:27.296918] [DEBUG] [LOCAL ] BRW: Trimmed 30514 records to 20738 (keeping 200 days of data) [2025-10-08T17:46:27.423417] [DEBUG] [LOCAL ] BRW: Primary data saved (20738 records). [2025-10-08T17:46:27.423543] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-08T17:46:27.423634] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 36.5s. Estimated remaining: 4h 39m 3s. Rate: 7.3 symbols/min [2025-10-08T17:46:27.606617] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:27.606866] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-10-08T17:46:27.606976] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-10-08T17:46:27.614101] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-08T17:46:27.627060] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-08T17:46:27.627945] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-08T17:46:27.629056] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:46:27.636304] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-08T17:46:27.999027] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:28.017500] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-08T17:46:28.615793] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:46:28.618679] [INFO ] [REMOTE ] BSAC: Full fetch complete (44113 records). [2025-10-08T17:46:28.618776] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-08T17:46:28.725738] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T17:46:28.822622] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-08T17:46:29.026279] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-08T17:46:29.026362] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-08T17:46:29.026907] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-08T17:46:29.026970] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-08T17:46:29.027901] [DEBUG] [LOCAL ] BSAC: Trimmed 44113 records to 32782 (keeping 200 days of data) [2025-10-08T17:46:29.220253] [DEBUG] [LOCAL ] BSAC: Primary data saved (32782 records). [2025-10-08T17:46:29.220422] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-08T17:46:29.220529] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSAC took 26.3s. Estimated remaining: 4h 38m 16s. Rate: 7.3 symbols/min [2025-10-08T17:46:29.390046] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:29.423131] [DEBUG] [LOCAL ] BSM: Loaded 32094 existing records from primary storage. [2025-10-08T17:46:29.423411] [INFO ] [MAIN ] BSM: Loaded 32094 existing records. [2025-10-08T17:46:29.600676] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:46:29.600898] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-08T17:46:29.600944] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-08T17:46:29.601179] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-08T17:46:29.601237] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-08T17:46:29.622832] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-08T17:46:29.964896] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:30.059533] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:46:30.417540] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-08T17:46:31.217599] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-08T17:46:31.548604] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T17:46:32.021286] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T17:46:32.019086] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-08T17:46:32.030681] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T17:46:32.817616] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-08T17:46:33.342977] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:46:33.617528] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-08T17:46:33.659059] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T17:46:34.417538] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-08T17:46:35.042857] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T17:46:35.217603] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-08T17:46:35.689869] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:46:36.017625] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-08T17:46:36.541398] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:46:36.817628] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-08T17:46:37.307915] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T17:46:37.617635] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-08T17:46:38.417542] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-08T17:46:38.519720] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T17:46:38.918959] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:46:39.036287] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T17:46:39.217555] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-08T17:46:40.017619] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-08T17:46:40.527100] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:46:40.529959] [INFO ] [REMOTE ] BSBR: Full fetch complete (50544 records). [2025-10-08T17:46:40.530068] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-08T17:46:40.822728] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-08T17:46:40.908174] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-08T17:46:40.908270] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-08T17:46:40.908929] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-08T17:46:40.908991] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-08T17:46:40.910110] [DEBUG] [LOCAL ] BSBR: Trimmed 50544 records to 35362 (keeping 200 days of data) [2025-10-08T17:46:41.115470] [DEBUG] [LOCAL ] BSBR: Primary data saved (35362 records). [2025-10-08T17:46:41.115670] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-08T17:46:41.115793] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSBR took 33.4s. Estimated remaining: 4h 38m 30s. Rate: 7.3 symbols/min [2025-10-08T17:46:41.288837] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:41.308770] [DEBUG] [LOCAL ] BST: Loaded 19001 existing records from primary storage. [2025-10-08T17:46:41.309097] [INFO ] [MAIN ] BST: Loaded 19001 existing records. [2025-10-08T17:46:41.518826] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:46:41.520704] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-08T17:46:41.520891] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-08T17:46:41.522891] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T17:46:41.532847] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-08T17:46:41.533058] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-08T17:46:41.622847] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-08T17:46:41.646158] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:46:41.902716] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:42.417593] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-08T17:46:43.217528] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-08T17:46:43.363160] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T17:46:43.367939] [INFO ] [REMOTE ] BRX: Full fetch complete (74965 records). [2025-10-08T17:46:43.368115] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-08T17:46:43.742401] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-08T17:46:43.817029] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-08T17:46:43.816809] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T17:46:43.827593] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-08T17:46:43.829718] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-08T17:46:43.829802] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-08T17:46:43.831306] [DEBUG] [LOCAL ] BRX: Trimmed 74965 records to 51779 (keeping 200 days of data) [2025-10-08T17:46:44.027194] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-08T17:46:44.174904] [DEBUG] [LOCAL ] BRX: Primary data saved (51779 records). [2025-10-08T17:46:44.175055] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-08T17:46:44.175170] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BRX took 44.8s. Estimated remaining: 4h 37m 51s. Rate: 7.3 symbols/min [2025-10-08T17:46:44.344188] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:44.344385] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-08T17:46:44.344421] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-08T17:46:44.344533] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-08T17:46:44.344574] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-08T17:46:44.344614] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-08T17:46:44.344670] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-08T17:46:44.689157] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:44.817566] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-08T17:46:45.567189] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T17:46:45.617531] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-08T17:46:45.789906] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T17:46:46.417609] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-08T17:46:46.554237] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T17:46:47.217584] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-08T17:46:47.244765] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T17:46:48.017509] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-08T17:46:48.335109] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:46:48.803977] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T17:46:48.817534] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-08T17:46:49.617581] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-08T17:46:49.648445] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T17:46:50.417624] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-08T17:46:50.692405] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T17:46:51.217621] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-08T17:46:51.766770] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T17:46:51.780493] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T17:46:52.017606] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-08T17:46:52.817572] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-08T17:46:53.230309] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T17:46:53.574040] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T17:46:53.617561] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-08T17:46:54.333105] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T17:46:54.334381] [INFO ] [REMOTE ] BSL: Full fetch complete (12702 records). [2025-10-08T17:46:54.334451] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-08T17:46:54.422731] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-08T17:46:54.699752] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-08T17:46:54.699838] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-08T17:46:54.700132] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-08T17:46:54.700171] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-08T17:46:54.700625] [DEBUG] [LOCAL ] BSL: Trimmed 12702 records to 8181 (keeping 200 days of data) [2025-10-08T17:46:54.750779] [DEBUG] [LOCAL ] BSL: Primary data saved (8181 records). [2025-10-08T17:46:54.750910] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-08T17:46:54.751019] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSL took 27.3s. Estimated remaining: 4h 37m 56s. Rate: 7.3 symbols/min [2025-10-08T17:46:54.927437] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:54.927683] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-08T17:46:54.927742] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-08T17:46:54.927857] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-08T17:46:54.927900] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-08T17:46:54.927942] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-08T17:46:54.927979] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-08T17:46:55.222784] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-08T17:46:55.280327] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:56.017625] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-08T17:46:56.042705] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T17:46:56.488840] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T17:46:56.817709] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-08T17:46:56.963225] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:46:57.617601] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-08T17:46:58.417516] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-08T17:46:58.622825] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T17:46:58.767479] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T17:46:59.217600] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-08T17:46:59.981083] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:47:00.017542] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-08T17:47:00.492431] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T17:47:00.817603] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-08T17:47:01.474856] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T17:47:01.617547] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-08T17:47:02.417575] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-08T17:47:02.774156] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-08T17:47:02.828997] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:47:03.217618] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-08T17:47:03.496766] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T17:47:04.017588] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-08T17:47:04.817525] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-08T17:47:04.913341] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:47:05.054688] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:47:05.617560] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-08T17:47:05.914139] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:47:06.331039] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T17:47:06.417566] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-08T17:47:07.217557] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-08T17:47:07.635105] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:47:08.017614] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-08T17:47:08.443707] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T17:47:08.817602] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-08T17:47:09.617705] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-08T17:47:09.824743] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:47:09.826882] [INFO ] [REMOTE ] BST: Full fetch complete (28720 records). [2025-10-08T17:47:09.826967] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-08T17:47:09.976841] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T17:47:10.247003] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-08T17:47:10.247089] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-08T17:47:10.247526] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-08T17:47:10.247565] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-08T17:47:10.248425] [DEBUG] [LOCAL ] BST: Trimmed 28720 records to 18984 (keeping 200 days of data) [2025-10-08T17:47:10.362405] [DEBUG] [LOCAL ] BST: Primary data saved (18984 records). [2025-10-08T17:47:10.362559] [INFO ] [MAIN ] BST: Full history saved. [2025-10-08T17:47:10.362666] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BST took 29.2s. Estimated remaining: 4h 38m 32s. Rate: 7.3 symbols/min [2025-10-08T17:47:10.427213] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-08T17:47:10.539682] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:10.547484] [DEBUG] [LOCAL ] BTA: Loaded 5458 existing records from primary storage. [2025-10-08T17:47:10.547696] [INFO ] [MAIN ] BTA: Loaded 5458 existing records. [2025-10-08T17:47:10.732790] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:10.733068] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-08T17:47:10.733122] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-08T17:47:10.733307] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-08T17:47:10.733363] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-08T17:47:11.110789] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:11.166371] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T17:47:11.217556] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-08T17:47:11.343450] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T17:47:12.017566] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-08T17:47:12.817518] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-08T17:47:12.869345] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T17:47:12.956489] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:47:13.617560] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-08T17:47:13.976456] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T17:47:14.417594] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-08T17:47:14.839182] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:47:14.843133] [INFO ] [REMOTE ] BSM: Full fetch complete (47150 records). [2025-10-08T17:47:14.843313] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-08T17:47:15.221717] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-08T17:47:15.238629] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-08T17:47:15.238864] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-08T17:47:15.239586] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-08T17:47:15.239836] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-08T17:47:15.241046] [DEBUG] [LOCAL ] BSM: Trimmed 47150 records to 32179 (keeping 200 days of data) [2025-10-08T17:47:15.349194] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T17:47:15.449203] [DEBUG] [LOCAL ] BSM: Primary data saved (32179 records). [2025-10-08T17:47:15.449374] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-08T17:47:15.449479] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BSM took 46.2s. Estimated remaining: 4h 38m 5s. Rate: 7.3 symbols/min [2025-10-08T17:47:15.620314] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:15.620556] [DEBUG] [LOCAL ] BTCM: No existing data file found in primary storage. [2025-10-08T17:47:15.620601] [WARN ] [MAIN ] BTCM: No existing data found, performing full refresh instead. [2025-10-08T17:47:15.620741] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-08T17:47:15.620786] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-08T17:47:15.620830] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-08T17:47:15.620863] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-08T17:47:15.975760] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:16.017505] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-08T17:47:16.366054] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T17:47:16.817571] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-08T17:47:16.853434] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:47:17.617611] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-08T17:47:17.952130] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T17:47:17.955425] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36844 records). [2025-10-08T17:47:17.955536] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-08T17:47:18.348126] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-08T17:47:18.348206] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-08T17:47:18.348710] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-08T17:47:18.348771] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-08T17:47:18.349560] [DEBUG] [LOCAL ] BSTZ: Trimmed 36844 records to 24965 (keeping 200 days of data) [2025-10-08T17:47:18.436981] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-08T17:47:18.481079] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:47:18.521121] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24965 records). [2025-10-08T17:47:18.521270] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-08T17:47:18.521353] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSTZ took 34.3s. Estimated remaining: 4h 37m 27s. Rate: 7.3 symbols/min [2025-10-08T17:47:18.690325] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:18.739814] [DEBUG] [LOCAL ] BTE: Loaded 52715 existing records from primary storage. [2025-10-08T17:47:18.740189] [INFO ] [MAIN ] BTE: Loaded 52715 existing records. [2025-10-08T17:47:18.915699] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:18.916016] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-08T17:47:18.916073] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-08T17:47:18.916372] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-08T17:47:18.916451] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-08T17:47:19.218635] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-08T17:47:19.315204] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T17:47:19.348425] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:19.900628] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T17:47:20.017562] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-08T17:47:20.817601] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-08T17:47:21.404823] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T17:47:21.617566] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-08T17:47:22.061578] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-08T17:47:22.281998] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T17:47:22.417554] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-08T17:47:23.217606] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-08T17:47:24.017570] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-08T17:47:24.335261] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T17:47:24.750799] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T17:47:24.817548] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-08T17:47:25.077233] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:47:25.617565] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-08T17:47:26.222935] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T17:47:26.417512] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-08T17:47:26.624008] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T17:47:27.083239] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T17:47:27.217588] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-08T17:47:27.872832] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T17:47:28.017564] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-08T17:47:28.695217] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T17:47:28.817568] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-08T17:47:29.617558] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-08T17:47:30.417522] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-08T17:47:30.707477] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:47:31.217149] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T17:47:31.226741] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-08T17:47:31.257241] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T17:47:31.843402] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T17:47:32.017543] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-08T17:47:32.755812] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-08T17:47:32.817507] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-08T17:47:33.369545] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T17:47:33.617538] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-08T17:47:34.417554] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-08T17:47:35.190157] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T17:47:35.191227] [INFO ] [REMOTE ] BTA: Full fetch complete (9500 records). [2025-10-08T17:47:35.191300] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-08T17:47:35.222799] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-08T17:47:35.595844] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-08T17:47:35.596431] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-08T17:47:35.597085] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-08T17:47:35.597384] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-08T17:47:35.604185] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-08T17:47:35.605532] [DEBUG] [LOCAL ] BTA: Trimmed 9500 records to 5488 (keeping 200 days of data) [2025-10-08T17:47:35.638082] [DEBUG] [LOCAL ] BTA: Primary data saved (5488 records). [2025-10-08T17:47:35.638185] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-08T17:47:35.638267] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BTA took 25.3s. Estimated remaining: 4h 38m 11s. Rate: 7.3 symbols/min [2025-10-08T17:47:35.804803] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:35.855464] [DEBUG] [LOCAL ] BTI: Loaded 53572 existing records from primary storage. [2025-10-08T17:47:35.855883] [INFO ] [MAIN ] BTI: Loaded 53572 existing records. [2025-10-08T17:47:36.025522] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-08T17:47:36.071078] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:36.072218] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-08T17:47:36.072309] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-08T17:47:36.072602] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-08T17:47:36.072694] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-08T17:47:36.431539] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:36.817553] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-08T17:47:37.062314] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:47:37.617721] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-08T17:47:38.004221] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T17:47:38.070330] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-08T17:47:38.210609] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T17:47:38.214883] [INFO ] [REMOTE ] BSX: Full fetch complete (77309 records). [2025-10-08T17:47:38.215097] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-08T17:47:38.216143] [FATAL] [VALIDATOR ] BSX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:47:38.216288] [FATAL] [MAIN ] BSX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:47:38.216336] [WARN ] [MAIN ] BSX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:47:38.216412] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-08T17:47:38.216527] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-08T17:47:38.216586] [INFO ] [LOCAL ] BSX: Starting deletion of derivative data. [2025-10-08T17:47:38.216629] [DEBUG] [LOCAL ] BSX: No derivative data file found to delete. [2025-10-08T17:47:38.216737] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSX took 43.5s. Estimated remaining: 4h 37m 29s. Rate: 7.3 symbols/min [2025-10-08T17:47:38.424336] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-08T17:47:38.439676] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:38.439927] [DEBUG] [LOCAL ] BTO: No existing data file found in primary storage. [2025-10-08T17:47:38.439984] [WARN ] [MAIN ] BTO: No existing data found, performing full refresh instead. [2025-10-08T17:47:38.440094] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-08T17:47:38.440148] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-08T17:47:38.440239] [DEBUG] [LOCAL ] BTO: No primary data file found to delete. [2025-10-08T17:47:38.440307] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-08T17:47:38.899291] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:39.217549] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-08T17:47:39.845736] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T17:47:39.909988] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:47:40.017548] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-08T17:47:40.817522] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-08T17:47:40.997483] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T17:47:41.617555] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-08T17:47:42.396202] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T17:47:42.417522] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-08T17:47:42.911402] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-08T17:47:43.217587] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-08T17:47:43.827612] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T17:47:43.829803] [INFO ] [REMOTE ] BTCM: Full fetch complete (19637 records). [2025-10-08T17:47:43.829886] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-08T17:47:44.021936] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-08T17:47:44.248009] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-08T17:47:44.248093] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-08T17:47:44.248432] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-08T17:47:44.248473] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-08T17:47:44.249190] [DEBUG] [LOCAL ] BTCM: Trimmed 19637 records to 16133 (keeping 200 days of data) [2025-10-08T17:47:44.342787] [DEBUG] [LOCAL ] BTCM: Primary data saved (16133 records). [2025-10-08T17:47:44.342950] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-08T17:47:44.343031] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 28.9s. Estimated remaining: 4h 37m 9s. Rate: 7.3 symbols/min [2025-10-08T17:47:44.516542] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:44.533545] [DEBUG] [LOCAL ] BTT: Loaded 15845 existing records from primary storage. [2025-10-08T17:47:44.533839] [INFO ] [MAIN ] BTT: Loaded 15845 existing records. [2025-10-08T17:47:44.714028] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:44.714258] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-08T17:47:44.714304] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-08T17:47:44.714502] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-08T17:47:44.714558] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-08T17:47:44.822689] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-08T17:47:45.078864] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:45.156870] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T17:47:45.566345] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T17:47:45.617597] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-08T17:47:46.008194] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T17:47:46.417631] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-08T17:47:46.546549] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T17:47:47.217619] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-08T17:47:47.430884] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T17:47:48.017702] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-08T17:47:48.817530] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-08T17:47:48.962636] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T17:47:49.576385] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T17:47:49.617546] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-08T17:47:49.828053] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:47:50.417525] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-08T17:47:51.217588] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-08T17:47:51.440159] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:47:51.725786] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T17:47:52.017545] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-08T17:47:52.101909] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T17:47:52.817560] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-08T17:47:52.853422] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:47:53.363345] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T17:47:53.617585] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-08T17:47:54.417573] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-08T17:47:55.157417] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T17:47:55.217522] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-08T17:47:55.436581] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:47:56.017556] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-08T17:47:56.027574] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T17:47:56.817512] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-08T17:47:56.863196] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T17:47:57.522750] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T17:47:57.523918] [INFO ] [REMOTE ] BTO: Full fetch complete (13155 records). [2025-10-08T17:47:57.523989] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-08T17:47:57.622274] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-08T17:47:57.884436] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-08T17:47:57.884516] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-08T17:47:57.884807] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-08T17:47:57.884869] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-08T17:47:57.885378] [DEBUG] [LOCAL ] BTO: Trimmed 13155 records to 8691 (keeping 200 days of data) [2025-10-08T17:47:57.936389] [DEBUG] [LOCAL ] BTO: Primary data saved (8691 records). [2025-10-08T17:47:57.936500] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-08T17:47:57.936571] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 19.7s. Estimated remaining: 4h 37m 32s. Rate: 7.3 symbols/min [2025-10-08T17:47:58.102892] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:58.156189] [DEBUG] [LOCAL ] BTU: Loaded 53316 existing records from primary storage. [2025-10-08T17:47:58.156538] [INFO ] [MAIN ] BTU: Loaded 53316 existing records. [2025-10-08T17:47:58.340590] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:58.340832] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-08T17:47:58.340879] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-08T17:47:58.341122] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-08T17:47:58.341180] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-08T17:47:58.421997] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-08T17:47:58.682995] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T17:47:58.726073] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:59.217614] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-08T17:48:00.017636] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-08T17:48:00.478455] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T17:48:00.627262] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T17:48:00.817553] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-08T17:48:01.550902] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:48:01.617519] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-08T17:48:01.928478] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T17:48:02.417599] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-08T17:48:03.035302] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:48:03.217591] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-08T17:48:04.017584] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-08T17:48:04.428695] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T17:48:04.485822] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:48:04.817568] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-08T17:48:05.617525] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-08T17:48:05.824013] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T17:48:06.417514] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-08T17:48:06.491308] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:48:06.626947] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T17:48:07.217556] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-08T17:48:07.988666] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:48:08.017491] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-08T17:48:08.740064] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T17:48:08.817514] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-08T17:48:09.617605] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-08T17:48:09.641611] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:48:09.645542] [INFO ] [REMOTE ] BTE: Full fetch complete (76124 records). [2025-10-08T17:48:09.645674] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-08T17:48:10.032741] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-08T17:48:10.032824] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-08T17:48:10.033602] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-08T17:48:10.033661] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-08T17:48:10.035062] [DEBUG] [LOCAL ] BTE: Trimmed 76124 records to 52713 (keeping 200 days of data) [2025-10-08T17:48:10.342454] [DEBUG] [LOCAL ] BTE: Primary data saved (52713 records). [2025-10-08T17:48:10.342580] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-08T17:48:10.342682] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 51.8s. Estimated remaining: 4h 37m 48s. Rate: 7.3 symbols/min [2025-10-08T17:48:10.422194] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-08T17:48:10.523465] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:10.523783] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-08T17:48:10.523842] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-08T17:48:10.524009] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-08T17:48:10.524092] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-08T17:48:10.524155] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-08T17:48:10.524189] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-08T17:48:10.916048] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:10.945510] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T17:48:11.217613] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:48:11.217770] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-08T17:48:11.986827] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-08T17:48:12.017497] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-08T17:48:12.817509] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-08T17:48:13.229857] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T17:48:13.372010] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T17:48:13.616901] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T17:48:13.617748] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-08T17:48:14.417524] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-08T17:48:14.532191] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T17:48:15.217568] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-08T17:48:16.017521] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-08T17:48:16.134277] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T17:48:16.817638] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-08T17:48:17.005390] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:48:17.163542] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T17:48:17.617512] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-08T17:48:18.417526] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-08T17:48:18.873051] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:48:18.901345] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-08T17:48:18.901541] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:48:18.903485] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T17:48:18.902239] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-08T17:48:18.915708] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:48:18.916192] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-08T17:48:18.916289] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-08T17:48:18.916348] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-08T17:48:18.916761] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-08T17:48:18.916821] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 8.6s. Estimated remaining: 4h 37m 41s. Rate: 7.3 symbols/min [2025-10-08T17:48:19.085803] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:19.112128] [DEBUG] [LOCAL ] BTZ: Loaded 22735 existing records from primary storage. [2025-10-08T17:48:19.112438] [INFO ] [MAIN ] BTZ: Loaded 22735 existing records. [2025-10-08T17:48:19.222727] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-08T17:48:19.311436] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:19.311704] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-08T17:48:19.311760] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-08T17:48:19.312143] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-08T17:48:19.312201] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-08T17:48:19.611427] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-08T17:48:19.654703] [INFO ] [REMOTE ] BTI: Full fetch complete (77467 records). [2025-10-08T17:48:19.685250] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-08T17:48:19.685160] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:20.022634] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-08T17:48:20.110170] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-08T17:48:20.110257] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-08T17:48:20.111182] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-08T17:48:20.111254] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-08T17:48:20.112973] [DEBUG] [LOCAL ] BTI: Trimmed 77467 records to 53576 (keeping 200 days of data) [2025-10-08T17:48:20.307348] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T17:48:20.334957] [INFO ] [REMOTE ] BTT: Full fetch complete (23525 records). [2025-10-08T17:48:20.335570] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-08T17:48:20.337430] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:48:20.338073] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:48:20.338673] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:48:20.339296] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-08T17:48:20.339632] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-08T17:48:20.340023] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-08T17:48:20.341077] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-10-08T17:48:20.341187] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTT took 36.0s. Estimated remaining: 4h 36m 54s. Rate: 7.3 symbols/min [2025-10-08T17:48:20.523046] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:20.647580] [DEBUG] [LOCAL ] BUD: Loaded 52706 existing records from primary storage. [2025-10-08T17:48:20.648922] [INFO ] [MAIN ] BUD: Loaded 52706 existing records. [2025-10-08T17:48:20.824692] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-08T17:48:20.856453] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:20.858293] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-08T17:48:20.858671] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-08T17:48:20.859956] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-08T17:48:20.860313] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-08T17:48:20.979039] [DEBUG] [LOCAL ] BTI: Primary data saved (53576 records). [2025-10-08T17:48:20.984905] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-08T17:48:20.990155] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTI took 45.4s. Estimated remaining: 4h 36m 2s. Rate: 7.3 symbols/min [2025-10-08T17:48:21.415311] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:21.437054] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:21.448186] [DEBUG] [LOCAL ] BUI: Loaded 11784 existing records from primary storage. [2025-10-08T17:48:21.448400] [INFO ] [MAIN ] BUI: Loaded 11784 existing records. [2025-10-08T17:48:21.631836] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:21.626006] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-08T17:48:21.632919] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-08T17:48:21.632982] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-08T17:48:21.633286] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-08T17:48:21.633345] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-08T17:48:21.931702] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T17:48:22.027128] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T17:48:22.056957] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:22.417614] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-08T17:48:23.217510] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-08T17:48:23.261977] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:48:23.708125] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-08T17:48:24.017571] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-08T17:48:24.822612] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-08T17:48:24.829544] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T17:48:25.091960] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T17:48:25.617593] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-08T17:48:26.085846] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:48:26.417557] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-08T17:48:27.217583] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-08T17:48:27.517164] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T17:48:27.520706] [INFO ] [REMOTE ] BTU: Full fetch complete (76649 records). [2025-10-08T17:48:27.520813] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-08T17:48:27.521463] [FATAL] [VALIDATOR ] BTU: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:48:27.521578] [FATAL] [MAIN ] BTU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:48:27.521621] [WARN ] [MAIN ] BTU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:48:27.521725] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-08T17:48:27.521790] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-08T17:48:27.521826] [INFO ] [LOCAL ] BTU: Starting deletion of derivative data. [2025-10-08T17:48:27.522035] [DEBUG] [LOCAL ] BTU: Deleted derivative data file. [2025-10-08T17:48:27.522127] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTU took 29.6s. Estimated remaining: 4h 35m 44s. Rate: 7.3 symbols/min [2025-10-08T17:48:27.692460] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:27.692691] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-10-08T17:48:27.692787] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-10-08T17:48:27.692911] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-08T17:48:27.692952] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-08T17:48:27.693021] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-10-08T17:48:27.693065] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-08T17:48:28.003831] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:48:28.019532] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-08T17:48:28.110868] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:28.149305] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:48:28.817537] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-08T17:48:29.131059] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:48:29.616789] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T17:48:29.619023] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-08T17:48:30.417523] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-08T17:48:30.754614] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T17:48:30.996402] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T17:48:31.217566] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-08T17:48:32.017555] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-08T17:48:32.796390] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:48:32.817543] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-08T17:48:32.961829] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T17:48:33.617561] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-08T17:48:34.233314] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:48:34.303726] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T17:48:34.417605] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-08T17:48:35.217565] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-08T17:48:35.423688] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T17:48:36.017598] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-08T17:48:36.151910] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T17:48:36.817531] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-08T17:48:36.945923] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T17:48:37.617639] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-08T17:48:37.667839] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:48:38.417619] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-08T17:48:39.217570] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-08T17:48:39.592863] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T17:48:39.760488] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T17:48:39.840989] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T17:48:40.017577] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-08T17:48:40.817609] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-08T17:48:41.617525] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-08T17:48:42.010551] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T17:48:42.092502] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-08T17:48:42.321629] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:48:42.417573] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-08T17:48:43.217625] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-08T17:48:43.348766] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:48:44.017562] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-08T17:48:44.817569] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-08T17:48:44.932868] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T17:48:45.617606] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-08T17:48:45.832316] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:48:46.417585] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-08T17:48:46.527814] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T17:48:46.529394] [INFO ] [REMOTE ] BUI: Full fetch complete (16495 records). [2025-10-08T17:48:46.529466] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-08T17:48:46.982935] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-08T17:48:46.997340] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-08T17:48:46.998254] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-08T17:48:46.998373] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-08T17:48:47.002231] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-08T17:48:47.002836] [DEBUG] [LOCAL ] BUI: Trimmed 16495 records to 11839 (keeping 200 days of data) [2025-10-08T17:48:47.100178] [DEBUG] [LOCAL ] BUI: Primary data saved (11839 records). [2025-10-08T17:48:47.100389] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-08T17:48:47.100499] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BUI took 26.1s. Estimated remaining: 4h 36m 41s. Rate: 7.3 symbols/min [2025-10-08T17:48:47.222748] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-08T17:48:47.289574] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:47.339142] [DEBUG] [LOCAL ] BURL: Loaded 45815 existing records from primary storage. [2025-10-08T17:48:47.339588] [INFO ] [MAIN ] BURL: Loaded 45815 existing records. [2025-10-08T17:48:47.533263] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:47.533579] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-08T17:48:47.533630] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-08T17:48:47.534022] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-08T17:48:47.534083] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-08T17:48:47.935456] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:48.025355] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-08T17:48:48.042673] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T17:48:48.817610] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-08T17:48:49.083392] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T17:48:49.131667] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T17:48:49.617557] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-08T17:48:50.417522] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-08T17:48:50.451720] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T17:48:50.707349] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:48:50.709717] [INFO ] [REMOTE ] BTZ: Full fetch complete (33662 records). [2025-10-08T17:48:50.709823] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-08T17:48:51.073269] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-08T17:48:51.073352] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-08T17:48:51.073832] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-08T17:48:51.073895] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-08T17:48:51.074807] [DEBUG] [LOCAL ] BTZ: Trimmed 33662 records to 22689 (keeping 200 days of data) [2025-10-08T17:48:51.217686] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-08T17:48:51.220073] [DEBUG] [LOCAL ] BTZ: Primary data saved (22689 records). [2025-10-08T17:48:51.220167] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-08T17:48:51.220304] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BTZ took 32.3s. Estimated remaining: 4h 36m 9s. Rate: 7.3 symbols/min [2025-10-08T17:48:51.394359] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:51.411025] [DEBUG] [LOCAL ] BUXX: Loaded 15298 existing records from primary storage. [2025-10-08T17:48:51.411280] [INFO ] [MAIN ] BUXX: Loaded 15298 existing records. [2025-10-08T17:48:51.588463] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:51.588746] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-08T17:48:51.588804] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-08T17:48:51.589010] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-08T17:48:51.589068] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-08T17:48:51.958978] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:52.022634] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-08T17:48:52.040704] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T17:48:52.715194] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T17:48:52.817578] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-08T17:48:52.981300] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T17:48:53.617547] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-08T17:48:54.181103] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:48:54.417574] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-08T17:48:55.171779] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:48:55.217560] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-08T17:48:56.017515] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-08T17:48:56.206937] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:48:56.817505] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-08T17:48:56.963743] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T17:48:57.460904] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T17:48:57.523235] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T17:48:57.617573] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-08T17:48:58.291373] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T17:48:58.417607] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-08T17:48:59.208298] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T17:48:59.217487] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-08T17:49:00.017540] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-08T17:49:00.200550] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T17:49:00.817563] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-08T17:49:01.558714] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T17:49:01.617546] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-08T17:49:02.417561] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-08T17:49:02.468337] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:49:02.688139] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T17:49:03.217559] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-08T17:49:04.017524] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-08T17:49:04.393897] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T17:49:04.817608] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-08T17:49:05.023814] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T17:49:05.266524] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T17:49:05.617575] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-08T17:49:05.910330] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:49:06.417606] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-08T17:49:07.217576] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-08T17:49:07.346445] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T17:49:07.426067] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-08T17:49:07.430344] [INFO ] [REMOTE ] BUD: Full fetch complete (76464 records). [2025-10-08T17:49:07.430511] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-08T17:49:07.843685] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-08T17:49:07.843820] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-08T17:49:07.844952] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-08T17:49:07.845025] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-08T17:49:07.846708] [DEBUG] [LOCAL ] BUD: Trimmed 76464 records to 52698 (keeping 200 days of data) [2025-10-08T17:49:08.026033] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-08T17:49:08.174556] [DEBUG] [LOCAL ] BUD: Primary data saved (52698 records). [2025-10-08T17:49:08.174741] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-08T17:49:08.175605] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUD took 47.8s. Estimated remaining: 4h 36m 50s. Rate: 7.3 symbols/min [2025-10-08T17:49:08.713224] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T17:49:08.817534] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-08T17:49:08.898953] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T17:49:09.364624] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:49:09.617606] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-08T17:49:10.417551] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-08T17:49:11.023148] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:49:11.217570] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-08T17:49:11.826897] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T17:49:11.830349] [INFO ] [REMOTE ] BUR: Full fetch complete (63621 records). [2025-10-08T17:49:11.830478] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-08T17:49:11.990273] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T17:49:12.041559] [INFO ] [REMOTE ] BUXX: Full fetch complete (20407 records). [2025-10-08T17:49:12.049972] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-08T17:49:12.075378] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-08T17:49:12.409518] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-08T17:49:12.410724] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-08T17:49:12.426572] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-08T17:49:12.441234] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-08T17:49:12.554252] [DEBUG] [LOCAL ] BUR: Trimmed 63621 records to 45195 (keeping 200 days of data) [2025-10-08T17:49:12.737566] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-08T17:49:12.740794] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-08T17:49:12.741538] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-08T17:49:12.742394] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-08T17:49:12.745102] [DEBUG] [LOCAL ] BUXX: Trimmed 20407 records to 15250 (keeping 200 days of data) [2025-10-08T17:49:12.944984] [DEBUG] [LOCAL ] BUXX: Primary data saved (15250 records). [2025-10-08T17:49:12.945970] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-08T17:49:12.946321] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUXX took 21.7s. Estimated remaining: 4h 36m 23s. Rate: 7.3 symbols/min [2025-10-08T17:49:13.006873] [DEBUG] [LOCAL ] BUR: Primary data saved (45195 records). [2025-10-08T17:49:13.007006] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-08T17:49:13.007081] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUR took 45.5s. Estimated remaining: 4h 35m 29s. Rate: 7.3 symbols/min [2025-10-08T17:49:13.866032] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T17:49:13.876053] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-08T17:49:15.562224] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T17:49:15.572085] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-08T17:49:17.157566] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T17:49:17.167533] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-08T17:49:18.690116] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T17:49:18.693417] [INFO ] [REMOTE ] BURL: Full fetch complete (65648 records). [2025-10-08T17:49:18.693559] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-08T17:49:19.116311] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-08T17:49:19.116413] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-08T17:49:19.117380] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-08T17:49:19.117452] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-08T17:49:19.119328] [DEBUG] [LOCAL ] BURL: Trimmed 65648 records to 45738 (keeping 200 days of data) [2025-10-08T17:49:19.405523] [DEBUG] [LOCAL ] BURL: Primary data saved (45738 records). [2025-10-08T17:49:19.405700] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-08T17:49:19.405843] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 32.3s. Estimated remaining: 4h 35m 10s. Rate: 7.3 symbols/min [2025-10-08T17:49:20.154745] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:20.164743] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:20.215819] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:20.241089] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-08T17:49:20.240993] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:20.241465] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-08T17:49:20.243820] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-08T17:49:20.243892] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-08T17:49:20.243972] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-08T17:49:20.244014] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-08T17:49:20.489811] [DEBUG] [LOCAL ] BW: Loaded 40087 existing records from primary storage. [2025-10-08T17:49:20.506638] [DEBUG] [LOCAL ] BVN: Loaded 44028 existing records from primary storage. [2025-10-08T17:49:20.525513] [INFO ] [MAIN ] BW: Loaded 40087 existing records. [2025-10-08T17:49:20.595091] [INFO ] [MAIN ] BVN: Loaded 44028 existing records. [2025-10-08T17:49:20.662010] [DEBUG] [LOCAL ] BWA: Loaded 52171 existing records from primary storage. [2025-10-08T17:49:20.825776] [INFO ] [MAIN ] BWA: Loaded 52171 existing records. [2025-10-08T17:49:21.125629] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:21.161941] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-08T17:49:21.192395] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:21.224504] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-08T17:49:21.258910] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-08T17:49:21.347675] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-08T17:49:21.350812] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:21.351158] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-08T17:49:21.350986] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-08T17:49:21.351285] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-08T17:49:21.328027] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:21.393384] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-08T17:49:21.405354] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-08T17:49:21.509736] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-08T17:49:21.569902] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-08T17:49:21.619548] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-08T17:49:21.655037] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-08T17:49:22.087559] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:22.098181] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-08T17:49:22.333546] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:22.348640] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-08T17:49:22.466550] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:22.466877] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-08T17:49:22.685077] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:49:22.691912] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-08T17:49:23.741797] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:49:23.748106] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-08T17:49:23.864959] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T17:49:23.875736] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-08T17:49:23.953023] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:49:23.962228] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-08T17:49:24.297361] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T17:49:24.307806] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-08T17:49:24.730039] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T17:49:24.737762] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-08T17:49:24.995417] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:49:25.004207] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-08T17:49:25.484825] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T17:49:25.494612] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-08T17:49:25.667044] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:49:25.677454] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-08T17:49:26.036275] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:49:26.045013] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-08T17:49:26.073729] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T17:49:26.417571] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-08T17:49:26.731489] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:49:27.144988] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:49:27.217497] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-08T17:49:27.252789] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:49:27.458071] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T17:49:28.017619] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-08T17:49:28.817587] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-08T17:49:29.063669] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T17:49:29.543091] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T17:49:29.617571] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-08T17:49:30.033331] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T17:49:30.418492] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-08T17:49:31.217597] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-08T17:49:31.291503] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T17:49:31.697890] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T17:49:32.017611] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-08T17:49:32.791288] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:49:32.817504] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-08T17:49:33.363490] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T17:49:33.617693] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-08T17:49:34.403297] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T17:49:34.417500] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-08T17:49:35.028921] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:49:35.217574] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-08T17:49:35.820092] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T17:49:36.017559] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-08T17:49:36.401901] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T17:49:36.817605] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-08T17:49:37.617528] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-08T17:49:37.645395] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T17:49:38.246885] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T17:49:38.417507] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-08T17:49:38.590164] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T17:49:39.217594] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-08T17:49:40.024423] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-08T17:49:40.029947] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T17:49:40.650930] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T17:49:40.817530] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-08T17:49:41.539903] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T17:49:41.617502] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-08T17:49:42.148601] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T17:49:42.417568] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-08T17:49:43.199534] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T17:49:43.217500] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-08T17:49:43.661458] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T17:49:44.017561] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-08T17:49:44.715298] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T17:49:44.817547] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-08T17:49:45.552388] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T17:49:45.617584] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-08T17:49:46.082776] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:49:46.086447] [INFO ] [REMOTE ] BW: Full fetch complete (58927 records). [2025-10-08T17:49:46.086554] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-08T17:49:46.426925] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-08T17:49:46.470454] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-08T17:49:46.470547] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-08T17:49:46.471263] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-08T17:49:46.471346] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-08T17:49:46.472582] [DEBUG] [LOCAL ] BW: Trimmed 58927 records to 40183 (keeping 200 days of data) [2025-10-08T17:49:46.705904] [DEBUG] [LOCAL ] BW: Primary data saved (40183 records). [2025-10-08T17:49:46.706081] [INFO ] [MAIN ] BW: Full history saved. [2025-10-08T17:49:46.706201] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BW took 27.3s. Estimated remaining: 4h 36m 48s. Rate: 7.3 symbols/min [2025-10-08T17:49:46.879431] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:46.917016] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:49:46.932638] [DEBUG] [LOCAL ] BWG: Loaded 12612 existing records from primary storage. [2025-10-08T17:49:46.933322] [INFO ] [MAIN ] BWG: Loaded 12612 existing records. [2025-10-08T17:49:47.114004] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:47.114293] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-08T17:49:47.114342] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-08T17:49:47.114560] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-08T17:49:47.114617] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-08T17:49:47.222811] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-08T17:49:47.473991] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:47.804508] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T17:49:48.017561] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-08T17:49:48.663786] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:49:48.667395] [INFO ] [REMOTE ] BVN: Full fetch complete (62856 records). [2025-10-08T17:49:48.667519] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-08T17:49:48.844731] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-08T17:49:48.970974] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T17:49:49.066624] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-08T17:49:49.066739] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-08T17:49:49.067440] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-08T17:49:49.067504] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-08T17:49:49.068844] [DEBUG] [LOCAL ] BVN: Trimmed 62856 records to 44059 (keeping 200 days of data) [2025-10-08T17:49:49.331528] [DEBUG] [LOCAL ] BVN: Primary data saved (44059 records). [2025-10-08T17:49:49.331769] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-08T17:49:49.331913] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BVN took 29.9s. Estimated remaining: 4h 36m 9s. Rate: 7.3 symbols/min [2025-10-08T17:49:49.519340] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:49.551031] [DEBUG] [LOCAL ] BWLP: Loaded 32303 existing records from primary storage. [2025-10-08T17:49:49.551402] [INFO ] [MAIN ] BWLP: Loaded 32303 existing records. [2025-10-08T17:49:49.623236] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-08T17:49:49.767026] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:49.767307] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-08T17:49:49.767355] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-08T17:49:49.768228] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-08T17:49:49.768313] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-08T17:49:50.059358] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T17:49:50.102403] [INFO ] [REMOTE ] BV: Full fetch complete (54458 records). [2025-10-08T17:49:50.122934] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-08T17:49:50.146302] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:50.427350] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-08T17:49:50.529218] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-08T17:49:50.529312] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-08T17:49:50.529995] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-08T17:49:50.530060] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-08T17:49:50.531390] [DEBUG] [LOCAL ] BV: Trimmed 54458 records to 38524 (keeping 200 days of data) [2025-10-08T17:49:50.755842] [DEBUG] [LOCAL ] BV: Primary data saved (38524 records). [2025-10-08T17:49:50.756004] [INFO ] [MAIN ] BV: Full history saved. [2025-10-08T17:49:50.756085] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BV took 31.3s. Estimated remaining: 4h 35m 23s. Rate: 7.3 symbols/min [2025-10-08T17:49:50.924257] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:50.932746] [DEBUG] [LOCAL ] BWMX: Loaded 7672 existing records from primary storage. [2025-10-08T17:49:50.932927] [INFO ] [MAIN ] BWMX: Loaded 7672 existing records. [2025-10-08T17:49:51.111215] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:51.111454] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-08T17:49:51.111501] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-08T17:49:51.111717] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-08T17:49:51.111775] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-08T17:49:51.222720] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-08T17:49:51.471011] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:51.528567] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T17:49:51.869385] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:49:52.017531] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-08T17:49:52.237312] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T17:49:52.706906] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:49:52.817565] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-08T17:49:53.303613] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T17:49:53.617623] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-08T17:49:54.220343] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T17:49:54.417554] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-08T17:49:55.163270] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T17:49:55.217506] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-08T17:49:56.018672] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-08T17:49:56.019787] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T17:49:56.492403] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T17:49:56.817559] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-08T17:49:57.399484] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T17:49:57.617587] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-08T17:49:58.417566] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-08T17:49:59.214344] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T17:49:59.217978] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-08T17:49:59.219071] [INFO ] [REMOTE ] BWA: Full fetch complete (75700 records). [2025-10-08T17:49:59.219150] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-08T17:49:59.621963] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-08T17:49:59.622067] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-08T17:49:59.622932] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-08T17:49:59.623004] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-08T17:49:59.624639] [DEBUG] [LOCAL ] BWA: Trimmed 75700 records to 52154 (keeping 200 days of data) [2025-10-08T17:49:59.876247] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T17:49:59.978867] [DEBUG] [LOCAL ] BWA: Primary data saved (52154 records). [2025-10-08T17:49:59.979018] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-08T17:49:59.979931] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 40.5s. Estimated remaining: 4h 35m 20s. Rate: 7.3 symbols/min [2025-10-08T17:50:00.022613] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-08T17:50:00.141718] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T17:50:00.194006] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:00.201728] [DEBUG] [LOCAL ] BWNB: Loaded 4363 existing records from primary storage. [2025-10-08T17:50:00.201958] [INFO ] [MAIN ] BWNB: Loaded 4363 existing records. [2025-10-08T17:50:00.379453] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:00.379750] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-08T17:50:00.379804] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-08T17:50:00.380023] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-08T17:50:00.380082] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-08T17:50:00.727634] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:00.817505] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-08T17:50:01.408866] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-08T17:50:01.424476] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:50:01.617559] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-08T17:50:02.307245] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T17:50:02.417547] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-08T17:50:02.933297] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T17:50:03.217622] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-08T17:50:04.017510] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-08T17:50:04.272581] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:50:04.817589] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-08T17:50:04.862795] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:50:05.617556] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-08T17:50:06.116849] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:50:06.410906] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T17:50:06.417491] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-08T17:50:07.217568] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-08T17:50:07.264123] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T17:50:08.017523] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-08T17:50:08.055352] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T17:50:08.625010] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T17:50:08.817555] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-08T17:50:09.542438] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T17:50:09.543984] [INFO ] [REMOTE ] BWG: Full fetch complete (17849 records). [2025-10-08T17:50:09.544062] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-08T17:50:09.622630] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-08T17:50:09.903172] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-08T17:50:09.903249] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-08T17:50:09.903630] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-08T17:50:09.903712] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-08T17:50:09.904235] [DEBUG] [LOCAL ] BWG: Trimmed 17849 records to 12634 (keeping 200 days of data) [2025-10-08T17:50:09.975934] [DEBUG] [LOCAL ] BWG: Primary data saved (12634 records). [2025-10-08T17:50:09.976072] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-08T17:50:09.976156] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWG took 23.3s. Estimated remaining: 4h 35m 21s. Rate: 7.3 symbols/min [2025-10-08T17:50:10.150406] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:10.156946] [DEBUG] [LOCAL ] BWSN: Loaded 5170 existing records from primary storage. [2025-10-08T17:50:10.157120] [INFO ] [MAIN ] BWSN: Loaded 5170 existing records. [2025-10-08T17:50:10.335491] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:10.335802] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-08T17:50:10.335859] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-08T17:50:10.336265] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-08T17:50:10.336324] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-08T17:50:10.425201] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-08T17:50:10.694463] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:10.970103] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:50:11.217528] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-08T17:50:11.233446] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T17:50:11.926563] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T17:50:12.017556] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-08T17:50:12.817514] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-08T17:50:13.442498] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T17:50:13.462847] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T17:50:13.617595] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-08T17:50:14.417586] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-08T17:50:15.155567] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T17:50:15.161384] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T17:50:15.217541] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-08T17:50:15.896354] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T17:50:15.897411] [INFO ] [REMOTE ] BWMX: Full fetch complete (10076 records). [2025-10-08T17:50:15.897480] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-08T17:50:16.023029] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-08T17:50:16.262724] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-08T17:50:16.262810] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-08T17:50:16.263060] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-08T17:50:16.263120] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-08T17:50:16.264690] [DEBUG] [LOCAL ] BWMX: Trimmed 10076 records to 7690 (keeping 200 days of data) [2025-10-08T17:50:16.310502] [DEBUG] [LOCAL ] BWMX: Primary data saved (7690 records). [2025-10-08T17:50:16.310638] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-08T17:50:16.310770] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWMX took 25.6s. Estimated remaining: 4h 35m 3s. Rate: 7.3 symbols/min [2025-10-08T17:50:16.476817] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:16.477014] [DEBUG] [LOCAL ] BWXT: No existing data file found in primary storage. [2025-10-08T17:50:16.477052] [WARN ] [MAIN ] BWXT: No existing data found, performing full refresh instead. [2025-10-08T17:50:16.477214] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-08T17:50:16.477255] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-08T17:50:16.477295] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-10-08T17:50:16.477325] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-08T17:50:16.823697] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-08T17:50:16.828550] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:17.015863] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T17:50:17.617560] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-08T17:50:17.996016] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-08T17:50:18.347490] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T17:50:18.417562] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-08T17:50:18.851918] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T17:50:19.217584] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-08T17:50:20.017594] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-08T17:50:20.487408] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T17:50:20.656894] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:50:20.817557] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-08T17:50:21.617559] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-08T17:50:22.244082] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:50:22.417618] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-08T17:50:23.000472] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T17:50:23.217789] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-08T17:50:23.513384] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:50:23.729406] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T17:50:24.017598] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-08T17:50:24.683613] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T17:50:24.817595] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-08T17:50:25.617555] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-08T17:50:26.128248] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T17:50:26.200835] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T17:50:26.417604] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-08T17:50:27.217591] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-08T17:50:27.963160] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T17:50:28.017572] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-08T17:50:28.117472] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T17:50:28.301208] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-08T17:50:28.817583] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-08T17:50:29.193153] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T17:50:29.617582] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-08T17:50:30.417567] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-08T17:50:31.003704] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:50:31.006694] [INFO ] [REMOTE ] BWLP: Full fetch complete (47975 records). [2025-10-08T17:50:31.006812] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-08T17:50:31.123773] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T17:50:31.223751] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-08T17:50:31.416304] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-08T17:50:31.416398] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-08T17:50:31.417134] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-08T17:50:31.417199] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-08T17:50:31.418296] [DEBUG] [LOCAL ] BWLP: Trimmed 47975 records to 32306 (keeping 200 days of data) [2025-10-08T17:50:31.625356] [DEBUG] [LOCAL ] BWLP: Primary data saved (32306 records). [2025-10-08T17:50:31.625557] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-08T17:50:31.625693] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWLP took 42.3s. Estimated remaining: 4h 35m 33s. Rate: 7.3 symbols/min [2025-10-08T17:50:31.798971] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:31.853660] [DEBUG] [LOCAL ] BX: Loaded 53479 existing records from primary storage. [2025-10-08T17:50:31.853994] [INFO ] [MAIN ] BX: Loaded 53479 existing records. [2025-10-08T17:50:32.024745] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-08T17:50:32.029500] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:32.029924] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-08T17:50:32.031233] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-08T17:50:32.032319] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-08T17:50:32.032396] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-08T17:50:32.377409] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:32.557285] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T17:50:32.817560] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-08T17:50:33.017887] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T17:50:33.617560] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-08T17:50:34.036089] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T17:50:34.417522] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-08T17:50:34.478609] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T17:50:35.217560] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-08T17:50:36.017514] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-08T17:50:36.129047] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T17:50:36.694366] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T17:50:36.750305] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:50:36.817549] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-08T17:50:37.617609] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-08T17:50:38.256225] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T17:50:38.417518] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-08T17:50:38.553798] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T17:50:39.217637] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-08T17:50:39.815618] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T17:50:39.816606] [INFO ] [REMOTE ] BWSN: Full fetch complete (6261 records). [2025-10-08T17:50:39.816721] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-08T17:50:40.028350] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-08T17:50:40.191426] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-08T17:50:40.191514] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-08T17:50:40.191714] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-08T17:50:40.191776] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-08T17:50:40.192173] [DEBUG] [LOCAL ] BWSN: Trimmed 6261 records to 5147 (keeping 200 days of data) [2025-10-08T17:50:40.223779] [DEBUG] [LOCAL ] BWSN: Primary data saved (5147 records). [2025-10-08T17:50:40.223924] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-08T17:50:40.224011] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWSN took 30.2s. Estimated remaining: 4h 35m 27s. Rate: 7.3 symbols/min [2025-10-08T17:50:40.396339] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:40.410387] [DEBUG] [LOCAL ] BXC: Loaded 13701 existing records from primary storage. [2025-10-08T17:50:40.410592] [INFO ] [MAIN ] BXC: Loaded 13701 existing records. [2025-10-08T17:50:40.588932] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:40.589140] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-08T17:50:40.589186] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-08T17:50:40.589601] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-08T17:50:40.589693] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-08T17:50:40.832958] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-08T17:50:40.948911] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:41.617546] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-08T17:50:42.012788] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:50:42.016573] [INFO ] [REMOTE ] BWNB: Full fetch complete (5676 records). [2025-10-08T17:50:42.016443] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (3.60 seconds). [2025-10-08T17:50:42.016843] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-08T17:50:42.404501] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T17:50:42.407312] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-08T17:50:42.407407] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-08T17:50:42.407624] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-08T17:50:42.407706] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-08T17:50:42.408178] [DEBUG] [LOCAL ] BWNB: Trimmed 5676 records to 4255 (keeping 200 days of data) [2025-10-08T17:50:42.421723] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-08T17:50:42.436558] [DEBUG] [LOCAL ] BWNB: Primary data saved (4255 records). [2025-10-08T17:50:42.436716] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-08T17:50:42.436814] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWNB took 42.5s. Estimated remaining: 4h 34m 46s. Rate: 7.3 symbols/min [2025-10-08T17:50:42.607544] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:42.656891] [DEBUG] [LOCAL ] BXMT: Loaded 47180 existing records from primary storage. [2025-10-08T17:50:42.657226] [INFO ] [MAIN ] BXMT: Loaded 47180 existing records. [2025-10-08T17:50:42.836373] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:42.836581] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-08T17:50:42.836627] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-08T17:50:42.836912] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-08T17:50:42.836969] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-08T17:50:43.222110] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-08T17:50:43.236210] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:44.017704] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-08T17:50:44.063278] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (4.03 seconds). [2025-10-08T17:50:44.294609] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:50:44.817531] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-08T17:50:45.382557] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T17:50:45.625742] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-08T17:50:45.631588] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:50:45.670094] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-10-08T17:50:46.417556] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-08T17:50:47.217640] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-08T17:50:47.815713] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-08T17:50:48.017535] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-08T17:50:48.265059] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T17:50:48.797015] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T17:50:48.817508] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-08T17:50:49.557920] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T17:50:49.617527] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-08T17:50:49.979378] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:50:50.417542] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-08T17:50:51.217569] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-08T17:50:51.518008] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T17:50:52.017522] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-08T17:50:52.817530] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-08T17:50:52.856181] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-08T17:50:52.929405] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:50:53.059102] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T17:50:53.617609] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-08T17:50:54.417626] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-08T17:50:55.150110] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:50:55.173559] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T17:50:55.217511] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-08T17:50:55.357076] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-08T17:50:56.017576] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-08T17:50:56.817613] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-08T17:50:56.989850] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:50:57.617531] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-08T17:50:57.671219] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T17:50:57.808232] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T17:50:58.417617] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-08T17:50:59.223712] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-08T17:50:59.247693] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:51:00.017505] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-08T17:51:00.350835] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T17:51:00.817523] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-08T17:51:01.100400] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T17:51:01.305182] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T17:51:01.617587] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-08T17:51:02.417571] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-08T17:51:02.670201] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T17:51:02.676168] [INFO ] [REMOTE ] BX: Full fetch complete (77406 records). [2025-10-08T17:51:02.676363] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-08T17:51:03.070629] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-08T17:51:03.070749] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-08T17:51:03.071813] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-08T17:51:03.071910] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-08T17:51:03.073361] [DEBUG] [LOCAL ] BX: Trimmed 77406 records to 53479 (keeping 200 days of data) [2025-10-08T17:51:03.257315] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-08T17:51:03.316805] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T17:51:03.425572] [DEBUG] [LOCAL ] BX: Primary data saved (53479 records). [2025-10-08T17:51:03.425797] [INFO ] [MAIN ] BX: Full history saved. [2025-10-08T17:51:03.425978] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BX took 31.8s. Estimated remaining: 4h 35m 47s. Rate: 7.3 symbols/min [2025-10-08T17:51:03.595550] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:03.623569] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-08T17:51:03.647573] [DEBUG] [LOCAL ] BXMX: Loaded 19513 existing records from primary storage. [2025-10-08T17:51:03.647848] [INFO ] [MAIN ] BXMX: Loaded 19513 existing records. [2025-10-08T17:51:03.828379] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:03.828757] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-08T17:51:03.828824] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-08T17:51:03.829082] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-08T17:51:03.829138] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-08T17:51:04.039387] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-08T17:51:04.241981] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:04.586795] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:51:04.817531] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-08T17:51:05.036132] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:51:05.617510] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-08T17:51:05.841028] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T17:51:06.417544] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-08T17:51:07.217508] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-08T17:51:07.479962] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T17:51:07.684570] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T17:51:08.017530] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-08T17:51:08.817537] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-08T17:51:08.853260] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T17:51:09.061431] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T17:51:09.065436] [INFO ] [REMOTE ] BWXT: Full fetch complete (67615 records). [2025-10-08T17:51:09.065563] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-08T17:51:09.476173] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-08T17:51:09.476262] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-08T17:51:09.477011] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-08T17:51:09.477079] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-08T17:51:09.478449] [DEBUG] [LOCAL ] BWXT: Trimmed 67615 records to 46822 (keeping 200 days of data) [2025-10-08T17:51:09.596347] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T17:51:09.617717] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-08T17:51:09.800821] [DEBUG] [LOCAL ] BWXT: Primary data saved (46822 records). [2025-10-08T17:51:09.800993] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-08T17:51:09.801097] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 53.5s. Estimated remaining: 4h 35m 28s. Rate: 7.3 symbols/min [2025-10-08T17:51:09.967575] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:10.014120] [DEBUG] [LOCAL ] BXP: Loaded 49822 existing records from primary storage. [2025-10-08T17:51:10.014470] [INFO ] [MAIN ] BXP: Loaded 49822 existing records. [2025-10-08T17:51:10.188234] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:10.188428] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-08T17:51:10.188490] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-08T17:51:10.188918] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-08T17:51:10.188975] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-08T17:51:10.429809] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-08T17:51:10.592272] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:10.772270] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T17:51:11.217515] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-08T17:51:11.346381] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T17:51:12.017607] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-08T17:51:12.379368] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:51:12.817551] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-08T17:51:13.617618] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-08T17:51:13.645407] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T17:51:13.649928] [INFO ] [REMOTE ] BXMT: Full fetch complete (69701 records). [2025-10-08T17:51:13.650070] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-08T17:51:13.801059] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:51:14.071286] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-08T17:51:14.071388] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-08T17:51:14.072182] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-08T17:51:14.072252] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-08T17:51:14.073833] [DEBUG] [LOCAL ] BXMT: Trimmed 69701 records to 47172 (keeping 200 days of data) [2025-10-08T17:51:14.366618] [DEBUG] [LOCAL ] BXMT: Primary data saved (47172 records). [2025-10-08T17:51:14.366815] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-08T17:51:14.366907] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BXMT took 31.9s. Estimated remaining: 4h 35m 0s. Rate: 7.3 symbols/min [2025-10-08T17:51:14.430777] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-08T17:51:14.542311] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:14.591807] [DEBUG] [LOCAL ] BXSL: Loaded 47768 existing records from primary storage. [2025-10-08T17:51:14.592239] [INFO ] [MAIN ] BXSL: Loaded 47768 existing records. [2025-10-08T17:51:14.774509] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:14.774835] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-08T17:51:14.774948] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-08T17:51:14.776457] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-08T17:51:14.776523] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-08T17:51:15.132085] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:15.217518] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-08T17:51:15.258406] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T17:51:15.305595] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T17:51:15.307129] [INFO ] [REMOTE ] BXC: Full fetch complete (18127 records). [2025-10-08T17:51:15.307202] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-08T17:51:15.682105] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-08T17:51:15.682213] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-08T17:51:15.682847] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-08T17:51:15.682918] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-08T17:51:15.683882] [DEBUG] [LOCAL ] BXC: Trimmed 18127 records to 13686 (keeping 200 days of data) [2025-10-08T17:51:15.773674] [DEBUG] [LOCAL ] BXC: Primary data saved (13686 records). [2025-10-08T17:51:15.773852] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-08T17:51:15.773978] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXC took 35.5s. Estimated remaining: 4h 34m 15s. Rate: 7.3 symbols/min [2025-10-08T17:51:15.965469] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:15.987673] [DEBUG] [LOCAL ] BY: Loaded 21734 existing records from primary storage. [2025-10-08T17:51:15.987955] [INFO ] [MAIN ] BY: Loaded 21734 existing records. [2025-10-08T17:51:16.022772] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-08T17:51:16.166660] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:16.166896] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-08T17:51:16.166942] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-08T17:51:16.167124] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-08T17:51:16.167180] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-08T17:51:16.548838] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:16.817524] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-08T17:51:16.868058] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T17:51:17.278843] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:51:17.617553] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-08T17:51:17.934440] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T17:51:18.417566] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-08T17:51:19.199951] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T17:51:19.217507] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-08T17:51:19.775214] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:51:20.017565] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-08T17:51:20.817544] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-08T17:51:21.123805] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T17:51:21.600304] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T17:51:21.617520] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-08T17:51:21.880439] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T17:51:22.417535] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-08T17:51:23.217534] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-08T17:51:23.318856] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:51:23.411109] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T17:51:24.017629] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-08T17:51:24.237312] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T17:51:24.817609] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-08T17:51:24.843082] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T17:51:25.569077] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:51:25.617525] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-08T17:51:26.417634] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-08T17:51:26.686744] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T17:51:27.217557] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-08T17:51:28.017518] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-08T17:51:28.158310] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:51:28.567758] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T17:51:28.817518] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-08T17:51:29.160803] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T17:51:29.617601] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-08T17:51:30.417633] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-08T17:51:30.493138] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:51:31.217836] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-08T17:51:31.755460] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T17:51:31.955413] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T17:51:32.017676] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-08T17:51:32.194575] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:51:32.197333] [INFO ] [REMOTE ] BXMX: Full fetch complete (28812 records). [2025-10-08T17:51:32.197457] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-08T17:51:32.691921] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-08T17:51:32.692005] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-08T17:51:32.692465] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-08T17:51:32.692529] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-08T17:51:32.693378] [DEBUG] [LOCAL ] BXMX: Trimmed 28812 records to 19532 (keeping 200 days of data) [2025-10-08T17:51:32.817774] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-08T17:51:32.823915] [DEBUG] [LOCAL ] BXMX: Primary data saved (19532 records). [2025-10-08T17:51:32.825858] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-08T17:51:32.826047] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 29.4s. Estimated remaining: 4h 34m 54s. Rate: 7.3 symbols/min [2025-10-08T17:51:33.015971] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:33.016602] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T17:51:33.061111] [DEBUG] [LOCAL ] BYD: Loaded 44885 existing records from primary storage. [2025-10-08T17:51:33.061431] [INFO ] [MAIN ] BYD: Loaded 44885 existing records. [2025-10-08T17:51:33.239700] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:33.239941] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-08T17:51:33.239989] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-08T17:51:33.241419] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-08T17:51:33.241482] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-08T17:51:33.608955] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:33.617491] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-08T17:51:33.725462] [DEBUG] [REMOTE ] BYD: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-08T17:51:33.725815] [WARN ] [REMOTE ] BYD: No data returned for month 2024-12 [2025-10-08T17:51:33.725922] [FATAL] [REMOTE ] BYD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:51:33.725976] [FATAL] [MAIN ] BYD: Failed to fetch primary data. [2025-10-08T17:51:33.726041] [WARN ] [MAIN ] BYD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:51:33.726141] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-08T17:51:33.726237] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-08T17:51:33.726285] [INFO ] [LOCAL ] BYD: Starting deletion of derivative data. [2025-10-08T17:51:33.726634] [DEBUG] [LOCAL ] BYD: Deleted derivative data file. [2025-10-08T17:51:33.726766] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BYD took 0.9s. Estimated remaining: 4h 34m 6s. Rate: 7.3 symbols/min [2025-10-08T17:51:33.947967] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:33.963197] [DEBUG] [LOCAL ] BYM: Loaded 11929 existing records from primary storage. [2025-10-08T17:51:33.963437] [INFO ] [MAIN ] BYM: Loaded 11929 existing records. [2025-10-08T17:51:34.192243] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:34.192559] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-08T17:51:34.192708] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-08T17:51:34.192958] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-08T17:51:34.193016] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-08T17:51:34.422954] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-08T17:51:34.606268] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T17:51:34.609993] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:35.217629] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-08T17:51:36.017520] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-08T17:51:36.109338] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:51:36.312511] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:51:36.749469] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:51:36.817529] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-08T17:51:37.617570] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-08T17:51:38.417525] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-08T17:51:38.449505] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T17:51:38.956225] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:51:39.217549] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-08T17:51:39.567745] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:51:40.017590] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-08T17:51:40.822821] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-08T17:51:40.835607] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T17:51:40.856283] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:51:41.617558] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-08T17:51:42.417588] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-08T17:51:42.486499] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:51:42.547344] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T17:51:43.217569] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-08T17:51:44.017521] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-08T17:51:44.061576] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:51:44.099095] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T17:51:44.817557] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-08T17:51:45.111726] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:51:45.617581] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-08T17:51:46.417517] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-08T17:51:46.532586] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T17:51:46.536410] [INFO ] [REMOTE ] BXP: Full fetch complete (71777 records). [2025-10-08T17:51:46.536528] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-08T17:51:46.926661] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-08T17:51:46.926755] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-08T17:51:46.927519] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-08T17:51:46.927563] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-08T17:51:46.929310] [DEBUG] [LOCAL ] BXP: Trimmed 71777 records to 49803 (keeping 200 days of data) [2025-10-08T17:51:47.228707] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:51:47.244017] [INFO ] [REMOTE ] BY: Full fetch complete (29595 records). [2025-10-08T17:51:47.244077] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-08T17:51:47.246036] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-08T17:51:47.249307] [DEBUG] [LOCAL ] BXP: Primary data saved (49803 records). [2025-10-08T17:51:47.270310] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-08T17:51:47.271933] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXP took 37.5s. Estimated remaining: 4h 34m 26s. Rate: 7.3 symbols/min [2025-10-08T17:51:47.620118] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:47.710939] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T17:51:47.835603] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-08T17:51:47.845949] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-08T17:51:47.846426] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-08T17:51:47.846533] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-08T17:51:47.847310] [DEBUG] [LOCAL ] BZH: Loaded 32402 existing records from primary storage. [2025-10-08T17:51:47.848046] [INFO ] [MAIN ] BZH: Loaded 32402 existing records. [2025-10-08T17:51:47.924525] [DEBUG] [LOCAL ] BY: Trimmed 29595 records to 21660 (keeping 200 days of data) [2025-10-08T17:51:48.022138] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-08T17:51:48.141401] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:48.142735] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-08T17:51:48.144095] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-08T17:51:48.145171] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-08T17:51:48.145600] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-08T17:51:48.514624] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:48.532848] [DEBUG] [LOCAL ] BY: Primary data saved (21660 records). [2025-10-08T17:51:48.532953] [INFO ] [MAIN ] BY: Full history saved. [2025-10-08T17:51:48.533025] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BY took 32.8s. Estimated remaining: 4h 33m 41s. Rate: 7.3 symbols/min [2025-10-08T17:51:48.710294] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:48.762932] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-08T17:51:48.763282] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-08T17:51:48.832775] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-08T17:51:48.948874] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:48.949290] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-08T17:51:48.949391] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-08T17:51:48.949688] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-08T17:51:48.949758] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-08T17:51:49.244707] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T17:51:49.278576] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T17:51:49.367122] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:49.617584] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-08T17:51:49.988111] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T17:51:50.417567] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-08T17:51:51.217522] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-08T17:51:51.727987] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-08T17:51:51.945025] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T17:51:51.948935] [INFO ] [REMOTE ] BXSL: Full fetch complete (69596 records). [2025-10-08T17:51:51.949060] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-08T17:51:52.023962] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-08T17:51:52.360109] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T17:51:52.406578] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-08T17:51:52.406686] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-08T17:51:52.407440] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-08T17:51:52.407483] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-08T17:51:52.408972] [DEBUG] [LOCAL ] BXSL: Trimmed 69596 records to 47831 (keeping 200 days of data) [2025-10-08T17:51:52.703372] [DEBUG] [LOCAL ] BXSL: Primary data saved (47831 records). [2025-10-08T17:51:52.703535] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-08T17:51:52.703639] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BXSL took 38.3s. Estimated remaining: 4h 33m 12s. Rate: 7.3 symbols/min [2025-10-08T17:51:52.822749] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-08T17:51:52.877855] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:52.899182] [DEBUG] [LOCAL ] CAAP: Loaded 19823 existing records from primary storage. [2025-10-08T17:51:52.899453] [INFO ] [MAIN ] CAAP: Loaded 19823 existing records. [2025-10-08T17:51:53.075915] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:53.076169] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-08T17:51:53.076216] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-08T17:51:53.076410] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-08T17:51:53.076467] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-08T17:51:53.432311] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:53.617528] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-08T17:51:53.688592] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T17:51:53.973546] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T17:51:54.417591] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-08T17:51:55.094923] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T17:51:55.109125] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T17:51:55.217492] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-08T17:51:56.017587] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-08T17:51:56.606912] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T17:51:56.817576] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-08T17:51:57.617527] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-08T17:51:57.798766] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T17:51:57.887450] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T17:51:58.266741] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T17:51:58.417562] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-08T17:51:59.217544] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-08T17:51:59.440089] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:52:00.017564] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-08T17:52:00.817598] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-08T17:52:01.436263] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-08T17:52:01.617511] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-08T17:52:01.919999] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T17:52:02.097016] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T17:52:02.417562] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-08T17:52:03.196862] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T17:52:03.217502] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-08T17:52:04.017533] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-08T17:52:04.169403] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-08T17:52:04.194513] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T17:52:04.817541] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-08T17:52:05.415839] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:52:05.617508] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-08T17:52:05.744864] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T17:52:05.746289] [INFO ] [REMOTE ] BYM: Full fetch complete (17949 records). [2025-10-08T17:52:05.746362] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-08T17:52:06.105256] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-08T17:52:06.105335] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-08T17:52:06.105687] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-08T17:52:06.105754] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-08T17:52:06.106264] [DEBUG] [LOCAL ] BYM: Trimmed 17949 records to 11961 (keeping 200 days of data) [2025-10-08T17:52:06.180882] [DEBUG] [LOCAL ] BYM: Primary data saved (11961 records). [2025-10-08T17:52:06.181030] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-08T17:52:06.181111] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 32.5s. Estimated remaining: 4h 33m 31s. Rate: 7.3 symbols/min [2025-10-08T17:52:06.348215] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:06.365973] [DEBUG] [LOCAL ] CABO: Loaded 16889 existing records from primary storage. [2025-10-08T17:52:06.366220] [INFO ] [MAIN ] CABO: Loaded 16889 existing records. [2025-10-08T17:52:06.428176] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-08T17:52:06.547803] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:06.548012] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-08T17:52:06.548061] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-08T17:52:06.548326] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-08T17:52:06.548389] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-08T17:52:06.910673] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:06.928471] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T17:52:07.217612] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-08T17:52:08.017585] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-08T17:52:08.713364] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-08T17:52:08.817545] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-08T17:52:08.925555] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:52:09.025764] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:52:09.617584] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-08T17:52:10.417519] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-08T17:52:10.765303] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T17:52:10.945048] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:52:11.094867] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T17:52:11.217580] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-08T17:52:12.017572] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-08T17:52:12.718022] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T17:52:12.817549] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-08T17:52:13.617563] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-08T17:52:14.084753] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:52:14.087839] [INFO ] [REMOTE ] BZH: Full fetch complete (47041 records). [2025-10-08T17:52:14.087943] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-08T17:52:14.421582] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-08T17:52:14.499617] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-08T17:52:14.622464] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-08T17:52:14.622686] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-08T17:52:14.623367] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-08T17:52:14.628695] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-08T17:52:14.636385] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T17:52:14.642202] [DEBUG] [LOCAL ] BZH: Trimmed 47041 records to 32393 (keeping 200 days of data) [2025-10-08T17:52:14.853894] [DEBUG] [LOCAL ] BZH: Primary data saved (32393 records). [2025-10-08T17:52:14.854057] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-08T17:52:14.854148] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 27.6s. Estimated remaining: 4h 33m 25s. Rate: 7.3 symbols/min [2025-10-08T17:52:15.036961] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:15.064175] [DEBUG] [LOCAL ] CACI: Loaded 24024 existing records from primary storage. [2025-10-08T17:52:15.064572] [INFO ] [MAIN ] CACI: Loaded 24024 existing records. [2025-10-08T17:52:15.222718] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-08T17:52:15.294090] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:15.294631] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-08T17:52:15.294725] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-08T17:52:15.295044] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-08T17:52:15.295104] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-08T17:52:15.440494] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:52:15.701083] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:16.017694] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-08T17:52:16.817581] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-08T17:52:16.930634] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:52:17.260933] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-08T17:52:17.484565] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T17:52:17.617607] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-08T17:52:18.417533] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-08T17:52:18.444049] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T17:52:19.217589] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-08T17:52:19.712395] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T17:52:20.017598] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-08T17:52:20.285994] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:52:20.817571] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-08T17:52:21.617517] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-08T17:52:21.719381] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T17:52:22.043951] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T17:52:22.220835] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T17:52:22.417567] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-08T17:52:23.080582] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T17:52:23.217617] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-08T17:52:24.017615] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-08T17:52:24.535052] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:52:24.817580] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-08T17:52:25.617577] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-08T17:52:26.019982] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T17:52:26.036004] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T17:52:26.039940] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-08T17:52:26.040053] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-08T17:52:26.424929] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-08T17:52:26.444994] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-08T17:52:26.445055] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-08T17:52:26.445906] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-08T17:52:26.445969] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-08T17:52:26.447517] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53740 (keeping 200 days of data) [2025-10-08T17:52:26.705287] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T17:52:26.831537] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-08T17:52:26.831729] [INFO ] [MAIN ] C: Full history saved. [2025-10-08T17:52:26.831828] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. C took 38.3s. Estimated remaining: 4h 33m 36s. Rate: 7.3 symbols/min [2025-10-08T17:52:27.005937] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:27.050605] [DEBUG] [LOCAL ] CADE: Loaded 49123 existing records from primary storage. [2025-10-08T17:52:27.051167] [INFO ] [MAIN ] CADE: Loaded 49123 existing records. [2025-10-08T17:52:27.224827] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-08T17:52:27.229920] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:27.230981] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-08T17:52:27.231037] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-08T17:52:27.231277] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-08T17:52:27.231333] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-08T17:52:27.592467] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:27.597775] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T17:52:27.599819] [INFO ] [REMOTE ] CAAP: Full fetch complete (27748 records). [2025-10-08T17:52:27.599893] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-08T17:52:27.974365] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-08T17:52:27.974444] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-08T17:52:27.974885] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-08T17:52:27.974947] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-08T17:52:27.975586] [DEBUG] [LOCAL ] CAAP: Trimmed 27748 records to 19804 (keeping 200 days of data) [2025-10-08T17:52:28.028224] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-08T17:52:28.097483] [DEBUG] [LOCAL ] CAAP: Primary data saved (19804 records). [2025-10-08T17:52:28.097611] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-08T17:52:28.097718] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CAAP took 35.4s. Estimated remaining: 4h 32m 52s. Rate: 7.3 symbols/min [2025-10-08T17:52:28.263742] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:28.299161] [DEBUG] [LOCAL ] CAE: Loaded 39206 existing records from primary storage. [2025-10-08T17:52:28.299456] [INFO ] [MAIN ] CAE: Loaded 39206 existing records. [2025-10-08T17:52:28.473441] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:28.473657] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-08T17:52:28.473719] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-08T17:52:28.475088] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-08T17:52:28.475149] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-08T17:52:28.841335] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-08T17:52:28.849260] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:28.910589] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:52:29.232827] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T17:52:29.617592] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-08T17:52:30.321679] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T17:52:30.417545] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-08T17:52:31.067507] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:52:31.217597] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-08T17:52:31.850748] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:52:32.017571] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-08T17:52:32.615801] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:52:32.817573] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-08T17:52:33.285866] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T17:52:33.617568] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-08T17:52:33.989624] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T17:52:34.417705] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-08T17:52:34.602032] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:52:35.217527] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-08T17:52:35.358318] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T17:52:36.017520] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-08T17:52:36.261897] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T17:52:36.817567] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-08T17:52:37.617524] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-08T17:52:37.718217] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:52:37.818957] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T17:52:38.417547] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-08T17:52:38.591223] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T17:52:39.217587] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-08T17:52:39.359035] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T17:52:40.017565] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-08T17:52:40.310700] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T17:52:40.817548] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-08T17:52:41.617569] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-08T17:52:41.739820] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T17:52:41.869783] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T17:52:42.417578] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-08T17:52:42.916785] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:52:43.217580] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-08T17:52:43.243673] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:52:43.245435] [INFO ] [REMOTE ] CACI: Full fetch complete (38636 records). [2025-10-08T17:52:43.245511] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-08T17:52:43.621978] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-08T17:52:43.622067] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-08T17:52:43.622625] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-08T17:52:43.622710] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-08T17:52:43.623562] [DEBUG] [LOCAL ] CACI: Trimmed 38636 records to 23827 (keeping 200 days of data) [2025-10-08T17:52:43.767132] [DEBUG] [LOCAL ] CACI: Primary data saved (23827 records). [2025-10-08T17:52:43.767300] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-08T17:52:43.767449] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. CACI took 28.9s. Estimated remaining: 4h 33m 22s. Rate: 7.3 symbols/min [2025-10-08T17:52:43.938226] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:43.945288] [DEBUG] [LOCAL ] CAF: Loaded 3410 existing records from primary storage. [2025-10-08T17:52:43.945493] [INFO ] [MAIN ] CAF: Loaded 3410 existing records. [2025-10-08T17:52:44.019721] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-08T17:52:44.130582] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:44.130857] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-08T17:52:44.130987] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-08T17:52:44.131207] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-08T17:52:44.131274] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-08T17:52:44.182130] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T17:52:44.500284] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:44.817608] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-08T17:52:45.323323] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:52:45.548566] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:52:45.617549] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-08T17:52:46.217106] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T17:52:46.417552] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-08T17:52:47.016345] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T17:52:47.217559] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-08T17:52:48.017601] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-08T17:52:48.672497] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T17:52:48.777770] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T17:52:48.779237] [INFO ] [REMOTE ] CABO: Full fetch complete (23109 records). [2025-10-08T17:52:48.779331] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-08T17:52:48.822708] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-08T17:52:49.154866] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-08T17:52:49.154955] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-08T17:52:49.155415] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-08T17:52:49.155479] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-08T17:52:49.156223] [DEBUG] [LOCAL ] CABO: Trimmed 23109 records to 16872 (keeping 200 days of data) [2025-10-08T17:52:49.268254] [DEBUG] [LOCAL ] CABO: Primary data saved (16872 records). [2025-10-08T17:52:49.268400] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-08T17:52:49.268510] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CABO took 43.1s. Estimated remaining: 4h 32m 60s. Rate: 7.3 symbols/min [2025-10-08T17:52:49.440161] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:49.455662] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T17:52:49.499573] [DEBUG] [LOCAL ] CAG: Loaded 53664 existing records from primary storage. [2025-10-08T17:52:49.499946] [INFO ] [MAIN ] CAG: Loaded 53664 existing records. [2025-10-08T17:52:49.622613] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-08T17:52:49.677466] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:49.677671] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-08T17:52:49.677731] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-08T17:52:49.679271] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-08T17:52:49.679345] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-08T17:52:50.066245] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:50.417601] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-08T17:52:51.035201] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T17:52:51.217547] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-08T17:52:52.017568] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-08T17:52:52.144764] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T17:52:52.227834] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T17:52:52.817564] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-08T17:52:53.461538] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T17:52:53.617527] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-08T17:52:53.860386] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T17:52:54.417575] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-08T17:52:55.136972] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T17:52:55.217568] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-08T17:52:55.915592] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T17:52:56.017538] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-08T17:52:56.817549] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-08T17:52:56.959627] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T17:52:57.617525] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-08T17:52:57.973519] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T17:52:58.419503] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-08T17:52:58.421952] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T17:52:59.051000] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:52:59.217552] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-08T17:53:00.017524] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-08T17:53:00.138910] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T17:53:00.736018] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T17:53:00.817520] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-08T17:53:01.617576] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-08T17:53:01.760476] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T17:53:01.909296] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:53:02.285462] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T17:53:02.417595] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-08T17:53:03.217602] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-08T17:53:03.836580] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T17:53:03.840197] [INFO ] [REMOTE ] CAE: Full fetch complete (56214 records). [2025-10-08T17:53:03.840409] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-08T17:53:04.018393] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-08T17:53:04.327770] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-08T17:53:04.327964] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-08T17:53:04.329282] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-08T17:53:04.329475] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-08T17:53:04.331392] [DEBUG] [LOCAL ] CAE: Trimmed 56214 records to 39208 (keeping 200 days of data) [2025-10-08T17:53:04.585197] [DEBUG] [LOCAL ] CAE: Primary data saved (39208 records). [2025-10-08T17:53:04.585460] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-08T17:53:04.585620] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAE took 36.5s. Estimated remaining: 4h 33m 28s. Rate: 7.3 symbols/min [2025-10-08T17:53:04.681428] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T17:53:04.800733] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:04.817608] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-08T17:53:04.866066] [DEBUG] [LOCAL ] CAH: Loaded 51479 existing records from primary storage. [2025-10-08T17:53:04.866718] [INFO ] [MAIN ] CAH: Loaded 51479 existing records. [2025-10-08T17:53:05.078233] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:05.078748] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-08T17:53:05.078830] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-08T17:53:05.080517] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-08T17:53:05.080619] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-08T17:53:05.426359] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-08T17:53:05.518480] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:05.617566] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-08T17:53:06.051211] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T17:53:06.417627] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-08T17:53:06.509062] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:53:06.514540] [INFO ] [REMOTE ] CADE: Full fetch complete (70123 records). [2025-10-08T17:53:06.514793] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-08T17:53:06.950589] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T17:53:06.977015] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-08T17:53:06.977128] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-08T17:53:06.977959] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-08T17:53:06.978026] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-08T17:53:06.979596] [DEBUG] [LOCAL ] CADE: Trimmed 70123 records to 49166 (keeping 200 days of data) [2025-10-08T17:53:07.217765] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-08T17:53:07.291635] [DEBUG] [LOCAL ] CADE: Primary data saved (49166 records). [2025-10-08T17:53:07.291840] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-08T17:53:07.291934] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CADE took 40.5s. Estimated remaining: 4h 32m 51s. Rate: 7.3 symbols/min [2025-10-08T17:53:07.465884] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:07.517179] [DEBUG] [LOCAL ] CAL: Loaded 43072 existing records from primary storage. [2025-10-08T17:53:07.517774] [INFO ] [MAIN ] CAL: Loaded 43072 existing records. [2025-10-08T17:53:07.701463] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:07.701773] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-08T17:53:07.701837] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-08T17:53:07.703185] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-08T17:53:07.703253] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-08T17:53:07.887711] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T17:53:08.022780] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-08T17:53:08.077558] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:08.817630] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-08T17:53:09.445001] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T17:53:09.445932] [INFO ] [REMOTE ] CAF: Full fetch complete (5559 records). [2025-10-08T17:53:09.446006] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-08T17:53:09.619863] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-08T17:53:09.846703] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-08T17:53:09.846875] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-08T17:53:09.847171] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-08T17:53:09.847347] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-08T17:53:09.848477] [DEBUG] [LOCAL ] CAF: Trimmed 5559 records to 3399 (keeping 200 days of data) [2025-10-08T17:53:09.890217] [DEBUG] [LOCAL ] CAF: Primary data saved (3399 records). [2025-10-08T17:53:09.903929] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-08T17:53:09.907188] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAF took 26.1s. Estimated remaining: 4h 32m 14s. Rate: 7.3 symbols/min [2025-10-08T17:53:09.920502] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:53:10.093345] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:10.130283] [DEBUG] [LOCAL ] CALX: Loaded 37780 existing records from primary storage. [2025-10-08T17:53:10.130600] [INFO ] [MAIN ] CALX: Loaded 37780 existing records. [2025-10-08T17:53:10.309806] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:10.310111] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-08T17:53:10.310182] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-08T17:53:10.311314] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-08T17:53:10.311379] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-08T17:53:10.422781] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-08T17:53:10.678575] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:11.072268] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:53:11.217505] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-08T17:53:12.017551] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-08T17:53:12.385194] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T17:53:12.547101] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T17:53:12.817591] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-08T17:53:13.617526] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-08T17:53:13.707358] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:53:14.246285] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T17:53:14.417552] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-08T17:53:15.217589] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-08T17:53:15.307175] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:53:15.763131] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T17:53:16.017631] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-08T17:53:16.626972] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:53:16.817678] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-08T17:53:17.617546] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-08T17:53:17.910475] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T17:53:18.265978] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T17:53:18.417597] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-08T17:53:18.943824] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T17:53:19.217619] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-08T17:53:19.964882] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T17:53:20.017514] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-08T17:53:20.817533] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-08T17:53:21.230552] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T17:53:21.628059] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-08T17:53:21.633559] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:53:22.184447] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T17:53:22.417534] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-08T17:53:23.217511] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-08T17:53:23.301331] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T17:53:23.930072] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T17:53:24.017754] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-08T17:53:24.789601] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T17:53:24.817489] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-08T17:53:25.457121] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T17:53:25.617555] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-08T17:53:26.069600] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T17:53:26.417551] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-08T17:53:27.217696] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-08T17:53:27.461944] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:53:27.857580] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T17:53:28.017537] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-08T17:53:28.346522] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T17:53:28.817553] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-08T17:53:29.617686] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-08T17:53:29.669951] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T17:53:30.401341] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T17:53:30.417503] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-08T17:53:30.836495] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T17:53:31.217579] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-08T17:53:32.017601] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-08T17:53:32.229058] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T17:53:32.817519] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-08T17:53:32.975829] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T17:53:33.617623] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-08T17:53:33.906010] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-08T17:53:33.911709] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-08T17:53:33.911848] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-08T17:53:34.315277] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-08T17:53:34.315373] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-08T17:53:34.316223] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-08T17:53:34.316289] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-08T17:53:34.317874] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 53664 (keeping 200 days of data) [2025-10-08T17:53:34.419235] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-08T17:53:34.582803] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T17:53:34.700244] [DEBUG] [LOCAL ] CAG: Primary data saved (53664 records). [2025-10-08T17:53:34.700420] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-08T17:53:34.700539] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 45.4s. Estimated remaining: 4h 33m 30s. Rate: 7.3 symbols/min [2025-10-08T17:53:34.879327] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:34.901684] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T17:53:34.931582] [DEBUG] [LOCAL ] CANG: Loaded 26957 existing records from primary storage. [2025-10-08T17:53:34.931915] [INFO ] [MAIN ] CANG: Loaded 26957 existing records. [2025-10-08T17:53:35.106375] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:35.106581] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-08T17:53:35.106680] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-08T17:53:35.106945] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-08T17:53:35.107019] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-08T17:53:35.222617] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-08T17:53:35.482534] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:35.647989] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:53:35.651351] [INFO ] [REMOTE ] CAL: Full fetch complete (61805 records). [2025-10-08T17:53:35.651449] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-08T17:53:36.026413] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-08T17:53:36.047253] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-08T17:53:36.047335] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-08T17:53:36.048038] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-08T17:53:36.048104] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-08T17:53:36.049373] [DEBUG] [LOCAL ] CAL: Trimmed 61805 records to 43047 (keeping 200 days of data) [2025-10-08T17:53:36.308448] [DEBUG] [LOCAL ] CAL: Primary data saved (43047 records). [2025-10-08T17:53:36.308603] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-08T17:53:36.308720] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 29.0s. Estimated remaining: 4h 32m 48s. Rate: 7.3 symbols/min [2025-10-08T17:53:36.477042] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:36.484705] [DEBUG] [LOCAL ] CAPL: Loaded 5715 existing records from primary storage. [2025-10-08T17:53:36.484915] [INFO ] [MAIN ] CAPL: Loaded 5715 existing records. [2025-10-08T17:53:36.663354] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:36.663538] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-08T17:53:36.663583] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-08T17:53:36.663894] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-08T17:53:36.663953] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-08T17:53:36.846765] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-08T17:53:37.034827] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:37.062773] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:53:37.458885] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T17:53:37.617569] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-08T17:53:38.332807] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T17:53:38.358620] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:53:38.417519] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-08T17:53:39.028561] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T17:53:39.217621] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-08T17:53:40.017600] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-08T17:53:40.608486] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T17:53:40.768214] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T17:53:40.817555] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-08T17:53:41.617627] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-08T17:53:42.135867] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T17:53:42.148762] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T17:53:42.417578] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-08T17:53:43.217552] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-08T17:53:43.938715] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T17:53:44.020062] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-08T17:53:44.023615] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:53:44.028101] [INFO ] [REMOTE ] CAH: Full fetch complete (74596 records). [2025-10-08T17:53:44.028244] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-08T17:53:44.420595] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-08T17:53:44.420718] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-08T17:53:44.421516] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-08T17:53:44.421560] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-08T17:53:44.423009] [DEBUG] [LOCAL ] CAH: Trimmed 74596 records to 51469 (keeping 200 days of data) [2025-10-08T17:53:44.749095] [DEBUG] [LOCAL ] CAH: Primary data saved (51469 records). [2025-10-08T17:53:44.749242] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-08T17:53:44.749352] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 40.2s. Estimated remaining: 4h 32m 41s. Rate: 7.3 symbols/min [2025-10-08T17:53:44.822850] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-08T17:53:44.920258] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:44.969785] [DEBUG] [LOCAL ] CARR: Loaded 53597 existing records from primary storage. [2025-10-08T17:53:44.970131] [INFO ] [MAIN ] CARR: Loaded 53597 existing records. [2025-10-08T17:53:45.147923] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:45.148254] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-08T17:53:45.148418] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-08T17:53:45.150100] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-08T17:53:45.150186] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-08T17:53:45.515230] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:45.535286] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T17:53:45.617500] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-08T17:53:46.102008] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:53:46.104846] [INFO ] [REMOTE ] CALX: Full fetch complete (54037 records). [2025-10-08T17:53:46.104981] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-08T17:53:46.422608] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-08T17:53:46.490566] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-08T17:53:46.490882] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-08T17:53:46.491575] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-08T17:53:46.491636] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-08T17:53:46.492862] [DEBUG] [LOCAL ] CALX: Trimmed 54037 records to 37736 (keeping 200 days of data) [2025-10-08T17:53:46.714470] [DEBUG] [LOCAL ] CALX: Primary data saved (37736 records). [2025-10-08T17:53:46.714621] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-08T17:53:46.714750] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 36.8s. Estimated remaining: 4h 32m 0s. Rate: 7.3 symbols/min [2025-10-08T17:53:46.880956] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:46.920302] [DEBUG] [LOCAL ] CARS: Loaded 39739 existing records from primary storage. [2025-10-08T17:53:46.920625] [INFO ] [MAIN ] CARS: Loaded 39739 existing records. [2025-10-08T17:53:47.054391] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T17:53:47.109875] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:47.113393] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-08T17:53:47.114042] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-08T17:53:47.115182] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-08T17:53:47.115246] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-08T17:53:47.223414] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-08T17:53:47.497405] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:47.517306] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:53:47.619874] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T17:53:48.017564] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-08T17:53:48.817570] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-08T17:53:49.508238] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:53:49.617522] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-08T17:53:49.654844] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T17:53:50.314266] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T17:53:50.417540] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-08T17:53:51.217567] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-08T17:53:51.662208] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T17:53:51.942075] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:53:52.017558] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-08T17:53:52.817563] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-08T17:53:53.617558] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-08T17:53:53.844991] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T17:53:54.080184] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T17:53:54.083197] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T17:53:54.092867] [INFO ] [REMOTE ] CAPL: Full fetch complete (8729 records). [2025-10-08T17:53:54.092987] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-08T17:53:54.429940] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-08T17:53:54.445369] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-08T17:53:54.446602] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-08T17:53:54.446937] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-08T17:53:54.446993] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-08T17:53:54.447440] [DEBUG] [LOCAL ] CAPL: Trimmed 8729 records to 5700 (keeping 200 days of data) [2025-10-08T17:53:54.481997] [DEBUG] [LOCAL ] CAPL: Primary data saved (5700 records). [2025-10-08T17:53:54.482106] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-08T17:53:54.482188] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAPL took 18.2s. Estimated remaining: 4h 31m 50s. Rate: 7.3 symbols/min [2025-10-08T17:53:54.689052] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:54.738191] [DEBUG] [LOCAL ] CAT: Loaded 52913 existing records from primary storage. [2025-10-08T17:53:54.738520] [INFO ] [MAIN ] CAT: Loaded 52913 existing records. [2025-10-08T17:53:54.911611] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:54.911859] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-08T17:53:54.911915] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-08T17:53:54.912138] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-08T17:53:54.912196] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-08T17:53:55.221779] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-08T17:53:55.262230] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:55.476753] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T17:53:56.017551] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-08T17:53:56.817517] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-08T17:53:56.943918] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T17:53:57.048484] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T17:53:57.617556] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-08T17:53:57.777762] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:53:58.417548] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-08T17:53:58.474182] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T17:53:59.217544] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-08T17:54:00.017557] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-08T17:54:00.285960] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T17:54:00.405023] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:54:00.817594] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-08T17:54:01.084028] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:54:01.617617] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-08T17:54:02.417527] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-08T17:54:02.911983] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-08T17:54:03.217515] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-08T17:54:03.305882] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:54:04.017509] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-08T17:54:04.200226] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T17:54:04.817492] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-08T17:54:05.159349] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T17:54:05.566621] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:54:05.617492] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-08T17:54:06.137173] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:54:06.417573] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-08T17:54:06.802215] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T17:54:07.217718] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-08T17:54:08.009525] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T17:54:08.019127] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-08T17:54:08.817544] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-08T17:54:08.866769] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T17:54:09.617583] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-08T17:54:10.079676] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-08T17:54:10.403615] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T17:54:10.417504] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-08T17:54:10.491052] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T17:54:11.217576] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-08T17:54:12.017528] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-08T17:54:12.084520] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:54:12.817516] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-08T17:54:13.292603] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:54:13.292323] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-08T17:54:13.306508] [INFO ] [REMOTE ] CANG: Full fetch complete (40130 records). [2025-10-08T17:54:13.307107] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-08T17:54:13.631339] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-08T17:54:13.679722] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-08T17:54:13.679811] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-08T17:54:13.680243] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-08T17:54:13.680283] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-08T17:54:13.681124] [DEBUG] [LOCAL ] CANG: Trimmed 40130 records to 26953 (keeping 200 days of data) [2025-10-08T17:54:13.825240] [DEBUG] [LOCAL ] CANG: Primary data saved (26953 records). [2025-10-08T17:54:13.825381] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-08T17:54:13.825463] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CANG took 39.1s. Estimated remaining: 4h 32m 37s. Rate: 7.3 symbols/min [2025-10-08T17:54:13.996002] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:54:14.004939] [DEBUG] [LOCAL ] CATO: Loaded 6981 existing records from primary storage. [2025-10-08T17:54:14.005147] [INFO ] [MAIN ] CATO: Loaded 6981 existing records. [2025-10-08T17:54:14.185341] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:54:14.185845] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-08T17:54:14.185928] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-08T17:54:14.186169] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-08T17:54:14.186349] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-08T17:54:14.317081] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T17:54:14.428163] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-08T17:54:14.587870] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:54:15.217550] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:54:15.217727] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-08T17:54:16.017619] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-08T17:54:16.707332] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-08T17:54:16.751777] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T17:54:16.817544] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-08T17:54:17.617577] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-08T17:54:17.902605] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T17:54:18.249321] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T17:54:18.417577] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-08T17:54:19.217556] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-08T17:54:19.587595] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:54:20.017500] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-08T17:54:20.252342] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-08T17:54:20.256860] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-08T17:54:20.257000] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-08T17:54:20.384096] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:54:20.693324] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-08T17:54:20.693407] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-08T17:54:20.694228] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-08T17:54:20.694292] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-08T17:54:20.695754] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53597 (keeping 200 days of data) [2025-10-08T17:54:20.818725] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-08T17:54:21.028855] [DEBUG] [LOCAL ] CARR: Primary data saved (53597 records). [2025-10-08T17:54:21.028997] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-08T17:54:21.029081] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARR took 36.3s. Estimated remaining: 4h 32m 24s. Rate: 7.3 symbols/min [2025-10-08T17:54:21.202067] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:54:21.209739] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T17:54:21.209428] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-10-08T17:54:21.212590] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-10-08T17:54:21.212849] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-08T17:54:21.212893] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-08T17:54:21.212936] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-08T17:54:21.212968] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-08T17:54:21.213050] [INFO ] [REMOTE ] CARS: Full fetch complete (55732 records). [2025-10-08T17:54:21.213170] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-08T17:54:21.655732] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-08T17:54:21.922933] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:54:21.940428] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:54:22.030140] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-08T17:54:22.030247] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-08T17:54:22.031001] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-08T17:54:22.031088] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-08T17:54:22.032458] [DEBUG] [LOCAL ] CARS: Trimmed 55732 records to 39698 (keeping 200 days of data) [2025-10-08T17:54:22.300995] [DEBUG] [LOCAL ] CARS: Primary data saved (39698 records). [2025-10-08T17:54:22.301159] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-08T17:54:22.301798] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARS took 35.6s. Estimated remaining: 4h 31m 41s. Rate: 7.3 symbols/min [2025-10-08T17:54:22.427758] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-08T17:54:22.502776] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:54:22.558912] [DEBUG] [LOCAL ] CB: Loaded 49930 existing records from primary storage. [2025-10-08T17:54:22.559326] [INFO ] [MAIN ] CB: Loaded 49930 existing records. [2025-10-08T17:54:22.738898] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:54:22.739199] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-08T17:54:22.739256] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-08T17:54:22.739499] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-08T17:54:22.739565] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-08T17:54:23.105899] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:54:23.217517] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-08T17:54:24.017711] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-08T17:54:24.123408] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-08T17:54:24.630574] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T17:54:24.679779] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-08T17:54:24.796787] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:54:24.817518] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-08T17:54:25.617550] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-08T17:54:26.378030] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T17:54:26.417559] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-08T17:54:27.120179] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T17:54:27.217592] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-08T17:54:28.017547] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-08T17:54:28.114337] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:54:28.816904] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T17:54:28.820895] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-08T17:54:29.072998] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T17:54:29.617610] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-08T17:54:30.417580] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-08T17:54:30.468206] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T17:54:30.783089] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T17:54:31.217611] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-08T17:54:32.017603] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-08T17:54:32.297539] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T17:54:32.641374] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T17:54:32.817519] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-08T17:54:33.097844] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:54:33.617581] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-08T17:54:34.148291] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T17:54:34.417521] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-08T17:54:34.952793] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T17:54:35.217546] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-08T17:54:36.017541] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-08T17:54:36.166853] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:54:36.817595] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-08T17:54:37.150985] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T17:54:37.617559] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-08T17:54:38.009776] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-08T17:54:38.013797] [INFO ] [REMOTE ] CAT: Full fetch complete (76692 records). [2025-10-08T17:54:38.013945] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-08T17:54:38.160200] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T17:54:38.422827] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-08T17:54:38.426768] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-08T17:54:38.427104] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-08T17:54:38.428883] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-08T17:54:38.428955] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-08T17:54:38.430538] [DEBUG] [LOCAL ] CAT: Trimmed 76692 records to 52918 (keeping 200 days of data) [2025-10-08T17:54:38.729242] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T17:54:38.832136] [DEBUG] [LOCAL ] CAT: Primary data saved (52918 records). [2025-10-08T17:54:38.832301] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-08T17:54:38.832398] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CAT took 44.4s. Estimated remaining: 4h 32m 14s. Rate: 7.3 symbols/min [2025-10-08T17:54:39.015032] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:54:39.028519] [DEBUG] [LOCAL ] CBAN: Loaded 10701 existing records from primary storage. [2025-10-08T17:54:39.028840] [INFO ] [MAIN ] CBAN: Loaded 10701 existing records. [2025-10-08T17:54:39.188621] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T17:54:39.218386] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-08T17:54:39.223618] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:54:39.224888] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-08T17:54:39.224938] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-08T17:54:39.225136] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-08T17:54:39.225194] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-08T17:54:39.653993] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:54:40.017616] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-08T17:54:40.817590] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-08T17:54:41.174763] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T17:54:41.273126] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T17:54:41.617519] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-08T17:54:41.688296] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T17:54:42.417561] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-08T17:54:43.217629] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-08T17:54:43.463610] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T17:54:43.899912] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T17:54:43.901094] [INFO ] [REMOTE ] CATO: Full fetch complete (11098 records). [2025-10-08T17:54:43.901185] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-08T17:54:44.020534] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-08T17:54:44.327029] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-08T17:54:44.327408] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-08T17:54:44.327851] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-08T17:54:44.327965] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-08T17:54:44.328784] [DEBUG] [LOCAL ] CATO: Trimmed 11098 records to 6871 (keeping 200 days of data) [2025-10-08T17:54:44.397766] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T17:54:44.416842] [DEBUG] [LOCAL ] CATO: Primary data saved (6871 records). [2025-10-08T17:54:44.417011] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-08T17:54:44.417107] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CATO took 30.6s. Estimated remaining: 4h 31m 52s. Rate: 7.3 symbols/min [2025-10-08T17:54:44.817634] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-08T17:54:44.964998] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T17:54:45.617560] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-08T17:54:46.417552] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-08T17:54:46.861978] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T17:54:47.217522] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-08T17:54:47.374177] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T17:54:47.374498] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:54:48.017566] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-08T17:54:48.817584] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-08T17:54:49.504277] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-08T17:54:49.584454] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:54:49.617531] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-08T17:54:49.677753] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T17:54:50.417552] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-08T17:54:51.217631] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-08T17:54:51.257492] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T17:54:51.450567] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T17:54:52.017615] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-08T17:54:52.561019] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T17:54:52.564837] [INFO ] [REMOTE ] CB: Full fetch complete (72605 records). [2025-10-08T17:54:52.564944] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-08T17:54:52.824459] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-08T17:54:52.899856] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T17:54:52.979632] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-08T17:54:52.979767] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-08T17:54:52.980580] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-08T17:54:52.980663] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-08T17:54:52.982088] [DEBUG] [LOCAL ] CB: Trimmed 72605 records to 49934 (keeping 200 days of data) [2025-10-08T17:54:53.301620] [DEBUG] [LOCAL ] CB: Primary data saved (49934 records). [2025-10-08T17:54:53.301810] [INFO ] [MAIN ] CB: Full history saved. [2025-10-08T17:54:53.302527] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CB took 31.0s. Estimated remaining: 4h 31m 47s. Rate: 7.3 symbols/min [2025-10-08T17:54:53.617559] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-08T17:54:54.593122] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:54:54.596340] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-08T17:54:54.845032] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-08T17:54:55.217545] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-08T17:54:55.253464] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T17:54:56.017572] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-08T17:54:56.796188] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T17:54:56.817512] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-08T17:54:57.197510] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-08T17:54:57.202882] [INFO ] [REMOTE ] CAVA: Full fetch complete (77322 records). [2025-10-08T17:54:57.203103] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-08T17:54:57.423564] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:54:57.633130] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-08T17:54:57.669261] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-08T17:54:57.669583] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-08T17:54:57.670893] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-08T17:54:57.671001] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-08T17:54:57.673896] [DEBUG] [LOCAL ] CAVA: Trimmed 77322 records to 53555 (keeping 200 days of data) [2025-10-08T17:54:58.054906] [DEBUG] [LOCAL ] CAVA: Primary data saved (53555 records). [2025-10-08T17:54:58.055129] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-08T17:54:58.055234] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 37.0s. Estimated remaining: 4h 31m 21s. Rate: 7.3 symbols/min [2025-10-08T17:54:58.419377] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T17:54:58.422314] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-08T17:54:59.035549] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T17:54:59.036767] [INFO ] [REMOTE ] CBAN: Full fetch complete (16085 records). [2025-10-08T17:54:59.036840] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-08T17:54:59.399945] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-08T17:54:59.400027] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-08T17:54:59.400391] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-08T17:54:59.400464] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-08T17:54:59.400996] [DEBUG] [LOCAL ] CBAN: Trimmed 16085 records to 10649 (keeping 200 days of data) [2025-10-08T17:54:59.465772] [DEBUG] [LOCAL ] CBAN: Primary data saved (10649 records). [2025-10-08T17:54:59.465907] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-08T17:54:59.465990] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CBAN took 20.6s. Estimated remaining: 4h 30m 39s. Rate: 7.3 symbols/min [2025-10-08T17:54:59.992974] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:00.042339] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-08T17:55:00.164063] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:00.164884] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:00.168019] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:00.165053] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-08T17:55:00.168976] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-08T17:55:00.169106] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-08T17:55:00.169440] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-08T17:55:00.169523] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-08T17:55:00.243420] [DEBUG] [LOCAL ] CBNA: Loaded 2906 existing records from primary storage. [2025-10-08T17:55:00.249996] [INFO ] [MAIN ] CBNA: Loaded 2906 existing records. [2025-10-08T17:55:00.357435] [DEBUG] [LOCAL ] CBL: Loaded 16300 existing records from primary storage. [2025-10-08T17:55:00.397939] [INFO ] [MAIN ] CBL: Loaded 16300 existing records. [2025-10-08T17:55:00.855021] [DEBUG] [LOCAL ] CBRE: Loaded 50455 existing records from primary storage. [2025-10-08T17:55:00.854913] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:00.898357] [INFO ] [MAIN ] CBRE: Loaded 50455 existing records. [2025-10-08T17:55:00.949600] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-08T17:55:00.983594] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-08T17:55:01.086699] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:01.089861] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:01.096260] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-08T17:55:01.095949] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-08T17:55:01.101825] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-08T17:55:01.112102] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-08T17:55:01.112203] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-08T17:55:01.133428] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-08T17:55:01.157716] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-08T17:55:01.437693] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:55:01.520225] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-08T17:55:01.534840] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:01.601124] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-08T17:55:01.638735] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:55:01.648278] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-08T17:55:01.669288] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-08T17:55:01.775941] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:55:01.791462] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-08T17:55:01.817517] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-08T17:55:01.837768] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-08T17:55:01.817437] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-08T17:55:01.856982] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-08T17:55:01.895115] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-08T17:55:01.921538] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 2.4s. Estimated remaining: 4h 30m 3s. Rate: 7.3 symbols/min [2025-10-08T17:55:02.160075] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:02.274157] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-08T17:55:02.322004] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:02.334298] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-08T17:55:02.650779] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:02.771225] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:02.771705] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-08T17:55:02.794497] [DEBUG] [LOCAL ] CBT: Loaded 30815 existing records from primary storage. [2025-10-08T17:55:02.794876] [INFO ] [MAIN ] CBT: Loaded 30815 existing records. [2025-10-08T17:55:02.983274] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:02.983528] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-08T17:55:02.983588] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-08T17:55:02.983938] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-08T17:55:02.984000] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-08T17:55:03.282922] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T17:55:03.290803] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-08T17:55:03.366287] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:03.366614] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-08T17:55:03.896567] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:55:03.982510] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T17:55:04.017567] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-08T17:55:04.560279] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T17:55:04.592807] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T17:55:04.817600] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-08T17:55:05.089245] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:55:05.617614] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-08T17:55:06.417527] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-08T17:55:06.621796] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T17:55:06.649321] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T17:55:06.907196] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T17:55:07.217552] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-08T17:55:08.017601] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-08T17:55:08.817568] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-08T17:55:08.948209] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T17:55:09.230581] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T17:55:09.374868] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:55:09.617591] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-08T17:55:10.036255] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T17:55:10.417557] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-08T17:55:11.217572] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-08T17:55:11.857288] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:55:12.017522] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-08T17:55:12.184945] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T17:55:12.573104] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T17:55:12.817618] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-08T17:55:13.617604] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-08T17:55:14.159742] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T17:55:14.223688] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T17:55:14.417591] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-08T17:55:15.217612] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-08T17:55:16.017531] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-08T17:55:16.333623] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T17:55:16.765793] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:55:16.785504] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T17:55:16.817488] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-08T17:55:17.617597] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-08T17:55:18.024874] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T17:55:18.220182] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:55:18.417625] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-08T17:55:18.911558] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:55:18.912610] [INFO ] [REMOTE ] CBNA: Full fetch complete (4507 records). [2025-10-08T17:55:18.912729] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-08T17:55:19.222768] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-08T17:55:19.286533] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-08T17:55:19.286614] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-08T17:55:19.286796] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-08T17:55:19.286858] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-08T17:55:19.287212] [DEBUG] [LOCAL ] CBNA: Trimmed 4507 records to 2896 (keeping 200 days of data) [2025-10-08T17:55:19.306996] [DEBUG] [LOCAL ] CBNA: Primary data saved (2896 records). [2025-10-08T17:55:19.307122] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-08T17:55:19.307207] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 19.8s. Estimated remaining: 4h 30m 39s. Rate: 7.3 symbols/min [2025-10-08T17:55:19.476499] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:19.501626] [DEBUG] [LOCAL ] CBU: Loaded 22579 existing records from primary storage. [2025-10-08T17:55:19.501912] [INFO ] [MAIN ] CBU: Loaded 22579 existing records. [2025-10-08T17:55:19.688509] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:19.688787] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-08T17:55:19.688838] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-08T17:55:19.689086] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-08T17:55:19.689144] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-08T17:55:20.022539] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-08T17:55:20.044176] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:20.784056] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:55:20.817502] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-08T17:55:21.181029] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T17:55:21.617579] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-08T17:55:21.974303] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:55:22.417575] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-08T17:55:22.884337] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:55:23.217613] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-08T17:55:23.639784] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T17:55:24.017551] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-08T17:55:24.227860] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T17:55:24.817593] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-08T17:55:25.311707] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T17:55:25.617580] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-08T17:55:25.879787] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:55:26.417597] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-08T17:55:26.773228] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T17:55:27.217562] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-08T17:55:27.384526] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T17:55:28.017601] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-08T17:55:28.817574] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-08T17:55:29.060330] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T17:55:29.204982] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T17:55:29.207560] [INFO ] [REMOTE ] CBT: Full fetch complete (45675 records). [2025-10-08T17:55:29.207718] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-08T17:55:29.584855] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-08T17:55:29.585002] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-08T17:55:29.585622] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-08T17:55:29.585751] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-08T17:55:29.586955] [DEBUG] [LOCAL ] CBT: Trimmed 45675 records to 30800 (keeping 200 days of data) [2025-10-08T17:55:29.655027] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-08T17:55:29.602369] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T17:55:29.802839] [DEBUG] [LOCAL ] CBT: Primary data saved (30800 records). [2025-10-08T17:55:29.802996] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-08T17:55:29.803124] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBT took 27.9s. Estimated remaining: 4h 30m 42s. Rate: 7.3 symbols/min [2025-10-08T17:55:29.970074] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:29.970326] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-08T17:55:29.970380] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-08T17:55:29.970456] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-08T17:55:29.970492] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-08T17:55:29.970531] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-08T17:55:29.970560] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-08T17:55:30.314062] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:30.417513] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-08T17:55:30.624169] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:55:30.624712] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-08T17:55:30.624818] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:55:30.624872] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-08T17:55:30.624905] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:55:30.624970] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-08T17:55:30.625078] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-08T17:55:30.625130] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-08T17:55:30.625172] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-08T17:55:30.625228] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBX took 0.8s. Estimated remaining: 4h 29m 58s. Rate: 7.3 symbols/min [2025-10-08T17:55:30.821943] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:30.855288] [DEBUG] [LOCAL ] CBZ: Loaded 33989 existing records from primary storage. [2025-10-08T17:55:30.855570] [INFO ] [MAIN ] CBZ: Loaded 33989 existing records. [2025-10-08T17:55:31.046218] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:31.046442] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-08T17:55:31.046518] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-08T17:55:31.046924] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-08T17:55:31.046999] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-08T17:55:31.225345] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-08T17:55:31.441709] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:31.470430] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:55:32.017530] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-08T17:55:32.343011] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T17:55:32.817574] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-08T17:55:33.200407] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T17:55:33.617603] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-08T17:55:34.417599] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-08T17:55:34.560898] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T17:55:34.853277] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T17:55:35.217581] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-08T17:55:35.473593] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T17:55:36.017552] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-08T17:55:36.126335] [DEBUG] [REMOTE ] CBRE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-08T17:55:36.126757] [WARN ] [REMOTE ] CBRE: No data returned for month 2025-08 [2025-10-08T17:55:36.126875] [FATAL] [REMOTE ] CBRE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:55:36.127012] [FATAL] [MAIN ] CBRE: Failed to fetch primary data. [2025-10-08T17:55:36.127093] [WARN ] [MAIN ] CBRE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:55:36.127168] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-08T17:55:36.127236] [DEBUG] [LOCAL ] CBRE: No primary data file found to delete. [2025-10-08T17:55:36.127272] [INFO ] [LOCAL ] CBRE: Starting deletion of derivative data. [2025-10-08T17:55:36.127543] [DEBUG] [LOCAL ] CBRE: Deleted derivative data file. [2025-10-08T17:55:36.127637] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBRE took 36.6s. Estimated remaining: 4h 29m 36s. Rate: 7.3 symbols/min [2025-10-08T17:55:36.325364] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:36.349297] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T17:55:36.414635] [DEBUG] [LOCAL ] CC: Loaded 52991 existing records from primary storage. [2025-10-08T17:55:36.415204] [INFO ] [MAIN ] CC: Loaded 52991 existing records. [2025-10-08T17:55:36.618060] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:36.618324] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-08T17:55:36.618372] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-08T17:55:36.618616] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-08T17:55:36.618719] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-08T17:55:36.825798] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-08T17:55:36.988083] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:37.617555] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-08T17:55:37.929417] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:55:38.417527] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-08T17:55:38.711784] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T17:55:39.059593] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T17:55:39.217553] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-08T17:55:40.017566] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-08T17:55:40.580205] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T17:55:40.817617] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-08T17:55:41.617627] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-08T17:55:41.703237] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:55:41.808594] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T17:55:42.417513] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-08T17:55:42.883279] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T17:55:43.217511] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-08T17:55:43.381381] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T17:55:44.017513] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-08T17:55:44.471803] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T17:55:44.817563] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-08T17:55:45.432031] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:55:45.617560] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-08T17:55:45.978811] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T17:55:46.417614] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-08T17:55:46.990100] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:55:47.024512] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T17:55:47.026150] [INFO ] [REMOTE ] CBL: Full fetch complete (25401 records). [2025-10-08T17:55:47.026246] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-08T17:55:47.222769] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-08T17:55:47.410463] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-08T17:55:47.410563] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-08T17:55:47.411044] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-08T17:55:47.411112] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-08T17:55:47.412100] [DEBUG] [LOCAL ] CBL: Trimmed 25401 records to 16262 (keeping 200 days of data) [2025-10-08T17:55:47.523802] [DEBUG] [LOCAL ] CBL: Primary data saved (16262 records). [2025-10-08T17:55:47.523961] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-08T17:55:47.524046] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBL took 48.1s. Estimated remaining: 4h 29m 43s. Rate: 7.3 symbols/min [2025-10-08T17:55:47.718607] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:47.773880] [DEBUG] [LOCAL ] CCI: Loaded 53138 existing records from primary storage. [2025-10-08T17:55:47.774270] [INFO ] [MAIN ] CCI: Loaded 53138 existing records. [2025-10-08T17:55:47.967882] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:47.968214] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-08T17:55:47.968297] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-08T17:55:47.968877] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-08T17:55:47.968951] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-08T17:55:48.022687] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-08T17:55:48.395297] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:48.471360] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T17:55:48.473499] [INFO ] [REMOTE ] CBU: Full fetch complete (32355 records). [2025-10-08T17:55:48.473581] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-08T17:55:48.822615] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-08T17:55:48.903328] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-08T17:55:48.903443] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-08T17:55:48.904073] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-08T17:55:48.904139] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-08T17:55:48.905315] [DEBUG] [LOCAL ] CBU: Trimmed 32355 records to 22520 (keeping 200 days of data) [2025-10-08T17:55:49.059511] [DEBUG] [LOCAL ] CBU: Primary data saved (22520 records). [2025-10-08T17:55:49.059675] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-08T17:55:49.059800] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 29.8s. Estimated remaining: 4h 29m 3s. Rate: 7.3 symbols/min [2025-10-08T17:55:49.241138] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:49.241309] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-08T17:55:49.241353] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-08T17:55:49.241472] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-08T17:55:49.241519] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-08T17:55:49.241576] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-08T17:55:49.241614] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-08T17:55:49.621020] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:49.621141] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-08T17:55:49.688159] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T17:55:49.944312] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T17:55:50.417585] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-08T17:55:50.874884] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-08T17:55:51.217517] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-08T17:55:51.522480] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:55:51.645388] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T17:55:52.017571] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-08T17:55:52.332930] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-08T17:55:52.817620] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-08T17:55:53.617595] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-08T17:55:53.947235] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-08T17:55:54.417526] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-08T17:55:54.532211] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:55:54.867198] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T17:55:55.217595] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-08T17:55:56.017577] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-08T17:55:56.492705] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T17:55:56.817582] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-08T17:55:56.885515] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T17:55:57.617549] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-08T17:55:57.956364] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-08T17:55:58.417504] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-08T17:55:58.524462] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T17:55:58.683053] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-08T17:55:59.217564] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-08T17:56:00.017610] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-08T17:56:00.528454] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T17:56:00.817528] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-08T17:56:01.012611] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:56:01.336118] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T17:56:01.617576] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-08T17:56:02.069406] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T17:56:02.070667] [INFO ] [REMOTE ] CCIA: Full fetch complete (2134 records). [2025-10-08T17:56:02.070765] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-08T17:56:02.279055] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T17:56:02.279279] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:56:02.279351] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:56:02.279425] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-08T17:56:02.279491] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-08T17:56:02.279527] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-08T17:56:02.279584] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-08T17:56:02.279698] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CCIA took 13.2s. Estimated remaining: 4h 29m 18s. Rate: 7.3 symbols/min [2025-10-08T17:56:02.423479] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-08T17:56:02.457605] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:02.476939] [DEBUG] [LOCAL ] CCIF: Loaded 15588 existing records from primary storage. [2025-10-08T17:56:02.477564] [INFO ] [MAIN ] CCIF: Loaded 15588 existing records. [2025-10-08T17:56:02.660365] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:02.660590] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-08T17:56:02.660639] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-08T17:56:02.660958] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-08T17:56:02.661019] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-08T17:56:03.033619] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:03.217505] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-08T17:56:03.603603] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T17:56:04.017582] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-08T17:56:04.143352] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T17:56:04.817614] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-08T17:56:05.617604] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-08T17:56:05.722102] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T17:56:05.991176] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T17:56:06.417553] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-08T17:56:07.217577] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-08T17:56:07.304430] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:56:08.017586] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-08T17:56:08.244852] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T17:56:08.731932] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T17:56:08.817594] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-08T17:56:09.617563] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-08T17:56:09.803539] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:56:09.852601] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:56:10.417683] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-08T17:56:11.217632] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-08T17:56:11.436950] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:56:12.017515] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-08T17:56:12.145265] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T17:56:12.181552] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:56:12.817608] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-08T17:56:13.617568] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-08T17:56:13.897381] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:56:14.417530] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-08T17:56:14.803917] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T17:56:14.892556] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:56:15.130539] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T17:56:15.217600] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-08T17:56:16.017562] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-08T17:56:16.817594] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-08T17:56:17.079302] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T17:56:17.556413] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:56:17.617527] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-08T17:56:17.766034] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:56:18.417566] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-08T17:56:19.217531] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-08T17:56:19.423383] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T17:56:19.429834] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T17:56:20.017580] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-08T17:56:20.546632] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:56:20.549584] [INFO ] [REMOTE ] CBZ: Full fetch complete (45749 records). [2025-10-08T17:56:20.549702] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-08T17:56:20.825283] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-08T17:56:20.945034] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-08T17:56:20.945121] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-08T17:56:20.945837] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-08T17:56:20.945902] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-08T17:56:20.946979] [DEBUG] [LOCAL ] CBZ: Trimmed 45749 records to 34023 (keeping 200 days of data) [2025-10-08T17:56:21.149909] [DEBUG] [LOCAL ] CBZ: Primary data saved (34023 records). [2025-10-08T17:56:21.150061] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-08T17:56:21.150148] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBZ took 50.5s. Estimated remaining: 4h 30m 1s. Rate: 7.3 symbols/min [2025-10-08T17:56:21.315422] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:21.366415] [DEBUG] [LOCAL ] CCJ: Loaded 53676 existing records from primary storage. [2025-10-08T17:56:21.366815] [INFO ] [MAIN ] CCJ: Loaded 53676 existing records. [2025-10-08T17:56:21.543176] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:21.543376] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-08T17:56:21.543457] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-08T17:56:21.543810] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-08T17:56:21.543868] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-08T17:56:21.618414] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-08T17:56:21.742969] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T17:56:21.824938] [INFO ] [REMOTE ] CC: Full fetch complete (75713 records). [2025-10-08T17:56:21.837675] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-08T17:56:22.072591] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:22.358463] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-08T17:56:22.358596] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-08T17:56:22.359497] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-08T17:56:22.359612] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-08T17:56:22.361181] [DEBUG] [LOCAL ] CC: Trimmed 75713 records to 52993 (keeping 200 days of data) [2025-10-08T17:56:22.419545] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-08T17:56:22.466218] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:56:22.722545] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:56:22.754998] [DEBUG] [LOCAL ] CC: Primary data saved (52993 records). [2025-10-08T17:56:22.755135] [INFO ] [MAIN ] CC: Full history saved. [2025-10-08T17:56:22.755234] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 46.6s. Estimated remaining: 4h 29m 21s. Rate: 7.3 symbols/min [2025-10-08T17:56:22.924164] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:22.966457] [DEBUG] [LOCAL ] CCK: Loaded 46302 existing records from primary storage. [2025-10-08T17:56:22.966893] [INFO ] [MAIN ] CCK: Loaded 46302 existing records. [2025-10-08T17:56:23.183923] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:23.184186] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-08T17:56:23.184241] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-08T17:56:23.184545] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-08T17:56:23.184604] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-08T17:56:23.226972] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-08T17:56:23.541075] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:24.017594] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-08T17:56:24.646033] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-08T17:56:24.751302] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T17:56:24.817520] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-08T17:56:24.978457] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T17:56:25.617564] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-08T17:56:26.417598] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-08T17:56:26.435636] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:56:26.439944] [INFO ] [REMOTE ] CCI: Full fetch complete (76987 records). [2025-10-08T17:56:26.440054] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-08T17:56:26.598439] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T17:56:26.857083] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-08T17:56:26.857183] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-08T17:56:26.858040] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-08T17:56:26.858106] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-08T17:56:26.859637] [DEBUG] [LOCAL ] CCI: Trimmed 76987 records to 53132 (keeping 200 days of data) [2025-10-08T17:56:27.196860] [DEBUG] [LOCAL ] CCI: Primary data saved (53132 records). [2025-10-08T17:56:27.197022] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-08T17:56:27.197110] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCI took 39.7s. Estimated remaining: 4h 28m 55s. Rate: 7.3 symbols/min [2025-10-08T17:56:27.226844] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-08T17:56:27.370350] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:27.423148] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-08T17:56:27.423490] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-08T17:56:27.601684] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:27.601933] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-08T17:56:27.601980] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-08T17:56:27.602342] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-08T17:56:27.602399] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-08T17:56:27.955481] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:28.017500] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-08T17:56:28.395752] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-08T17:56:28.817616] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-08T17:56:29.036824] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T17:56:29.617540] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-08T17:56:29.937256] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T17:56:30.417550] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-08T17:56:30.662404] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-08T17:56:31.223388] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-08T17:56:31.244424] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:56:31.246563] [INFO ] [REMOTE ] CCIF: Full fetch complete (21976 records). [2025-10-08T17:56:31.248478] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:56:31.248637] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-08T17:56:31.632965] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-08T17:56:31.633070] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-08T17:56:31.633514] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-08T17:56:31.633557] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-08T17:56:31.634514] [DEBUG] [LOCAL ] CCIF: Trimmed 21976 records to 15666 (keeping 200 days of data) [2025-10-08T17:56:31.731151] [DEBUG] [LOCAL ] CCIF: Primary data saved (15666 records). [2025-10-08T17:56:31.731306] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-08T17:56:31.731461] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIF took 29.5s. Estimated remaining: 4h 28m 29s. Rate: 7.3 symbols/min [2025-10-08T17:56:31.922985] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:31.974181] [DEBUG] [LOCAL ] CCO: Loaded 48007 existing records from primary storage. [2025-10-08T17:56:31.974503] [INFO ] [MAIN ] CCO: Loaded 48007 existing records. [2025-10-08T17:56:32.022691] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-08T17:56:32.179031] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:32.179256] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-08T17:56:32.179302] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-08T17:56:32.179854] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-08T17:56:32.179912] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-08T17:56:32.533785] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:32.817582] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-08T17:56:33.541037] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-08T17:56:33.617571] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-08T17:56:34.179118] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T17:56:34.256871] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:56:34.417505] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-08T17:56:35.217566] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-08T17:56:35.733419] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:56:35.773758] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T17:56:36.017566] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-08T17:56:36.817525] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-08T17:56:36.997952] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T17:56:37.199619] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:56:37.617552] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-08T17:56:38.368333] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:56:38.417502] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-08T17:56:39.217524] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-08T17:56:39.387586] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T17:56:39.754579] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:56:40.017582] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-08T17:56:40.817586] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-08T17:56:41.617548] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-08T17:56:41.698308] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-08T17:56:41.934721] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T17:56:42.417525] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-08T17:56:42.648462] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T17:56:42.742629] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:56:43.217600] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-08T17:56:44.017625] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-08T17:56:44.753156] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-08T17:56:44.822673] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-08T17:56:44.839245] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:56:45.617578] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-08T17:56:46.072352] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-08T17:56:46.417562] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-08T17:56:46.840430] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T17:56:47.119412] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T17:56:47.217551] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-08T17:56:48.017604] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-08T17:56:48.384594] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T17:56:48.764878] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:56:48.817517] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-08T17:56:49.617601] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-08T17:56:49.967057] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T17:56:50.426275] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-08T17:56:50.431984] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T17:56:51.217576] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-08T17:56:51.975733] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-08T17:56:52.017620] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-08T17:56:52.790150] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-08T17:56:52.817493] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-08T17:56:52.937250] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T17:56:53.361066] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T17:56:53.617556] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-08T17:56:54.417600] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-08T17:56:55.102525] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-08T17:56:55.217584] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-08T17:56:55.602578] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-08T17:56:55.624252] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T17:56:55.627620] [INFO ] [REMOTE ] CCK: Full fetch complete (67592 records). [2025-10-08T17:56:55.627736] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-08T17:56:56.026779] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-08T17:56:56.030425] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-08T17:56:56.030506] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-08T17:56:56.032160] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-08T17:56:56.032261] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-08T17:56:56.033811] [DEBUG] [LOCAL ] CCK: Trimmed 67592 records to 46300 (keeping 200 days of data) [2025-10-08T17:56:56.315904] [DEBUG] [LOCAL ] CCK: Primary data saved (46300 records). [2025-10-08T17:56:56.316055] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-08T17:56:56.316147] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCK took 33.6s. Estimated remaining: 4h 29m 38s. Rate: 7.3 symbols/min [2025-10-08T17:56:56.482427] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:56.492161] [DEBUG] [LOCAL ] CCRD: Loaded 9204 existing records from primary storage. [2025-10-08T17:56:56.492338] [INFO ] [MAIN ] CCRD: Loaded 9204 existing records. [2025-10-08T17:56:56.665263] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:56.665466] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-08T17:56:56.665512] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-08T17:56:56.665732] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-08T17:56:56.665789] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-08T17:56:56.821037] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-08T17:56:57.022513] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:57.558558] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-08T17:56:57.617547] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-08T17:56:57.821711] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T17:56:57.826076] [INFO ] [REMOTE ] CCJ: Full fetch complete (77683 records). [2025-10-08T17:56:57.826235] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-08T17:56:58.267796] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-08T17:56:58.267927] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-08T17:56:58.268812] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-08T17:56:58.268875] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-08T17:56:58.270377] [DEBUG] [LOCAL ] CCJ: Trimmed 77683 records to 53675 (keeping 200 days of data) [2025-10-08T17:56:58.443833] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-08T17:56:58.608740] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:56:58.639089] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-10-08T17:56:58.639266] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-08T17:56:58.640036] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCJ took 37.5s. Estimated remaining: 4h 29m 2s. Rate: 7.3 symbols/min [2025-10-08T17:56:58.807759] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:58.846408] [DEBUG] [LOCAL ] CCS: Loaded 30314 existing records from primary storage. [2025-10-08T17:56:58.846842] [INFO ] [MAIN ] CCS: Loaded 30314 existing records. [2025-10-08T17:56:59.035244] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:59.035531] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-08T17:56:59.035578] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-08T17:56:59.035858] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-08T17:56:59.035916] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-08T17:56:59.231867] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-08T17:56:59.420595] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:59.466044] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T17:56:59.876516] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-08T17:56:59.880922] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-08T17:56:59.881083] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-08T17:57:00.028135] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-08T17:57:00.288915] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-08T17:57:00.289021] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-08T17:57:00.289929] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-08T17:57:00.290016] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-08T17:57:00.291630] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-10-08T17:57:00.624889] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-08T17:57:00.625106] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-08T17:57:00.625204] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCL took 33.4s. Estimated remaining: 4h 28m 24s. Rate: 7.3 symbols/min [2025-10-08T17:57:00.814111] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:00.820795] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-08T17:57:00.853331] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T17:57:00.860160] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:57:00.887775] [DEBUG] [LOCAL ] CCU: Loaded 22981 existing records from primary storage. [2025-10-08T17:57:00.888042] [INFO ] [MAIN ] CCU: Loaded 22981 existing records. [2025-10-08T17:57:01.074566] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:01.074840] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-08T17:57:01.074890] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-08T17:57:01.075194] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-08T17:57:01.075274] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-08T17:57:01.441586] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:01.617569] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-08T17:57:02.087156] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:57:02.283326] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T17:57:02.417622] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-08T17:57:03.217622] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-08T17:57:03.911148] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T17:57:04.017569] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-08T17:57:04.817561] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-08T17:57:05.003286] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T17:57:05.181710] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:57:05.232007] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T17:57:05.617567] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-08T17:57:06.417590] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-08T17:57:07.099817] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:57:07.217523] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-08T17:57:07.784262] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:57:08.017606] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-08T17:57:08.673352] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T17:57:08.817577] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-08T17:57:09.187871] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:57:09.617603] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-08T17:57:10.259338] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T17:57:10.320511] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T17:57:10.324126] [INFO ] [REMOTE ] CCO: Full fetch complete (66836 records). [2025-10-08T17:57:10.324221] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-08T17:57:10.423163] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-08T17:57:10.716970] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-08T17:57:10.717291] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-08T17:57:10.718817] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-08T17:57:10.718880] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-08T17:57:10.720222] [DEBUG] [LOCAL ] CCO: Trimmed 66836 records to 48014 (keeping 200 days of data) [2025-10-08T17:57:10.983861] [DEBUG] [LOCAL ] CCO: Primary data saved (48014 records). [2025-10-08T17:57:10.984016] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-08T17:57:10.984917] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCO took 39.3s. Estimated remaining: 4h 28m 26s. Rate: 7.3 symbols/min [2025-10-08T17:57:11.151076] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:11.151244] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-08T17:57:11.151298] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-08T17:57:11.151463] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-08T17:57:11.151504] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-08T17:57:11.151544] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-08T17:57:11.151575] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-08T17:57:11.225146] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-08T17:57:11.510835] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:11.681722] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T17:57:12.017556] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-08T17:57:12.321322] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T17:57:12.817597] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-08T17:57:13.480872] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T17:57:13.617563] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-08T17:57:13.930857] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T17:57:14.417513] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-08T17:57:14.765062] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T17:57:15.131120] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T17:57:15.217529] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-08T17:57:16.017550] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-08T17:57:16.407251] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T17:57:16.817562] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-08T17:57:17.403433] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T17:57:17.534437] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T17:57:17.617514] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-08T17:57:18.417544] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-08T17:57:18.510114] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:57:19.217575] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-08T17:57:19.557902] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T17:57:19.626473] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-08T17:57:20.017576] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-08T17:57:20.817573] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-08T17:57:20.841285] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T17:57:21.617567] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-08T17:57:22.070280] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T17:57:22.417522] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-08T17:57:22.563959] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T17:57:22.700742] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-08T17:57:23.217606] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-08T17:57:23.505842] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-08T17:57:24.017624] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-08T17:57:24.817505] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-08T17:57:25.045588] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-08T17:57:25.071033] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:57:25.617539] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-08T17:57:26.417539] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-08T17:57:26.706064] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T17:57:27.217565] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-08T17:57:27.536405] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-08T17:57:27.722901] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T17:57:28.017616] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-08T17:57:28.817532] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-08T17:57:28.887171] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T17:57:29.056028] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-08T17:57:29.617550] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-08T17:57:30.075608] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:57:30.076004] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-08T17:57:30.076091] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:57:30.076175] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-08T17:57:30.076235] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:57:30.076307] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-08T17:57:30.076371] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-08T17:57:30.076406] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-08T17:57:30.076465] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-08T17:57:30.076535] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCZ took 19.1s. Estimated remaining: 4h 29m 9s. Rate: 7.3 symbols/min [2025-10-08T17:57:30.243426] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:30.304136] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-08T17:57:30.304482] [INFO ] [MAIN ] CDE: Loaded 53642 existing records. [2025-10-08T17:57:30.422698] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-08T17:57:30.488286] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:30.488478] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-08T17:57:30.488525] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-08T17:57:30.489058] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-08T17:57:30.489116] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-08T17:57:30.844551] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:31.217529] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-08T17:57:31.254796] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:57:31.255929] [INFO ] [REMOTE ] CCRD: Full fetch complete (11845 records). [2025-10-08T17:57:31.256011] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-08T17:57:31.641513] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-08T17:57:31.641615] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-08T17:57:31.641987] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-08T17:57:31.642062] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-08T17:57:31.642663] [DEBUG] [LOCAL ] CCRD: Trimmed 11845 records to 9219 (keeping 200 days of data) [2025-10-08T17:57:31.699085] [DEBUG] [LOCAL ] CCRD: Primary data saved (9219 records). [2025-10-08T17:57:31.699248] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-08T17:57:31.699392] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCRD took 35.4s. Estimated remaining: 4h 28m 29s. Rate: 7.3 symbols/min [2025-10-08T17:57:31.898952] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:31.911889] [DEBUG] [LOCAL ] CDLR: Loaded 9880 existing records from primary storage. [2025-10-08T17:57:31.912145] [INFO ] [MAIN ] CDLR: Loaded 9880 existing records. [2025-10-08T17:57:32.022684] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-08T17:57:32.117126] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:32.117356] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-08T17:57:32.117405] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-08T17:57:32.117581] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-08T17:57:32.117638] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-08T17:57:32.523471] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:32.524542] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T17:57:32.817563] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-08T17:57:33.512140] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:57:33.617549] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-08T17:57:34.069821] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T17:57:34.115300] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T17:57:34.417628] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-08T17:57:35.217622] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-08T17:57:35.635736] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:57:35.638114] [INFO ] [REMOTE ] CCS: Full fetch complete (45001 records). [2025-10-08T17:57:35.638202] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-08T17:57:35.904949] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T17:57:36.017890] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-08T17:57:36.018254] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-08T17:57:36.019352] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-08T17:57:36.019957] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-08T17:57:36.020019] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-08T17:57:36.021112] [DEBUG] [LOCAL ] CCS: Trimmed 45001 records to 30228 (keeping 200 days of data) [2025-10-08T17:57:36.210850] [DEBUG] [LOCAL ] CCS: Primary data saved (30228 records). [2025-10-08T17:57:36.210999] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-08T17:57:36.211084] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCS took 37.6s. Estimated remaining: 4h 28m 4s. Rate: 7.3 symbols/min [2025-10-08T17:57:36.384383] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:36.427887] [DEBUG] [LOCAL ] CDP: Loaded 42619 existing records from primary storage. [2025-10-08T17:57:36.428226] [INFO ] [MAIN ] CDP: Loaded 42619 existing records. [2025-10-08T17:57:36.600639] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:36.600892] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-08T17:57:36.600940] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-08T17:57:36.601154] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-08T17:57:36.601212] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-08T17:57:36.825256] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-08T17:57:36.952329] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:37.617517] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-08T17:57:37.851479] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T17:57:37.988573] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T17:57:38.383464] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T17:57:38.417535] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-08T17:57:39.217575] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-08T17:57:39.961096] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T17:57:40.017569] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-08T17:57:40.313607] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T17:57:40.805769] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T17:57:40.817493] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-08T17:57:41.617575] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-08T17:57:41.669767] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:57:42.417546] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-08T17:57:42.690001] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T17:57:42.692127] [INFO ] [REMOTE ] CCU: Full fetch complete (32451 records). [2025-10-08T17:57:42.692249] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-08T17:57:43.088974] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-08T17:57:43.089058] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-08T17:57:43.089511] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-08T17:57:43.089550] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-08T17:57:43.090340] [DEBUG] [LOCAL ] CCU: Trimmed 32451 records to 22832 (keeping 200 days of data) [2025-10-08T17:57:43.216878] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T17:57:43.217758] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-08T17:57:43.245828] [DEBUG] [LOCAL ] CCU: Primary data saved (22832 records). [2025-10-08T17:57:43.245982] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-08T17:57:43.246084] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCU took 42.6s. Estimated remaining: 4h 27m 50s. Rate: 7.3 symbols/min [2025-10-08T17:57:43.416182] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:43.442136] [DEBUG] [LOCAL ] CDRE: Loaded 24694 existing records from primary storage. [2025-10-08T17:57:43.442427] [INFO ] [MAIN ] CDRE: Loaded 24694 existing records. [2025-10-08T17:57:43.615028] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:43.615302] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-08T17:57:43.615377] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-08T17:57:43.615801] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-08T17:57:43.615872] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-08T17:57:43.963054] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:44.017514] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-08T17:57:44.817512] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-08T17:57:45.314264] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-08T17:57:45.343183] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T17:57:45.617528] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-08T17:57:45.725153] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T17:57:46.417528] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-08T17:57:46.663703] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:57:47.217574] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-08T17:57:48.017734] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-08T17:57:48.166256] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T17:57:48.358011] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T17:57:48.817529] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-08T17:57:48.867682] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T17:57:49.617617] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-08T17:57:50.197526] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:57:50.417526] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-08T17:57:50.492765] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T17:57:50.494705] [INFO ] [REMOTE ] CDLR: Full fetch complete (13556 records). [2025-10-08T17:57:50.494821] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-08T17:57:50.902695] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-08T17:57:50.902837] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-08T17:57:50.903436] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-08T17:57:50.903481] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-08T17:57:50.904134] [DEBUG] [LOCAL ] CDLR: Trimmed 13556 records to 9863 (keeping 200 days of data) [2025-10-08T17:57:50.968982] [DEBUG] [LOCAL ] CDLR: Primary data saved (9863 records). [2025-10-08T17:57:50.969202] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-08T17:57:50.969316] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDLR took 19.3s. Estimated remaining: 4h 27m 39s. Rate: 7.3 symbols/min [2025-10-08T17:57:51.153056] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:51.217582] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-08T17:57:51.221225] [DEBUG] [LOCAL ] CE: Loaded 51475 existing records from primary storage. [2025-10-08T17:57:51.221905] [INFO ] [MAIN ] CE: Loaded 51475 existing records. [2025-10-08T17:57:51.425359] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:51.425748] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-08T17:57:51.425808] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-08T17:57:51.426207] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-08T17:57:51.426268] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-08T17:57:51.814045] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:51.948726] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:57:52.017525] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-08T17:57:52.060470] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T17:57:52.817581] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-08T17:57:53.478589] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:57:53.624330] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-08T17:57:53.642224] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:57:54.417613] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-08T17:57:55.094625] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:57:55.217625] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-08T17:57:55.297613] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T17:57:56.017549] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-08T17:57:56.817626] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-08T17:57:57.190756] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:57:57.617540] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-08T17:57:57.714188] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:57:58.417523] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-08T17:57:58.560351] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:57:59.217551] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-08T17:57:59.376666] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T17:57:59.787780] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T17:58:00.017688] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-08T17:58:00.817949] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-08T17:58:00.982954] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:58:01.617566] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-08T17:58:01.755276] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T17:58:02.049292] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T17:58:02.417613] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-08T17:58:03.139321] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T17:58:03.217556] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-08T17:58:04.017536] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-08T17:58:04.087495] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T17:58:04.807346] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T17:58:04.818364] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-08T17:58:04.869603] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T17:58:05.617582] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-08T17:58:06.309054] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T17:58:06.417580] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-08T17:58:06.533304] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T17:58:07.217594] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-08T17:58:08.004931] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:58:08.017496] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-08T17:58:08.068739] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T17:58:08.817564] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-08T17:58:09.607984] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T17:58:09.617516] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-08T17:58:10.417582] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-08T17:58:10.676632] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:58:10.679051] [INFO ] [REMOTE ] CDRE: Full fetch complete (35058 records). [2025-10-08T17:58:10.679156] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-08T17:58:11.064146] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-08T17:58:11.064329] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-08T17:58:11.064975] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-08T17:58:11.065058] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-08T17:58:11.094753] [DEBUG] [LOCAL ] CDRE: Trimmed 35058 records to 24629 (keeping 200 days of data) [2025-10-08T17:58:11.098728] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-08T17:58:11.217676] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-08T17:58:11.265818] [DEBUG] [LOCAL ] CDRE: Primary data saved (24629 records). [2025-10-08T17:58:11.265950] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-08T17:58:11.266038] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDRE took 28.0s. Estimated remaining: 4h 28m 27s. Rate: 7.3 symbols/min [2025-10-08T17:58:11.430496] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:11.439017] [DEBUG] [LOCAL ] CEE: Loaded 5637 existing records from primary storage. [2025-10-08T17:58:11.439247] [INFO ] [MAIN ] CEE: Loaded 5637 existing records. [2025-10-08T17:58:11.611310] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:11.611614] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-08T17:58:11.611719] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-08T17:58:11.611914] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-08T17:58:11.611970] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-08T17:58:11.971841] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:12.017538] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-08T17:58:12.114410] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:58:12.705290] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:58:12.817556] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-08T17:58:13.021632] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T17:58:13.617572] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-08T17:58:14.417525] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-08T17:58:14.590186] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:58:14.990011] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T17:58:15.217563] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-08T17:58:15.658584] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-08T17:58:15.663421] [INFO ] [REMOTE ] CDE: Full fetch complete (77595 records). [2025-10-08T17:58:15.663594] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-08T17:58:15.960668] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T17:58:16.022742] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-08T17:58:16.102311] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-08T17:58:16.102416] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-08T17:58:16.103359] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-08T17:58:16.103485] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-08T17:58:16.105176] [DEBUG] [LOCAL ] CDE: Trimmed 77595 records to 53642 (keeping 200 days of data) [2025-10-08T17:58:16.421136] [DEBUG] [LOCAL ] CDE: Primary data saved (53642 records). [2025-10-08T17:58:16.421299] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-08T17:58:16.421900] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDE took 46.3s. Estimated remaining: 4h 28m 4s. Rate: 7.3 symbols/min [2025-10-08T17:58:16.594388] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:16.623004] [DEBUG] [LOCAL ] CEPU: Loaded 25974 existing records from primary storage. [2025-10-08T17:58:16.623307] [INFO ] [MAIN ] CEPU: Loaded 25974 existing records. [2025-10-08T17:58:16.803170] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:16.803422] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-08T17:58:16.803470] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-08T17:58:16.803713] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-08T17:58:16.803772] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-08T17:58:16.823975] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-08T17:58:17.175498] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:17.617559] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-08T17:58:17.697517] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:58:18.353871] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T17:58:18.357372] [INFO ] [REMOTE ] CDP: Full fetch complete (61807 records). [2025-10-08T17:58:18.357476] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-08T17:58:18.422459] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-08T17:58:18.632205] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:58:18.770045] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-08T17:58:18.770155] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-08T17:58:18.770905] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-08T17:58:18.770970] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-08T17:58:18.772242] [DEBUG] [LOCAL ] CDP: Trimmed 61807 records to 42533 (keeping 200 days of data) [2025-10-08T17:58:19.032513] [DEBUG] [LOCAL ] CDP: Primary data saved (42533 records). [2025-10-08T17:58:19.032668] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-08T17:58:19.033240] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDP took 42.8s. Estimated remaining: 4h 27m 30s. Rate: 7.3 symbols/min [2025-10-08T17:58:19.205402] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:19.217550] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-08T17:58:19.257669] [DEBUG] [LOCAL ] CF: Loaded 52174 existing records from primary storage. [2025-10-08T17:58:19.258029] [INFO ] [MAIN ] CF: Loaded 52174 existing records. [2025-10-08T17:58:19.435997] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:19.436214] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-08T17:58:19.436260] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-08T17:58:19.436552] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-08T17:58:19.436609] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-08T17:58:19.797890] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:19.872676] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:58:20.017585] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-08T17:58:20.817596] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-08T17:58:20.997605] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:58:21.051447] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T17:58:21.617626] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-08T17:58:22.417585] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-08T17:58:22.451551] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T17:58:22.576254] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T17:58:23.217572] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-08T17:58:24.017542] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-08T17:58:24.132871] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T17:58:24.316574] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:58:24.817587] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-08T17:58:25.120947] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:58:25.428411] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T17:58:25.617548] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-08T17:58:26.417519] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-08T17:58:26.741200] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T17:58:26.795092] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T17:58:27.217559] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-08T17:58:28.017516] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-08T17:58:28.342915] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T17:58:28.817589] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-08T17:58:29.452076] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:58:29.617562] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-08T17:58:30.251067] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T17:58:30.417576] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-08T17:58:31.217585] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-08T17:58:31.323954] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T17:58:32.017557] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-08T17:58:32.064590] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T17:58:32.068824] [INFO ] [REMOTE ] CE: Full fetch complete (74775 records). [2025-10-08T17:58:32.068952] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-08T17:58:32.260616] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T17:58:32.508494] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-08T17:58:32.508637] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-08T17:58:32.509786] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-08T17:58:32.509853] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-08T17:58:32.511393] [DEBUG] [LOCAL ] CE: Trimmed 74775 records to 51448 (keeping 200 days of data) [2025-10-08T17:58:32.817586] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-08T17:58:32.822021] [DEBUG] [LOCAL ] CE: Primary data saved (51448 records). [2025-10-08T17:58:32.822164] [INFO ] [MAIN ] CE: Full history saved. [2025-10-08T17:58:32.822249] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CE took 41.9s. Estimated remaining: 4h 27m 47s. Rate: 7.3 symbols/min [2025-10-08T17:58:32.989458] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:33.037915] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-08T17:58:33.038240] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-10-08T17:58:33.220523] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:33.221031] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-08T17:58:33.221089] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-08T17:58:33.221410] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-08T17:58:33.221468] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-08T17:58:33.582243] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:33.617567] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-08T17:58:33.717035] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:58:33.754193] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T17:58:34.417561] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-08T17:58:35.217606] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-08T17:58:35.355803] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T17:58:35.518823] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:58:35.741308] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T17:58:36.017567] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-08T17:58:36.765886] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:58:36.817564] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-08T17:58:37.371662] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:58:37.617568] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-08T17:58:38.417563] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-08T17:58:38.974471] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T17:58:39.217551] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-08T17:58:40.017556] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-08T17:58:40.075013] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T17:58:40.810631] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T17:58:40.821285] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-08T17:58:41.273206] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T17:58:41.275506] [INFO ] [REMOTE ] CEPU: Full fetch complete (39297 records). [2025-10-08T17:58:41.275577] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-08T17:58:41.557202] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T17:58:41.569451] [INFO ] [REMOTE ] CEE: Full fetch complete (10138 records). [2025-10-08T17:58:41.574983] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-08T17:58:41.618014] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-08T17:58:41.808118] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-08T17:58:41.808256] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-08T17:58:41.808882] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-08T17:58:41.809248] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-08T17:58:41.869478] [DEBUG] [LOCAL ] CEPU: Trimmed 39297 records to 25995 (keeping 200 days of data) [2025-10-08T17:58:42.179755] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-08T17:58:42.180418] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-08T17:58:42.181453] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-08T17:58:42.181530] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-08T17:58:42.184288] [DEBUG] [LOCAL ] CEE: Trimmed 10138 records to 5614 (keeping 200 days of data) [2025-10-08T17:58:42.226823] [DEBUG] [LOCAL ] CEE: Primary data saved (5614 records). [2025-10-08T17:58:42.229929] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-08T17:58:42.230062] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CEE took 31.0s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-08T17:58:42.418994] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-08T17:58:42.440159] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:42.445222] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-08T17:58:42.445108] [DEBUG] [LOCAL ] CEPU: Primary data saved (25995 records). [2025-10-08T17:58:42.445385] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-08T17:58:42.445533] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-08T17:58:42.445834] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CEPU took 26.0s. Estimated remaining: 4h 26m 59s. Rate: 7.3 symbols/min [2025-10-08T17:58:42.445709] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-08T17:58:42.459051] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-08T17:58:42.481405] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-08T17:58:42.492597] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-08T17:58:42.796026] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:43.012620] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:43.026862] [DEBUG] [LOCAL ] CFR: Loaded 33008 existing records from primary storage. [2025-10-08T17:58:43.027227] [INFO ] [MAIN ] CFR: Loaded 33008 existing records. [2025-10-08T17:58:43.212533] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:43.212819] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-08T17:58:43.212868] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-08T17:58:43.213245] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-08T17:58:43.213302] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-08T17:58:43.227007] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-08T17:58:43.475762] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:58:43.497719] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-08T17:58:43.505480] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:58:43.509137] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-08T17:58:43.516021] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:58:43.522246] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-08T17:58:43.538031] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-08T17:58:43.543398] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-08T17:58:43.572772] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-08T17:58:43.591688] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 1.4s. Estimated remaining: 4h 26m 19s. Rate: 7.3 symbols/min [2025-10-08T17:58:43.611402] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:43.797919] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-08T17:58:43.834041] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:43.872333] [DEBUG] [LOCAL ] CGAU: Loaded 43023 existing records from primary storage. [2025-10-08T17:58:43.872716] [INFO ] [MAIN ] CGAU: Loaded 43023 existing records. [2025-10-08T17:58:44.022568] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-08T17:58:44.054776] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:44.055234] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-08T17:58:44.055319] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-08T17:58:44.055723] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-08T17:58:44.055803] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-08T17:58:44.265227] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T17:58:44.478501] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:44.817554] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-08T17:58:45.472060] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:58:45.617530] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-08T17:58:46.397565] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T17:58:46.417496] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-08T17:58:46.820107] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T17:58:47.217553] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-08T17:58:47.937885] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:58:48.017603] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-08T17:58:48.822714] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-08T17:58:48.838871] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:58:49.617596] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-08T17:58:49.788958] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:58:49.963482] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T17:58:50.417551] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-08T17:58:51.073502] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T17:58:51.217572] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-08T17:58:52.017619] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-08T17:58:52.287457] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T17:58:52.444431] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T17:58:52.817623] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-08T17:58:53.395904] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T17:58:53.617638] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-08T17:58:54.293597] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T17:58:54.417551] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-08T17:58:55.217554] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-08T17:58:55.498757] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:58:55.533064] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T17:58:56.017593] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-08T17:58:56.817557] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-08T17:58:57.001697] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:58:57.478936] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:58:57.617535] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-08T17:58:58.109779] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:58:58.417548] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-08T17:58:59.070309] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T17:58:59.217596] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-08T17:58:59.913567] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T17:59:00.017562] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-08T17:59:00.817522] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-08T17:59:01.002456] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T17:59:01.617518] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-08T17:59:01.823380] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T17:59:02.235568] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T17:59:02.417565] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-08T17:59:03.099931] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T17:59:03.217627] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-08T17:59:03.755196] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T17:59:04.017695] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-08T17:59:04.785562] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:59:04.817515] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-08T17:59:05.430782] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T17:59:05.617547] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-08T17:59:06.417602] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-08T17:59:06.621828] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T17:59:06.625810] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-08T17:59:06.625934] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-08T17:59:07.025538] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-08T17:59:07.025639] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-08T17:59:07.026519] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-08T17:59:07.026571] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-08T17:59:07.028162] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53623 (keeping 200 days of data) [2025-10-08T17:59:07.127522] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T17:59:07.134170] [INFO ] [REMOTE ] CFR: Full fetch complete (48330 records). [2025-10-08T17:59:07.134859] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-08T17:59:07.223219] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-08T17:59:07.578754] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-08T17:59:07.579132] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-08T17:59:07.580191] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-08T17:59:07.582417] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-08T17:59:07.640739] [DEBUG] [LOCAL ] CFR: Trimmed 48330 records to 32900 (keeping 200 days of data) [2025-10-08T17:59:07.829637] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:59:07.969490] [DEBUG] [LOCAL ] CFG: Primary data saved (53623 records). [2025-10-08T17:59:07.970165] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-08T17:59:07.970294] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CFG took 35.1s. Estimated remaining: 4h 27m 24s. Rate: 7.3 symbols/min [2025-10-08T17:59:08.028599] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-08T17:59:08.161197] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:08.168272] [DEBUG] [LOCAL ] CGV: Loaded 1394 existing records from primary storage. [2025-10-08T17:59:08.208392] [INFO ] [MAIN ] CGV: Loaded 1394 existing records. [2025-10-08T17:59:08.402619] [DEBUG] [LOCAL ] CFR: Primary data saved (32900 records). [2025-10-08T17:59:08.409086] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-08T17:59:08.413187] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFR took 26.0s. Estimated remaining: 4h 26m 40s. Rate: 7.3 symbols/min [2025-10-08T17:59:08.432194] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:08.478192] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-08T17:59:08.489965] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-08T17:59:08.511305] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-08T17:59:08.511677] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-08T17:59:08.720276] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:08.963768] [DEBUG] [LOCAL ] CHCT: Loaded 23845 existing records from primary storage. [2025-10-08T17:59:09.005082] [INFO ] [MAIN ] CHCT: Loaded 23845 existing records. [2025-10-08T17:59:09.004984] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:09.016171] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-08T17:59:09.167493] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-08T17:59:09.233460] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:09.234033] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-08T17:59:09.234096] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-08T17:59:09.234357] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-08T17:59:09.234416] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-08T17:59:09.602987] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:09.617490] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-08T17:59:09.654983] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T17:59:09.804751] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:59:10.417549] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-08T17:59:10.563530] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T17:59:10.871973] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T17:59:11.217561] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-08T17:59:12.017621] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-08T17:59:12.402070] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-08T17:59:12.817582] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-08T17:59:12.872854] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T17:59:12.877412] [INFO ] [REMOTE ] CF: Full fetch complete (75299 records). [2025-10-08T17:59:12.877586] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-08T17:59:13.212312] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T17:59:13.323852] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-08T17:59:13.323954] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-08T17:59:13.325189] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-08T17:59:13.325269] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-08T17:59:13.327145] [DEBUG] [LOCAL ] CF: Trimmed 75299 records to 52155 (keeping 200 days of data) [2025-10-08T17:59:13.620711] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-08T17:59:13.662188] [DEBUG] [LOCAL ] CF: Primary data saved (52155 records). [2025-10-08T17:59:13.662352] [INFO ] [MAIN ] CF: Full history saved. [2025-10-08T17:59:13.663253] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CF took 54.6s. Estimated remaining: 4h 26m 18s. Rate: 7.3 symbols/min [2025-10-08T17:59:13.834711] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:13.834912] [DEBUG] [LOCAL ] CHD: No existing data file found in primary storage. [2025-10-08T17:59:13.834950] [WARN ] [MAIN ] CHD: No existing data found, performing full refresh instead. [2025-10-08T17:59:13.835060] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-08T17:59:13.835100] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-08T17:59:13.835162] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-10-08T17:59:13.835196] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-08T17:59:14.211112] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:14.417569] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-08T17:59:14.792799] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T17:59:15.217598] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-08T17:59:15.687435] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-08T17:59:16.017527] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-08T17:59:16.162396] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:59:16.817551] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-08T17:59:17.617561] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-08T17:59:17.750461] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T17:59:18.418179] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-08T17:59:18.418098] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T17:59:18.482943] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T17:59:19.217554] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-08T17:59:20.017586] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-08T17:59:20.083498] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T17:59:20.414690] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T17:59:20.490629] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T17:59:20.817593] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-08T17:59:21.617536] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-08T17:59:22.417562] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-08T17:59:22.530731] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T17:59:22.600206] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T17:59:23.217615] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-08T17:59:23.732109] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:59:23.736010] [INFO ] [REMOTE ] CGAU: Full fetch complete (61027 records). [2025-10-08T17:59:23.736144] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-08T17:59:24.024833] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-08T17:59:24.147525] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-08T17:59:24.147617] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-08T17:59:24.148339] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-08T17:59:24.148397] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-08T17:59:24.149701] [DEBUG] [LOCAL ] CGAU: Trimmed 61027 records to 43077 (keeping 200 days of data) [2025-10-08T17:59:24.411910] [DEBUG] [LOCAL ] CGAU: Primary data saved (43077 records). [2025-10-08T17:59:24.421717] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-08T17:59:24.421855] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CGAU took 40.8s. Estimated remaining: 4h 26m 21s. Rate: 7.3 symbols/min [2025-10-08T17:59:24.494871] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T17:59:24.496415] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T17:59:24.613279] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:24.631538] [DEBUG] [LOCAL ] CHE: Loaded 15233 existing records from primary storage. [2025-10-08T17:59:24.631855] [INFO ] [MAIN ] CHE: Loaded 15233 existing records. [2025-10-08T17:59:24.810717] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:24.811032] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-08T17:59:24.811079] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-08T17:59:24.811307] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-08T17:59:24.811366] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-08T17:59:24.822727] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-08T17:59:25.177951] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:25.297915] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T17:59:25.617605] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-08T17:59:26.417566] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-08T17:59:27.217586] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-08T17:59:27.421319] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:59:27.441811] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T17:59:27.506904] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-08T17:59:28.017581] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-08T17:59:28.817606] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-08T17:59:29.617520] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-08T17:59:29.708299] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:59:29.951057] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T17:59:30.417593] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-08T17:59:30.444787] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T17:59:30.868382] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T17:59:31.217566] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-08T17:59:31.986471] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T17:59:32.017531] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-08T17:59:32.818322] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-08T17:59:32.824269] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T17:59:33.617565] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-08T17:59:34.179243] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T17:59:34.298977] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T17:59:34.417552] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-08T17:59:35.217548] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-08T17:59:35.391343] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T17:59:35.706926] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:59:35.707639] [INFO ] [REMOTE ] CGV: Full fetch complete (2276 records). [2025-10-08T17:59:35.707735] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-08T17:59:36.022702] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-08T17:59:36.064372] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-08T17:59:36.064498] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-08T17:59:36.064609] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-08T17:59:36.064684] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-08T17:59:36.065074] [DEBUG] [LOCAL ] CGV: Trimmed 2276 records to 1395 (keeping 200 days of data) [2025-10-08T17:59:36.074506] [DEBUG] [LOCAL ] CGV: Primary data saved (1395 records). [2025-10-08T17:59:36.074626] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-08T17:59:36.074748] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGV took 28.1s. Estimated remaining: 4h 26m 28s. Rate: 7.3 symbols/min [2025-10-08T17:59:36.252023] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:36.298074] [DEBUG] [LOCAL ] CHGG: Loaded 47825 existing records from primary storage. [2025-10-08T17:59:36.298479] [INFO ] [MAIN ] CHGG: Loaded 47825 existing records. [2025-10-08T17:59:36.480873] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:36.481125] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-08T17:59:36.481174] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-08T17:59:36.481451] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-08T17:59:36.481509] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-08T17:59:36.820730] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-08T17:59:36.851524] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:37.617527] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-08T17:59:37.863063] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T17:59:37.884397] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T17:59:38.415144] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T17:59:38.421277] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-08T17:59:39.217586] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-08T17:59:39.338398] [DEBUG] [REMOTE ] CHCT: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T17:59:39.338783] [WARN ] [REMOTE ] CHCT: No data returned for month 2025-09 [2025-10-08T17:59:39.338872] [FATAL] [REMOTE ] CHCT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:59:39.339087] [FATAL] [MAIN ] CHCT: Failed to fetch primary data. [2025-10-08T17:59:39.339168] [WARN ] [MAIN ] CHCT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:59:39.339242] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-08T17:59:39.339307] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-08T17:59:39.339342] [INFO ] [LOCAL ] CHCT: Starting deletion of derivative data. [2025-10-08T17:59:39.339616] [DEBUG] [LOCAL ] CHCT: Deleted derivative data file. [2025-10-08T17:59:39.339736] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHCT took 30.9s. Estimated remaining: 4h 25m 58s. Rate: 7.3 symbols/min [2025-10-08T17:59:39.537992] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:39.574750] [DEBUG] [LOCAL ] CHH: Loaded 32270 existing records from primary storage. [2025-10-08T17:59:39.575162] [INFO ] [MAIN ] CHH: Loaded 32270 existing records. [2025-10-08T17:59:39.760764] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:39.760992] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-08T17:59:39.761042] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-08T17:59:39.761954] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-08T17:59:39.762017] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-08T17:59:40.027038] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-08T17:59:40.142474] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:40.817577] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-08T17:59:40.852821] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-08T17:59:41.357375] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T17:59:41.617567] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-08T17:59:42.009316] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T17:59:42.417639] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-08T17:59:43.217539] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-08T17:59:43.240439] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T17:59:43.652964] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T17:59:44.017670] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-08T17:59:44.591587] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T17:59:44.817591] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-08T17:59:45.617551] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-08T17:59:45.737187] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T17:59:45.864085] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T17:59:46.417566] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-08T17:59:46.959251] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T17:59:47.217538] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-08T17:59:47.228901] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T17:59:47.230732] [INFO ] [REMOTE ] CHE: Full fetch complete (20201 records). [2025-10-08T17:59:47.230808] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-08T17:59:47.586897] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-08T17:59:47.586979] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-08T17:59:47.587338] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-08T17:59:47.587376] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-08T17:59:47.587984] [DEBUG] [LOCAL ] CHE: Trimmed 20201 records to 15279 (keeping 200 days of data) [2025-10-08T17:59:47.687512] [DEBUG] [LOCAL ] CHE: Primary data saved (15279 records). [2025-10-08T17:59:47.687682] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-08T17:59:47.687783] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 23.3s. Estimated remaining: 4h 25m 50s. Rate: 7.3 symbols/min [2025-10-08T17:59:47.854684] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:47.874682] [DEBUG] [LOCAL ] CHMI: Loaded 21639 existing records from primary storage. [2025-10-08T17:59:47.874949] [INFO ] [MAIN ] CHMI: Loaded 21639 existing records. [2025-10-08T17:59:48.020802] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-08T17:59:48.057109] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:48.057354] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-08T17:59:48.057421] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-08T17:59:48.058292] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-08T17:59:48.058358] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-08T17:59:48.413874] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:48.592205] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:59:48.817571] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-08T17:59:49.617520] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-08T17:59:49.899070] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:59:50.417513] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-08T17:59:50.476184] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T17:59:50.680820] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:59:51.217590] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-08T17:59:52.017516] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-08T17:59:52.140598] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T17:59:52.817555] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-08T17:59:52.872871] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T17:59:53.617585] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-08T17:59:53.710211] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:59:54.417688] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-08T17:59:54.618522] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T17:59:54.978271] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T17:59:55.217583] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-08T17:59:55.686815] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:59:56.017628] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-08T17:59:56.797613] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T17:59:56.803499] [INFO ] [REMOTE ] CHD: Full fetch complete (74448 records). [2025-10-08T17:59:56.803742] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-08T17:59:56.822770] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-08T17:59:57.276739] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-08T17:59:57.276892] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-08T17:59:57.277766] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-08T17:59:57.277859] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-08T17:59:57.299828] [DEBUG] [LOCAL ] CHD: Trimmed 74448 records to 52208 (keeping 200 days of data) [2025-10-08T17:59:57.301380] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:59:57.630701] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-08T17:59:57.654407] [DEBUG] [LOCAL ] CHD: Primary data saved (52208 records). [2025-10-08T17:59:57.654549] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-08T17:59:57.654626] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHD took 44.0s. Estimated remaining: 4h 25m 50s. Rate: 7.3 symbols/min [2025-10-08T17:59:57.819865] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:57.826422] [DEBUG] [LOCAL ] CHN: Loaded 4770 existing records from primary storage. [2025-10-08T17:59:57.826743] [INFO ] [MAIN ] CHN: Loaded 4770 existing records. [2025-10-08T17:59:58.005700] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:58.006021] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-08T17:59:58.006085] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-08T17:59:58.006417] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-08T17:59:58.006476] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-08T17:59:58.371850] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:58.400244] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T17:59:58.417502] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-08T17:59:58.731962] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:59:58.888510] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T17:59:59.217620] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-08T18:00:00.017615] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-08T18:00:00.519968] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:00:00.737332] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T18:00:00.817547] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-08T18:00:01.470361] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T18:00:01.617637] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-08T18:00:02.217708] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:00:02.417703] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-08T18:00:03.217591] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-08T18:00:03.847312] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:00:04.017544] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-08T18:00:04.817581] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-08T18:00:05.340745] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T18:00:05.343743] [INFO ] [REMOTE ] CHH: Full fetch complete (47070 records). [2025-10-08T18:00:05.343851] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-08T18:00:05.627830] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-08T18:00:05.780345] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-08T18:00:05.780774] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-08T18:00:05.781439] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-08T18:00:05.781577] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-08T18:00:05.783007] [DEBUG] [LOCAL ] CHH: Trimmed 47070 records to 32293 (keeping 200 days of data) [2025-10-08T18:00:05.898908] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:00:05.934675] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-08T18:00:06.050431] [DEBUG] [LOCAL ] CHH: Primary data saved (32293 records). [2025-10-08T18:00:06.050567] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-08T18:00:06.050689] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHH took 26.7s. Estimated remaining: 4h 25m 42s. Rate: 7.3 symbols/min [2025-10-08T18:00:06.072694] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:00:06.417583] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-08T18:00:07.044990] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T18:00:07.217548] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-08T18:00:08.017556] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-08T18:00:08.676847] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:00:08.712017] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T18:00:08.817556] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-08T18:00:09.525719] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T18:00:09.617596] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-08T18:00:10.417608] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-08T18:00:10.614898] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T18:00:11.217514] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-08T18:00:11.266084] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T18:00:12.017516] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-08T18:00:12.259095] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T18:00:12.504848] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T18:00:12.817560] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-08T18:00:13.617597] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-08T18:00:14.417558] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-08T18:00:15.119594] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:00:15.120488] [INFO ] [REMOTE ] CHN: Full fetch complete (7405 records). [2025-10-08T18:00:15.120560] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-08T18:00:15.295076] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-08T18:00:15.328344] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-08T18:00:15.521366] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-08T18:00:15.521444] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-08T18:00:15.521628] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-08T18:00:15.521721] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-08T18:00:15.522135] [DEBUG] [LOCAL ] CHN: Trimmed 7405 records to 4753 (keeping 200 days of data) [2025-10-08T18:00:15.550394] [DEBUG] [LOCAL ] CHN: Primary data saved (4753 records). [2025-10-08T18:00:15.550526] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-08T18:00:15.550613] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHN took 17.9s. Estimated remaining: 4h 25m 39s. Rate: 7.3 symbols/min [2025-10-08T18:00:16.363226] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T18:00:16.373821] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-08T18:00:16.991849] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:00:16.998357] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-08T18:00:17.783306] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T18:00:17.788303] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-08T18:00:18.054661] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T18:00:18.417554] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-08T18:00:19.178977] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:00:19.217544] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-08T18:00:19.742147] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T18:00:20.017604] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-08T18:00:20.206820] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T18:00:20.208723] [INFO ] [REMOTE ] CHMI: Full fetch complete (31814 records). [2025-10-08T18:00:20.208802] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-08T18:00:20.619856] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-08T18:00:20.619963] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-08T18:00:20.620490] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-08T18:00:20.620532] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-08T18:00:20.621435] [DEBUG] [LOCAL ] CHMI: Trimmed 31814 records to 21661 (keeping 200 days of data) [2025-10-08T18:00:20.753282] [DEBUG] [LOCAL ] CHMI: Primary data saved (21661 records). [2025-10-08T18:00:20.753417] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-08T18:00:20.753497] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHMI took 33.1s. Estimated remaining: 4h 25m 18s. Rate: 7.3 symbols/min [2025-10-08T18:00:21.590609] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T18:00:21.601678] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-08T18:00:23.249790] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T18:00:23.253456] [INFO ] [REMOTE ] CHGG: Full fetch complete (70072 records). [2025-10-08T18:00:23.253624] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-08T18:00:23.258567] [FATAL] [VALIDATOR ] CHGG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:00:23.258771] [FATAL] [MAIN ] CHGG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:00:23.258818] [WARN ] [MAIN ] CHGG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:00:23.258886] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-08T18:00:23.258955] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-08T18:00:23.258992] [INFO ] [LOCAL ] CHGG: Starting deletion of derivative data. [2025-10-08T18:00:23.259197] [DEBUG] [LOCAL ] CHGG: Deleted derivative data file. [2025-10-08T18:00:23.259311] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHGG took 47.2s. Estimated remaining: 4h 24m 44s. Rate: 7.3 symbols/min [2025-10-08T18:00:23.979676] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:23.965613] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:24.008472] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-08T18:00:24.011780] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-08T18:00:24.053222] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:24.049503] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-08T18:00:24.060007] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-08T18:00:24.063239] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-08T18:00:24.063526] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-08T18:00:24.125027] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:24.272639] [DEBUG] [LOCAL ] CHT: Loaded 19602 existing records from primary storage. [2025-10-08T18:00:24.304894] [INFO ] [MAIN ] CHT: Loaded 19602 existing records. [2025-10-08T18:00:24.630969] [DEBUG] [LOCAL ] CI: Loaded 49809 existing records from primary storage. [2025-10-08T18:00:24.661982] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-08T18:00:24.667905] [INFO ] [MAIN ] CI: Loaded 49809 existing records. [2025-10-08T18:00:24.691090] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-08T18:00:24.795313] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:24.860986] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-08T18:00:24.956439] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:00:24.982843] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-08T18:00:24.999503] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-08T18:00:25.044958] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-08T18:00:25.065818] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-08T18:00:25.184721] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:00:25.230022] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:00:25.249226] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-08T18:00:25.258757] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-08T18:00:25.275422] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-08T18:00:25.294674] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-08T18:00:25.319544] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-08T18:00:25.325587] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-08T18:00:25.325695] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-08T18:00:25.325884] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-08T18:00:26.111346] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:26.135844] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-08T18:00:26.381750] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:26.387167] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-08T18:00:26.391452] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:26.391896] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-08T18:00:27.347428] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T18:00:27.351810] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-08T18:00:27.390699] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-08T18:00:27.402960] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-08T18:00:27.966859] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T18:00:27.980792] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-08T18:00:27.993928] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T18:00:27.997985] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-08T18:00:28.121391] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T18:00:28.132074] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-08T18:00:28.842475] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T18:00:28.846845] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-08T18:00:29.292741] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T18:00:29.560791] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T18:00:29.617543] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-08T18:00:30.017002] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T18:00:30.055512] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T18:00:30.417540] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-08T18:00:31.217577] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-08T18:00:31.572172] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T18:00:31.856612] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-08T18:00:32.017629] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-08T18:00:32.817703] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-08T18:00:32.875059] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T18:00:33.617597] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-08T18:00:33.691044] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T18:00:34.417546] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-08T18:00:34.584037] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T18:00:35.217530] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-08T18:00:35.418940] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:00:36.017582] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-08T18:00:36.310883] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T18:00:36.313006] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T18:00:36.817595] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-08T18:00:37.617510] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-08T18:00:37.891762] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T18:00:38.417529] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-08T18:00:38.679175] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T18:00:38.852941] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T18:00:39.217554] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-08T18:00:40.017721] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-08T18:00:40.128593] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T18:00:40.794129] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-08T18:00:40.817504] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-08T18:00:41.617575] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-08T18:00:42.220182] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T18:00:42.344007] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:00:42.417535] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-08T18:00:42.908325] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T18:00:43.217521] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-08T18:00:44.017529] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-08T18:00:44.236444] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T18:00:44.639336] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T18:00:44.817701] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-08T18:00:45.077941] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T18:00:45.617526] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-08T18:00:45.714094] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:00:45.715861] [INFO ] [REMOTE ] CHT: Full fetch complete (27485 records). [2025-10-08T18:00:45.715939] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-08T18:00:45.716556] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:00:45.716666] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:00:45.716724] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:00:45.716765] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-08T18:00:45.716836] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-08T18:00:45.716890] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-08T18:00:45.717135] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-08T18:00:45.717230] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 22.5s. Estimated remaining: 4h 25m 38s. Rate: 7.3 symbols/min [2025-10-08T18:00:45.884181] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:45.901009] [DEBUG] [LOCAL ] CIA: Loaded 16849 existing records from primary storage. [2025-10-08T18:00:45.901257] [INFO ] [MAIN ] CIA: Loaded 16849 existing records. [2025-10-08T18:00:46.076284] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:00:46.076511] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-08T18:00:46.076558] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-08T18:00:46.077052] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-08T18:00:46.077113] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-08T18:00:46.418370] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-08T18:00:46.444428] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:47.217528] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-08T18:00:47.702089] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-08T18:00:47.863692] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:00:48.017509] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-08T18:00:48.121384] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T18:00:48.817611] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-08T18:00:49.617542] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-08T18:00:49.830770] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T18:00:50.417618] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-08T18:00:50.792609] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-08T18:00:51.217568] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-08T18:00:51.483454] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T18:00:52.017675] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-08T18:00:52.068377] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T18:00:52.257447] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T18:00:52.817624] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-08T18:00:53.617547] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-08T18:00:53.726250] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T18:00:53.853040] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T18:00:54.417589] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-08T18:00:55.217540] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-08T18:00:55.507299] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T18:00:55.848190] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:00:56.017572] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-08T18:00:56.817565] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-08T18:00:57.552002] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T18:00:57.617526] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-08T18:00:57.744217] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T18:00:57.847885] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T18:00:58.417604] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-08T18:00:59.217581] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-08T18:00:59.414097] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T18:00:59.418150] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-10-08T18:00:59.418263] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-08T18:00:59.671232] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T18:00:59.873104] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-08T18:00:59.873320] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-08T18:00:59.874534] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-08T18:00:59.874621] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-08T18:00:59.876860] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 53654 (keeping 200 days of data) [2025-10-08T18:01:00.054296] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-08T18:01:00.219055] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-08T18:01:00.219208] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-08T18:01:00.219338] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHWY took 37.0s. Estimated remaining: 4h 25m 57s. Rate: 7.3 symbols/min [2025-10-08T18:01:00.403062] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:00.436225] [DEBUG] [LOCAL ] CIB: Loaded 30737 existing records from primary storage. [2025-10-08T18:01:00.436578] [INFO ] [MAIN ] CIB: Loaded 30737 existing records. [2025-10-08T18:01:00.619957] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:00.620236] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-08T18:01:00.620292] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-08T18:01:00.621274] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-08T18:01:00.621336] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-08T18:01:00.828393] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-08T18:01:00.991913] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:01.107516] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T18:01:01.184226] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T18:01:01.187189] [INFO ] [REMOTE ] CHPT: Full fetch complete (71958 records). [2025-10-08T18:01:01.187330] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-08T18:01:01.188134] [FATAL] [VALIDATOR ] CHPT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:01:01.188217] [FATAL] [MAIN ] CHPT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:01:01.188282] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:01:01.188353] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-08T18:01:01.188418] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-08T18:01:01.188452] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-10-08T18:01:01.188490] [DEBUG] [LOCAL ] CHPT: No derivative data file found to delete. [2025-10-08T18:01:01.188566] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHPT took 37.9s. Estimated remaining: 4h 25m 17s. Rate: 7.3 symbols/min [2025-10-08T18:01:01.355886] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:01.356115] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-08T18:01:01.356158] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-08T18:01:01.356271] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-08T18:01:01.356311] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-08T18:01:01.356351] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-08T18:01:01.356382] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-08T18:01:01.624712] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-08T18:01:01.649975] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T18:01:01.664950] [INFO ] [REMOTE ] CI: Full fetch complete (72263 records). [2025-10-08T18:01:01.698942] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-08T18:01:01.775365] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:02.135489] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-08T18:01:02.135570] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-08T18:01:02.136368] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-08T18:01:02.136432] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-08T18:01:02.137859] [DEBUG] [LOCAL ] CI: Trimmed 72263 records to 49812 (keeping 200 days of data) [2025-10-08T18:01:02.429688] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-08T18:01:02.466215] [DEBUG] [LOCAL ] CI: Primary data saved (49812 records). [2025-10-08T18:01:02.466406] [INFO ] [MAIN ] CI: Full history saved. [2025-10-08T18:01:02.466496] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CI took 39.2s. Estimated remaining: 4h 24m 39s. Rate: 7.3 symbols/min [2025-10-08T18:01:02.638596] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:02.686069] [DEBUG] [LOCAL ] CIEN: Loaded 52111 existing records from primary storage. [2025-10-08T18:01:02.686394] [INFO ] [MAIN ] CIEN: Loaded 52111 existing records. [2025-10-08T18:01:02.826229] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T18:01:02.887849] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:02.888085] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-08T18:01:02.888142] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-08T18:01:02.889547] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-08T18:01:02.889607] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-08T18:01:03.222806] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-08T18:01:03.244965] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:03.626251] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:01:04.017561] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-08T18:01:04.289089] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T18:01:04.817548] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-08T18:01:05.617552] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-08T18:01:05.752335] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T18:01:05.897108] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T18:01:06.417606] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-08T18:01:06.789153] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:01:07.010040] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-08T18:01:07.217598] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-08T18:01:08.017613] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-08T18:01:08.116962] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T18:01:08.505406] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T18:01:08.817614] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-08T18:01:09.617503] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-08T18:01:09.838626] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T18:01:09.840105] [INFO ] [REMOTE ] CIA: Full fetch complete (23527 records). [2025-10-08T18:01:09.840176] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-08T18:01:10.221340] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-08T18:01:10.221452] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-08T18:01:10.221878] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-08T18:01:10.221940] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-08T18:01:10.222529] [DEBUG] [LOCAL ] CIA: Trimmed 23527 records to 16834 (keeping 200 days of data) [2025-10-08T18:01:10.320141] [DEBUG] [LOCAL ] CIA: Primary data saved (16834 records). [2025-10-08T18:01:10.320298] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-08T18:01:10.320387] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CIA took 24.6s. Estimated remaining: 4h 24m 29s. Rate: 7.3 symbols/min [2025-10-08T18:01:10.422911] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-08T18:01:10.504845] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:10.505023] [DEBUG] [LOCAL ] CIF: No existing data file found in primary storage. [2025-10-08T18:01:10.505058] [WARN ] [MAIN ] CIF: No existing data found, performing full refresh instead. [2025-10-08T18:01:10.505170] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-08T18:01:10.505211] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-08T18:01:10.505250] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-10-08T18:01:10.505281] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-08T18:01:10.858899] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:11.217616] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-08T18:01:11.443623] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:01:11.709565] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T18:01:11.788474] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T18:01:12.017558] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-08T18:01:12.817606] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-08T18:01:13.450036] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T18:01:13.497600] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T18:01:13.617595] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-08T18:01:14.417568] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-08T18:01:15.217559] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-08T18:01:15.451105] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T18:01:15.505236] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-08T18:01:15.785925] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:01:16.017557] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-08T18:01:16.817617] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-08T18:01:17.512674] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T18:01:17.617516] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-08T18:01:17.764292] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T18:01:18.417622] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-08T18:01:18.894360] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T18:01:18.929103] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-08T18:01:19.217604] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-08T18:01:19.648248] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-08T18:01:20.017613] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-08T18:01:20.817548] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-08T18:01:21.076378] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-08T18:01:21.617533] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-08T18:01:21.699618] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T18:01:21.992273] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-08T18:01:22.417561] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-08T18:01:22.846035] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T18:01:23.217558] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-08T18:01:23.574229] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:01:24.017552] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-08T18:01:24.817513] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-08T18:01:25.127515] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-08T18:01:25.285460] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T18:01:25.617596] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-08T18:01:26.417560] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-08T18:01:26.796410] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T18:01:26.797179] [INFO ] [REMOTE ] CICB: Full fetch complete (1991 records). [2025-10-08T18:01:26.797253] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-08T18:01:26.797627] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:01:26.797750] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:01:26.797793] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:01:26.797837] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-08T18:01:26.797930] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-08T18:01:26.797987] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-08T18:01:26.798032] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-08T18:01:26.798106] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CICB took 25.6s. Estimated remaining: 4h 24m 56s. Rate: 7.3 symbols/min [2025-10-08T18:01:26.981229] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:27.026057] [DEBUG] [LOCAL ] CIG: Loaded 43835 existing records from primary storage. [2025-10-08T18:01:27.026389] [INFO ] [MAIN ] CIG: Loaded 43835 existing records. [2025-10-08T18:01:27.221264] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-08T18:01:27.221169] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:27.222444] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-08T18:01:27.222529] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-08T18:01:27.232968] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-08T18:01:27.250782] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-08T18:01:27.311929] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T18:01:27.637538] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:28.017577] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-08T18:01:28.502993] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T18:01:28.794727] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T18:01:28.817571] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-08T18:01:29.295383] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T18:01:29.617552] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-08T18:01:30.417599] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-08T18:01:31.217579] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-08T18:01:31.263233] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T18:01:31.540788] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T18:01:32.017640] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-08T18:01:32.462844] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T18:01:32.817520] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-08T18:01:33.617591] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-08T18:01:33.838913] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:01:34.050338] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T18:01:34.417616] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-08T18:01:35.185486] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:01:35.217518] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-08T18:01:35.647300] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T18:01:36.017625] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-08T18:01:36.567946] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T18:01:36.598709] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T18:01:36.817563] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-08T18:01:37.617537] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-08T18:01:38.138478] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T18:01:38.406464] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:01:38.417500] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-08T18:01:39.217595] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-08T18:01:40.007813] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:01:40.017505] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-08T18:01:40.047195] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T18:01:40.817609] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-08T18:01:41.579840] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T18:01:41.607997] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T18:01:41.617463] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-08T18:01:42.417570] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-08T18:01:42.998259] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T18:01:43.068350] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T18:01:43.217549] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-08T18:01:44.017587] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-08T18:01:44.251461] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T18:01:44.263989] [INFO ] [REMOTE ] CIB: Full fetch complete (44547 records). [2025-10-08T18:01:44.264224] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-08T18:01:44.821703] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-08T18:01:44.864183] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-08T18:01:44.864325] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-08T18:01:44.865155] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-08T18:01:44.865230] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-08T18:01:44.866768] [DEBUG] [LOCAL ] CIB: Trimmed 44547 records to 30591 (keeping 200 days of data) [2025-10-08T18:01:45.088796] [DEBUG] [LOCAL ] CIB: Primary data saved (30591 records). [2025-10-08T18:01:45.088960] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-08T18:01:45.089051] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 44.9s. Estimated remaining: 4h 25m 31s. Rate: 7.2 symbols/min [2025-10-08T18:01:45.302480] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:45.319944] [DEBUG] [LOCAL ] CII: Loaded 15178 existing records from primary storage. [2025-10-08T18:01:45.320214] [INFO ] [MAIN ] CII: Loaded 15178 existing records. [2025-10-08T18:01:45.523256] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:45.523522] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-08T18:01:45.523570] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-08T18:01:45.524143] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-08T18:01:45.524203] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-08T18:01:45.628745] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-08T18:01:45.956830] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:46.001449] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T18:01:46.185760] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T18:01:46.186622] [INFO ] [REMOTE ] CIF: Full fetch complete (6595 records). [2025-10-08T18:01:46.186726] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-08T18:01:46.425317] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-08T18:01:46.582093] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-08T18:01:46.582208] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-08T18:01:46.582437] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-08T18:01:46.582509] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-08T18:01:46.583132] [DEBUG] [LOCAL ] CIF: Trimmed 6595 records to 4097 (keeping 200 days of data) [2025-10-08T18:01:46.632517] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T18:01:46.650239] [DEBUG] [LOCAL ] CIF: Primary data saved (4097 records). [2025-10-08T18:01:46.650574] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-08T18:01:46.650701] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIF took 36.3s. Estimated remaining: 4h 24m 54s. Rate: 7.3 symbols/min [2025-10-08T18:01:46.819417] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:46.859314] [DEBUG] [LOCAL ] CIM: Loaded 37719 existing records from primary storage. [2025-10-08T18:01:46.859701] [INFO ] [MAIN ] CIM: Loaded 37719 existing records. [2025-10-08T18:01:47.057184] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:47.057521] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-08T18:01:47.057584] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-08T18:01:47.058793] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-08T18:01:47.058855] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-08T18:01:47.222839] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-08T18:01:47.458267] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:47.596933] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T18:01:48.017601] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-08T18:01:48.767325] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:01:48.817531] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-08T18:01:49.366269] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:01:49.617545] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-08T18:01:50.427550] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-08T18:01:50.453209] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:01:51.217632] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-08T18:01:51.326577] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T18:01:51.484026] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T18:01:51.489507] [INFO ] [REMOTE ] CIEN: Full fetch complete (75175 records). [2025-10-08T18:01:51.489715] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-08T18:01:51.493748] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:01:51.493882] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:01:51.493965] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:01:51.494063] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-08T18:01:51.494188] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-08T18:01:51.494257] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-08T18:01:51.494788] [DEBUG] [LOCAL ] CIEN: Deleted derivative data file. [2025-10-08T18:01:51.494897] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIEN took 49.0s. Estimated remaining: 4h 24m 31s. Rate: 7.3 symbols/min [2025-10-08T18:01:51.696073] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:51.696303] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-10-08T18:01:51.696348] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-10-08T18:01:51.696471] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-08T18:01:51.696514] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-08T18:01:51.696558] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-08T18:01:51.696592] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-08T18:01:52.022764] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-08T18:01:52.093321] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:52.412533] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:01:52.817532] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-08T18:01:53.054359] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:01:53.617532] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-08T18:01:54.417549] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-08T18:01:54.443875] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T18:01:54.450207] [INFO ] [REMOTE ] CIG: Full fetch complete (61351 records). [2025-10-08T18:01:54.450366] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-08T18:01:54.720166] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T18:01:54.889069] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-08T18:01:54.889156] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-08T18:01:54.889879] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-08T18:01:54.889942] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-08T18:01:54.891508] [DEBUG] [LOCAL ] CIG: Trimmed 61351 records to 43848 (keeping 200 days of data) [2025-10-08T18:01:55.071340] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T18:01:55.155528] [DEBUG] [LOCAL ] CIG: Primary data saved (43848 records). [2025-10-08T18:01:55.155693] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-08T18:01:55.157128] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CIG took 28.4s. Estimated remaining: 4h 24m 3s. Rate: 7.3 symbols/min [2025-10-08T18:01:55.222757] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-08T18:01:55.330795] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:55.330942] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-08T18:01:55.330978] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-08T18:01:55.331088] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-08T18:01:55.331130] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-08T18:01:55.331172] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-08T18:01:55.331205] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-08T18:01:55.672610] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:56.017558] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-08T18:01:56.427352] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T18:01:56.817542] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-08T18:01:56.868063] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T18:01:57.617533] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-08T18:01:57.888521] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T18:01:58.417722] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-08T18:01:58.981948] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:01:59.015928] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:01:59.217580] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-08T18:02:00.017559] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-08T18:02:00.473214] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T18:02:00.817518] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-08T18:02:01.159869] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T18:02:01.599622] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T18:02:01.617508] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-08T18:02:02.417545] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-08T18:02:02.597850] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:02:03.217601] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-08T18:02:03.717231] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T18:02:03.980779] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:02:04.017517] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-08T18:02:04.817554] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-08T18:02:05.467254] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:02:05.596846] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T18:02:05.617520] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-08T18:02:06.417516] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-08T18:02:06.660489] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:02:07.217585] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-08T18:02:07.599144] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T18:02:08.017554] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-08T18:02:08.157250] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T18:02:08.158865] [INFO ] [REMOTE ] CII: Full fetch complete (22838 records). [2025-10-08T18:02:08.158937] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-08T18:02:08.159507] [FATAL] [VALIDATOR ] CII: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:02:08.159586] [FATAL] [MAIN ] CII: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:02:08.159676] [WARN ] [MAIN ] CII: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:02:08.159735] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-08T18:02:08.159792] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-08T18:02:08.159826] [INFO ] [LOCAL ] CII: Starting deletion of derivative data. [2025-10-08T18:02:08.160026] [DEBUG] [LOCAL ] CII: Deleted derivative data file. [2025-10-08T18:02:08.160207] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CII took 23.1s. Estimated remaining: 4h 24m 15s. Rate: 7.3 symbols/min [2025-10-08T18:02:08.327101] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:08.327319] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-08T18:02:08.327374] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-08T18:02:08.327495] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-08T18:02:08.327539] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-08T18:02:08.327579] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-08T18:02:08.327611] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-08T18:02:08.616218] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T18:02:08.702199] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:08.817579] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-08T18:02:09.025178] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:02:09.025484] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-08T18:02:09.025599] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:02:09.025727] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-08T18:02:09.025812] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:02:09.025897] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-08T18:02:09.026005] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-08T18:02:09.026066] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-08T18:02:09.026141] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-08T18:02:09.026226] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMP took 0.9s. Estimated remaining: 4h 23m 36s. Rate: 7.3 symbols/min [2025-10-08T18:02:09.270185] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:09.293308] [DEBUG] [LOCAL ] CINT: Loaded 19213 existing records from primary storage. [2025-10-08T18:02:09.293696] [INFO ] [MAIN ] CINT: Loaded 19213 existing records. [2025-10-08T18:02:09.521781] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:09.522090] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-08T18:02:09.522151] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-08T18:02:09.522764] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-08T18:02:09.522829] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-08T18:02:09.622351] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-08T18:02:09.899827] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:10.145621] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T18:02:10.417610] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-08T18:02:11.217523] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-08T18:02:11.379434] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T18:02:12.017559] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-08T18:02:12.564739] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T18:02:12.811401] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T18:02:12.819093] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-08T18:02:13.308342] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T18:02:13.617561] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-08T18:02:14.417563] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-08T18:02:14.978609] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T18:02:15.032036] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:02:15.217559] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-08T18:02:16.017547] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-08T18:02:16.745532] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T18:02:16.765923] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T18:02:16.817542] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-08T18:02:17.260659] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T18:02:17.617540] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-08T18:02:17.993762] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T18:02:18.417547] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-08T18:02:18.962093] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T18:02:19.217555] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-08T18:02:19.683401] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:02:20.017554] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-08T18:02:20.628354] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T18:02:20.817607] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-08T18:02:21.282811] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-08T18:02:21.617537] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-08T18:02:22.417608] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-08T18:02:22.503736] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T18:02:23.144729] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:02:23.217607] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-08T18:02:23.768629] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T18:02:24.017610] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-08T18:02:24.711637] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T18:02:24.712847] [INFO ] [REMOTE ] CIMO: Full fetch complete (5167 records). [2025-10-08T18:02:24.712981] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-08T18:02:24.822704] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-08T18:02:24.927282] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T18:02:24.927527] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:02:24.927597] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:02:24.927693] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-08T18:02:24.927763] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-08T18:02:24.927798] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-08T18:02:24.927838] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-08T18:02:24.927954] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMO took 29.8s. Estimated remaining: 4h 23m 60s. Rate: 7.3 symbols/min [2025-10-08T18:02:25.117258] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:25.138711] [DEBUG] [LOCAL ] CIO: Loaded 20458 existing records from primary storage. [2025-10-08T18:02:25.138981] [INFO ] [MAIN ] CIO: Loaded 20458 existing records. [2025-10-08T18:02:25.314260] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:25.314487] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-08T18:02:25.314533] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-08T18:02:25.315163] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-08T18:02:25.315222] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-08T18:02:25.419152] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T18:02:25.622725] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-08T18:02:25.676663] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:26.417581] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-08T18:02:26.697811] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T18:02:26.782141] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T18:02:27.217565] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-08T18:02:27.725795] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T18:02:27.726844] [INFO ] [REMOTE ] CIMN: Full fetch complete (3930 records). [2025-10-08T18:02:27.726921] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-08T18:02:28.022811] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-08T18:02:28.128226] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-08T18:02:28.128317] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-08T18:02:28.128494] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-08T18:02:28.128582] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-08T18:02:28.129050] [DEBUG] [LOCAL ] CIMN: Trimmed 3930 records to 2733 (keeping 200 days of data) [2025-10-08T18:02:28.146543] [DEBUG] [LOCAL ] CIMN: Primary data saved (2733 records). [2025-10-08T18:02:28.146810] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-08T18:02:28.146929] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIMN took 36.7s. Estimated remaining: 4h 23m 30s. Rate: 7.3 symbols/min [2025-10-08T18:02:28.325743] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:28.355273] [DEBUG] [LOCAL ] CION: Loaded 28464 existing records from primary storage. [2025-10-08T18:02:28.355597] [INFO ] [MAIN ] CION: Loaded 28464 existing records. [2025-10-08T18:02:28.559541] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:28.559830] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-08T18:02:28.559880] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-08T18:02:28.560706] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-08T18:02:28.560770] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-08T18:02:28.822684] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-08T18:02:28.968801] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:29.415430] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T18:02:29.418796] [INFO ] [REMOTE ] CIM: Full fetch complete (54758 records). [2025-10-08T18:02:29.418930] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-08T18:02:29.419625] [FATAL] [VALIDATOR ] CIM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:02:29.419738] [FATAL] [MAIN ] CIM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:02:29.419784] [WARN ] [MAIN ] CIM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:02:29.419824] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-08T18:02:29.419884] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-08T18:02:29.419921] [INFO ] [LOCAL ] CIM: Starting deletion of derivative data. [2025-10-08T18:02:29.420086] [DEBUG] [LOCAL ] CIM: Deleted derivative data file. [2025-10-08T18:02:29.420961] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIM took 42.8s. Estimated remaining: 4h 22m 53s. Rate: 7.3 symbols/min [2025-10-08T18:02:29.595831] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:29.617579] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-08T18:02:29.656445] [DEBUG] [LOCAL ] CIVI: Loaded 52615 existing records from primary storage. [2025-10-08T18:02:29.656798] [INFO ] [MAIN ] CIVI: Loaded 52615 existing records. [2025-10-08T18:02:29.838051] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:29.838496] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-08T18:02:29.838613] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-08T18:02:29.839005] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-08T18:02:29.839064] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-08T18:02:29.967846] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T18:02:30.237052] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:30.417571] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-08T18:02:31.024224] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:02:31.103007] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T18:02:31.217616] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-08T18:02:32.017563] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-08T18:02:32.410532] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:02:32.817561] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-08T18:02:33.262930] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T18:02:33.617591] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-08T18:02:33.655474] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T18:02:34.417601] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-08T18:02:34.733619] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T18:02:35.217551] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-08T18:02:36.017580] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-08T18:02:36.127589] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:02:36.174406] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T18:02:36.817586] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-08T18:02:37.432091] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T18:02:37.617558] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-08T18:02:37.967775] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T18:02:38.417599] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-08T18:02:38.609023] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T18:02:39.217561] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-08T18:02:40.017512] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-08T18:02:40.144759] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:02:40.322923] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:02:40.817620] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-08T18:02:41.096755] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T18:02:41.617558] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-08T18:02:42.385768] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T18:02:42.417537] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-08T18:02:42.602166] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:02:43.217580] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-08T18:02:44.017515] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-08T18:02:44.190624] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T18:02:44.227876] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T18:02:44.817606] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-08T18:02:45.374541] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:02:45.378233] [INFO ] [REMOTE ] CINT: Full fetch complete (27357 records). [2025-10-08T18:02:45.378343] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-08T18:02:45.627076] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-08T18:02:45.748083] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-08T18:02:45.748172] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-08T18:02:45.748824] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-08T18:02:45.748923] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-08T18:02:45.749865] [DEBUG] [LOCAL ] CINT: Trimmed 27357 records to 19416 (keeping 200 days of data) [2025-10-08T18:02:45.873845] [DEBUG] [LOCAL ] CINT: Primary data saved (19416 records). [2025-10-08T18:02:45.874013] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-08T18:02:45.874113] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CINT took 36.8s. Estimated remaining: 4h 23m 19s. Rate: 7.3 symbols/min [2025-10-08T18:02:46.059225] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:46.111550] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-08T18:02:46.111933] [INFO ] [MAIN ] CL: Loaded 53648 existing records. [2025-10-08T18:02:46.307671] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:46.307968] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-08T18:02:46.308031] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-08T18:02:46.309027] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-08T18:02:46.309089] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-08T18:02:46.428920] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-08T18:02:46.615216] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:02:46.702707] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:46.759757] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T18:02:47.217546] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-08T18:02:47.562423] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T18:02:48.017564] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-08T18:02:48.714396] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T18:02:48.817633] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-08T18:02:49.500045] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:02:49.617511] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-08T18:02:50.417569] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-08T18:02:50.609024] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T18:02:50.827230] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T18:02:51.217558] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-08T18:02:52.017507] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-08T18:02:52.129773] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T18:02:52.342534] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T18:02:52.817636] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-08T18:02:53.617565] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-08T18:02:53.811977] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T18:02:53.947877] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T18:02:54.417572] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-08T18:02:54.511856] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T18:02:55.217623] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-08T18:02:56.022698] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-08T18:02:56.044449] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T18:02:56.817599] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-08T18:02:56.976820] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T18:02:57.504341] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:02:57.617601] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-08T18:02:58.417559] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-08T18:02:58.762080] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T18:02:59.217520] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-08T18:02:59.361725] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T18:02:59.510897] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T18:02:59.881919] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T18:03:00.017571] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-08T18:03:00.817622] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-08T18:03:01.617606] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-08T18:03:02.146528] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T18:03:02.434598] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-08T18:03:02.443686] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:03:02.768086] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:03:03.217621] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-08T18:03:03.565664] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T18:03:03.567964] [INFO ] [REMOTE ] CIO: Full fetch complete (29171 records). [2025-10-08T18:03:03.568060] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-08T18:03:03.940536] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-08T18:03:03.940620] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-08T18:03:03.941088] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-08T18:03:03.941142] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-08T18:03:03.941974] [DEBUG] [LOCAL ] CIO: Trimmed 29171 records to 20422 (keeping 200 days of data) [2025-10-08T18:03:04.023036] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-08T18:03:04.062037] [DEBUG] [LOCAL ] CIO: Primary data saved (20422 records). [2025-10-08T18:03:04.062173] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-08T18:03:04.062256] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIO took 39.1s. Estimated remaining: 4h 23m 52s. Rate: 7.3 symbols/min [2025-10-08T18:03:04.237441] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:04.280102] [DEBUG] [LOCAL ] CLB: Loaded 33057 existing records from primary storage. [2025-10-08T18:03:04.280466] [INFO ] [MAIN ] CLB: Loaded 33057 existing records. [2025-10-08T18:03:04.459352] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:03:04.459671] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-08T18:03:04.459745] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-08T18:03:04.460056] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-08T18:03:04.460113] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-08T18:03:04.841883] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:04.842101] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-08T18:03:05.130791] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T18:03:05.133043] [INFO ] [REMOTE ] CION: Full fetch complete (40429 records). [2025-10-08T18:03:05.133149] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-08T18:03:05.133805] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:03:05.133897] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:03:05.133940] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:03:05.133978] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-08T18:03:05.134034] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-08T18:03:05.134069] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-08T18:03:05.134304] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-10-08T18:03:05.134410] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CION took 37.0s. Estimated remaining: 4h 23m 14s. Rate: 7.3 symbols/min [2025-10-08T18:03:05.312021] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:05.357730] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T18:03:05.375209] [DEBUG] [LOCAL ] CLCO: Loaded 12716 existing records from primary storage. [2025-10-08T18:03:05.375805] [INFO ] [MAIN ] CLCO: Loaded 12716 existing records. [2025-10-08T18:03:05.589465] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:03:05.589732] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-08T18:03:05.589789] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-08T18:03:05.590070] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-08T18:03:05.590153] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-08T18:03:05.628968] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-08T18:03:06.027798] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:06.184304] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T18:03:06.189611] [INFO ] [REMOTE ] CIVI: Full fetch complete (75734 records). [2025-10-08T18:03:06.189841] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-08T18:03:06.422792] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-08T18:03:06.592632] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-08T18:03:06.592803] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-08T18:03:06.593878] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-08T18:03:06.593943] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-08T18:03:06.595820] [DEBUG] [LOCAL ] CIVI: Trimmed 75734 records to 52615 (keeping 200 days of data) [2025-10-08T18:03:06.930183] [DEBUG] [LOCAL ] CIVI: Primary data saved (52615 records). [2025-10-08T18:03:06.930345] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-08T18:03:06.931054] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CIVI took 37.5s. Estimated remaining: 4h 22m 39s. Rate: 7.3 symbols/min [2025-10-08T18:03:07.099398] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:07.099611] [DEBUG] [LOCAL ] CLDT: No existing data file found in primary storage. [2025-10-08T18:03:07.099685] [WARN ] [MAIN ] CLDT: No existing data found, performing full refresh instead. [2025-10-08T18:03:07.099798] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-08T18:03:07.099885] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-08T18:03:07.099948] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-10-08T18:03:07.099982] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-08T18:03:07.222685] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-08T18:03:07.477335] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:07.542297] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:03:07.731852] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T18:03:08.017548] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-08T18:03:08.301675] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T18:03:08.817548] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-08T18:03:09.320020] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T18:03:09.617551] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-08T18:03:10.417548] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-08T18:03:11.013236] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T18:03:11.085298] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-08T18:03:11.217565] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-08T18:03:11.689274] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T18:03:12.017549] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-08T18:03:12.413271] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T18:03:12.817544] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-08T18:03:13.130701] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:03:13.617546] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-08T18:03:13.863258] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T18:03:14.417555] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-08T18:03:14.923148] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T18:03:15.217631] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-08T18:03:16.017557] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-08T18:03:16.260844] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T18:03:16.629605] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T18:03:16.817558] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-08T18:03:17.531771] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:03:17.617584] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-08T18:03:17.944138] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T18:03:18.417805] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-08T18:03:19.084821] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T18:03:19.217535] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-08T18:03:19.720721] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:03:20.017615] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-08T18:03:20.538890] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T18:03:20.817589] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-08T18:03:21.183498] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T18:03:21.617596] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-08T18:03:22.085056] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T18:03:22.417734] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-08T18:03:22.506258] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T18:03:23.217587] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-08T18:03:23.671271] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T18:03:24.017731] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-08T18:03:24.817541] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-08T18:03:25.029444] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T18:03:25.377274] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-08T18:03:25.617538] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-08T18:03:25.999906] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T18:03:26.417621] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-08T18:03:27.217801] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-08T18:03:27.352849] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T18:03:27.358195] [INFO ] [REMOTE ] CL: Full fetch complete (77620 records). [2025-10-08T18:03:27.358336] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-08T18:03:27.857055] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-08T18:03:27.857398] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-08T18:03:27.859159] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T18:03:27.860239] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-08T18:03:27.867605] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-08T18:03:27.869999] [DEBUG] [LOCAL ] CL: Trimmed 77620 records to 53648 (keeping 200 days of data) [2025-10-08T18:03:28.057106] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-08T18:03:28.067374] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T18:03:28.218436] [DEBUG] [LOCAL ] CL: Primary data saved (53648 records). [2025-10-08T18:03:28.218606] [INFO ] [MAIN ] CL: Full history saved. [2025-10-08T18:03:28.218742] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CL took 42.3s. Estimated remaining: 4h 23m 25s. Rate: 7.3 symbols/min [2025-10-08T18:03:28.397090] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:28.449161] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-08T18:03:28.449553] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-08T18:03:28.628259] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:03:28.628507] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-08T18:03:28.628600] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-08T18:03:28.629035] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-08T18:03:28.629108] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-08T18:03:28.822710] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-08T18:03:28.997903] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:29.287083] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T18:03:29.617579] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-08T18:03:30.403021] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T18:03:30.407818] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T18:03:30.409252] [INFO ] [REMOTE ] CLB: Full fetch complete (46526 records). [2025-10-08T18:03:30.411595] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-08T18:03:30.423212] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-08T18:03:30.823133] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-08T18:03:30.823230] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-08T18:03:30.823821] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-08T18:03:30.823885] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-08T18:03:30.825058] [DEBUG] [LOCAL ] CLB: Trimmed 46526 records to 33007 (keeping 200 days of data) [2025-10-08T18:03:31.040716] [DEBUG] [LOCAL ] CLB: Primary data saved (33007 records). [2025-10-08T18:03:31.040896] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-08T18:03:31.041014] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CLB took 27.0s. Estimated remaining: 4h 22m 54s. Rate: 7.3 symbols/min [2025-10-08T18:03:31.219240] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-08T18:03:31.219144] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:31.246158] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T18:03:31.260785] [DEBUG] [LOCAL ] CLH: Loaded 27665 existing records from primary storage. [2025-10-08T18:03:31.261096] [INFO ] [MAIN ] CLH: Loaded 27665 existing records. [2025-10-08T18:03:31.441583] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:03:31.441825] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-08T18:03:31.441875] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-08T18:03:31.442160] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-08T18:03:31.442218] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-08T18:03:31.796588] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:32.017608] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-08T18:03:32.191471] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T18:03:32.817573] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-08T18:03:33.280978] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T18:03:33.617617] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-08T18:03:34.417519] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-08T18:03:34.566871] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T18:03:34.816006] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T18:03:35.217609] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-08T18:03:35.405300] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T18:03:36.017622] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-08T18:03:36.817536] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-08T18:03:37.141722] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T18:03:37.419446] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T18:03:37.546175] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:03:37.548227] [INFO ] [REMOTE ] CLCO: Full fetch complete (22578 records). [2025-10-08T18:03:37.548297] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-08T18:03:37.622719] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-08T18:03:37.960381] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-08T18:03:37.960477] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-08T18:03:37.961310] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-08T18:03:37.961376] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-08T18:03:37.962402] [DEBUG] [LOCAL ] CLCO: Trimmed 22578 records to 12762 (keeping 200 days of data) [2025-10-08T18:03:38.046131] [DEBUG] [LOCAL ] CLCO: Primary data saved (12762 records). [2025-10-08T18:03:38.046289] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-08T18:03:38.046405] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLCO took 32.9s. Estimated remaining: 4h 22m 40s. Rate: 7.3 symbols/min [2025-10-08T18:03:38.263747] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:38.263939] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-08T18:03:38.263979] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-08T18:03:38.264091] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-08T18:03:38.264132] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-08T18:03:38.264175] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-08T18:03:38.264209] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-08T18:03:38.422762] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-08T18:03:38.651204] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:38.812854] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T18:03:39.217592] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-08T18:03:39.458206] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T18:03:40.017538] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-08T18:03:40.234874] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T18:03:40.817552] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-08T18:03:41.617582] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-08T18:03:41.917283] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T18:03:42.111202] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T18:03:42.157973] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T18:03:42.417624] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-08T18:03:43.217576] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-08T18:03:44.017535] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-08T18:03:44.153373] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T18:03:44.415085] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T18:03:44.417434] [INFO ] [REMOTE ] CLDT: Full fetch complete (37225 records). [2025-10-08T18:03:44.417518] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-08T18:03:44.824695] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-08T18:03:44.837298] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T18:03:44.836821] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-08T18:03:44.840921] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-08T18:03:44.841488] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-08T18:03:44.841534] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-08T18:03:44.842368] [DEBUG] [LOCAL ] CLDT: Trimmed 37225 records to 25381 (keeping 200 days of data) [2025-10-08T18:03:45.000082] [DEBUG] [LOCAL ] CLDT: Primary data saved (25381 records). [2025-10-08T18:03:45.000300] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-08T18:03:45.000437] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLDT took 38.1s. Estimated remaining: 4h 22m 27s. Rate: 7.3 symbols/min [2025-10-08T18:03:45.277006] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:45.277349] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-10-08T18:03:45.277413] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-10-08T18:03:45.277534] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-08T18:03:45.277596] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-08T18:03:45.277706] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-08T18:03:45.277778] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-08T18:03:45.622817] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-08T18:03:45.847560] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:46.417529] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-08T18:03:46.754526] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T18:03:46.888809] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T18:03:47.217582] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-08T18:03:48.017508] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-08T18:03:48.081767] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T18:03:48.154811] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T18:03:48.817590] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-08T18:03:48.933915] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T18:03:49.617609] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-08T18:03:50.417570] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-08T18:03:50.595785] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T18:03:50.938796] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-08T18:03:51.217573] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-08T18:03:51.623489] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T18:03:52.017567] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-08T18:03:52.817611] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-08T18:03:53.617585] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-08T18:03:53.821801] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-08T18:03:53.852788] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T18:03:53.933927] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T18:03:54.372925] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T18:03:54.417531] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-08T18:03:55.069005] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T18:03:55.217616] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-08T18:03:56.017548] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-08T18:03:56.120330] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T18:03:56.817562] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-08T18:03:57.220003] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T18:03:57.338359] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T18:03:57.617568] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-08T18:03:58.417546] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-08T18:03:58.684824] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T18:03:58.687319] [INFO ] [REMOTE ] CLH: Full fetch complete (41784 records). [2025-10-08T18:03:58.687403] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-08T18:03:59.171379] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-08T18:03:59.171491] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-08T18:03:59.172197] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-08T18:03:59.172274] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-08T18:03:59.173572] [DEBUG] [LOCAL ] CLH: Trimmed 41784 records to 27621 (keeping 200 days of data) [2025-10-08T18:03:59.234355] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-08T18:03:59.357593] [DEBUG] [LOCAL ] CLH: Primary data saved (27621 records). [2025-10-08T18:03:59.357796] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-08T18:03:59.357923] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLH took 28.3s. Estimated remaining: 4h 22m 44s. Rate: 7.3 symbols/min [2025-10-08T18:03:59.531805] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:59.532012] [DEBUG] [LOCAL ] CLVT: No existing data file found in primary storage. [2025-10-08T18:03:59.532049] [WARN ] [MAIN ] CLVT: No existing data found, performing full refresh instead. [2025-10-08T18:03:59.532212] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-08T18:03:59.532259] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-08T18:03:59.532299] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-08T18:03:59.532330] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-08T18:03:59.885195] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:00.017586] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-08T18:04:00.563366] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-08T18:04:00.817556] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-08T18:04:01.550313] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-08T18:04:01.617529] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-08T18:04:02.002129] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T18:04:02.417571] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-08T18:04:03.168769] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-08T18:04:03.217499] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-08T18:04:03.566843] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:04:04.017574] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-08T18:04:04.240030] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-08T18:04:04.622327] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T18:04:04.623847] [INFO ] [REMOTE ] CLPR: Full fetch complete (16787 records). [2025-10-08T18:04:04.623944] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-08T18:04:04.823916] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-08T18:04:05.011901] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-08T18:04:05.012432] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-08T18:04:05.012944] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-08T18:04:05.013009] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-08T18:04:05.013824] [DEBUG] [LOCAL ] CLPR: Trimmed 16787 records to 10563 (keeping 200 days of data) [2025-10-08T18:04:05.079841] [DEBUG] [LOCAL ] CLPR: Primary data saved (10563 records). [2025-10-08T18:04:05.079995] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-08T18:04:05.080073] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLPR took 27.0s. Estimated remaining: 4h 22m 25s. Rate: 7.3 symbols/min [2025-10-08T18:04:05.284132] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:05.287415] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-08T18:04:05.319116] [DEBUG] [LOCAL ] CLW: Loaded 21707 existing records from primary storage. [2025-10-08T18:04:05.319372] [INFO ] [MAIN ] CLW: Loaded 21707 existing records. [2025-10-08T18:04:05.493693] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:05.493933] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-08T18:04:05.493979] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-08T18:04:05.494405] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-08T18:04:05.494465] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-08T18:04:05.633328] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-08T18:04:05.855807] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:06.417612] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-08T18:04:07.192829] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T18:04:07.217505] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-08T18:04:07.339127] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T18:04:07.516220] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T18:04:08.017600] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-08T18:04:08.817602] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-08T18:04:09.489917] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-08T18:04:09.617552] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-08T18:04:10.069011] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-08T18:04:10.304523] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T18:04:10.417580] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-08T18:04:11.217601] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-08T18:04:11.530972] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:04:11.639390] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T18:04:12.017578] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-08T18:04:12.817547] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-08T18:04:12.956871] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T18:04:13.617611] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-08T18:04:14.350027] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-08T18:04:14.417537] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-08T18:04:14.790790] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T18:04:14.794368] [INFO ] [REMOTE ] CLF: Full fetch complete (77419 records). [2025-10-08T18:04:14.794498] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-08T18:04:14.795420] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:04:14.795534] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:04:14.795609] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:04:14.795729] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-08T18:04:14.795805] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-08T18:04:14.795841] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-10-08T18:04:14.796057] [DEBUG] [LOCAL ] CLF: Deleted derivative data file. [2025-10-08T18:04:14.796158] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLF took 46.6s. Estimated remaining: 4h 22m 23s. Rate: 7.3 symbols/min [2025-10-08T18:04:14.969941] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:15.023477] [DEBUG] [LOCAL ] CLX: Loaded 51546 existing records from primary storage. [2025-10-08T18:04:15.023844] [INFO ] [MAIN ] CLX: Loaded 51546 existing records. [2025-10-08T18:04:15.219676] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-08T18:04:15.224419] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:15.225671] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-08T18:04:15.225807] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-08T18:04:15.226445] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-08T18:04:15.226741] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-08T18:04:15.363148] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T18:04:15.700365] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:15.701609] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T18:04:16.017574] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-08T18:04:16.817537] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-08T18:04:17.617720] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-08T18:04:17.773925] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T18:04:17.836625] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-08T18:04:18.417634] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-08T18:04:18.614614] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T18:04:18.660918] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T18:04:19.217603] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-08T18:04:19.944298] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T18:04:20.017594] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-08T18:04:20.817615] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-08T18:04:21.617577] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-08T18:04:21.736441] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:04:22.007869] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T18:04:22.078468] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-08T18:04:22.417558] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-08T18:04:23.217595] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-08T18:04:23.339770] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:04:23.823498] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T18:04:23.849029] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T18:04:24.017554] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-08T18:04:24.817723] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-08T18:04:25.617525] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-08T18:04:25.715199] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T18:04:26.417616] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-08T18:04:26.897709] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T18:04:27.202523] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-08T18:04:27.207363] [INFO ] [REMOTE ] CLS: Full fetch complete (77087 records). [2025-10-08T18:04:27.207601] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-08T18:04:27.209629] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:04:27.209891] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:04:27.209962] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:04:27.210042] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-08T18:04:27.210115] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-08T18:04:27.210154] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-10-08T18:04:27.210194] [DEBUG] [LOCAL ] CLS: No derivative data file found to delete. [2025-10-08T18:04:27.210268] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLS took 42.2s. Estimated remaining: 4h 22m 31s. Rate: 7.3 symbols/min [2025-10-08T18:04:27.223400] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-08T18:04:27.383852] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:27.384061] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-10-08T18:04:27.384117] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-10-08T18:04:27.384235] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-08T18:04:27.384277] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-08T18:04:27.384319] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-10-08T18:04:27.384352] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-08T18:04:27.777450] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:27.809527] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T18:04:28.017564] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-08T18:04:28.375249] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T18:04:28.817632] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-08T18:04:29.622786] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-08T18:04:29.638479] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:04:29.980421] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T18:04:30.417580] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-08T18:04:31.217631] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-08T18:04:31.395018] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T18:04:32.017603] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-08T18:04:32.235754] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:04:32.267356] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T18:04:32.269665] [INFO ] [REMOTE ] CLW: Full fetch complete (34532 records). [2025-10-08T18:04:32.269816] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-08T18:04:32.721306] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-08T18:04:32.721411] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-08T18:04:32.721980] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-08T18:04:32.722045] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-08T18:04:32.723057] [DEBUG] [LOCAL ] CLW: Trimmed 34532 records to 21669 (keeping 200 days of data) [2025-10-08T18:04:32.822369] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-08T18:04:32.874182] [DEBUG] [LOCAL ] CLW: Primary data saved (21669 records). [2025-10-08T18:04:32.874358] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-08T18:04:32.874460] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLW took 27.8s. Estimated remaining: 4h 22m 12s. Rate: 7.3 symbols/min [2025-10-08T18:04:33.052385] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:33.101813] [DEBUG] [LOCAL ] CMA: Loaded 49900 existing records from primary storage. [2025-10-08T18:04:33.102184] [INFO ] [MAIN ] CMA: Loaded 49900 existing records. [2025-10-08T18:04:33.281442] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:33.281708] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-08T18:04:33.281766] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-08T18:04:33.282065] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-08T18:04:33.282124] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-08T18:04:33.620630] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-08T18:04:33.700629] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:33.824986] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T18:04:34.417525] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-08T18:04:34.575396] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T18:04:35.217573] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-08T18:04:35.433902] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T18:04:36.017572] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-08T18:04:36.151907] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:04:36.817534] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-08T18:04:36.939771] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T18:04:37.338346] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T18:04:37.342312] [INFO ] [REMOTE ] CLVT: Full fetch complete (75223 records). [2025-10-08T18:04:37.342453] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-08T18:04:37.622784] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-08T18:04:37.737220] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-08T18:04:37.737315] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-08T18:04:37.738168] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-08T18:04:37.738243] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-08T18:04:37.739965] [DEBUG] [LOCAL ] CLVT: Trimmed 75223 records to 51982 (keeping 200 days of data) [2025-10-08T18:04:38.054501] [DEBUG] [LOCAL ] CLVT: Primary data saved (51982 records). [2025-10-08T18:04:38.054702] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-08T18:04:38.054812] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLVT took 38.7s. Estimated remaining: 4h 21m 52s. Rate: 7.3 symbols/min [2025-10-08T18:04:38.313504] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:38.346090] [DEBUG] [LOCAL ] CMBT: Loaded 24479 existing records from primary storage. [2025-10-08T18:04:38.346483] [INFO ] [MAIN ] CMBT: Loaded 24479 existing records. [2025-10-08T18:04:38.421538] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-08T18:04:38.638012] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:04:38.732306] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:38.732626] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-08T18:04:38.732733] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-08T18:04:38.733145] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-08T18:04:38.733221] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-08T18:04:39.233340] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-08T18:04:39.248181] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:39.292973] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T18:04:40.017524] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-08T18:04:40.206293] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T18:04:40.682839] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T18:04:40.817560] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-08T18:04:41.388357] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T18:04:41.617588] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-08T18:04:42.417525] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-08T18:04:42.685105] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T18:04:42.690830] [INFO ] [REMOTE ] CLX: Full fetch complete (73227 records). [2025-10-08T18:04:42.691056] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-08T18:04:43.118634] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-08T18:04:43.118793] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-08T18:04:43.119962] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-08T18:04:43.120033] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-08T18:04:43.121700] [DEBUG] [LOCAL ] CLX: Trimmed 73227 records to 51594 (keeping 200 days of data) [2025-10-08T18:04:43.218224] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-08T18:04:43.415554] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:04:43.543749] [DEBUG] [LOCAL ] CLX: Primary data saved (51594 records). [2025-10-08T18:04:43.543912] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-08T18:04:43.543999] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLX took 28.7s. Estimated remaining: 4h 21m 32s. Rate: 7.3 symbols/min [2025-10-08T18:04:43.711784] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:43.757851] [DEBUG] [LOCAL ] CMC: Loaded 45441 existing records from primary storage. [2025-10-08T18:04:43.758221] [INFO ] [MAIN ] CMC: Loaded 45441 existing records. [2025-10-08T18:04:43.947694] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:43.948129] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-08T18:04:43.948198] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-08T18:04:43.948482] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-08T18:04:43.948559] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-08T18:04:44.022444] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-08T18:04:44.313067] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:44.348269] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T18:04:44.541056] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:04:44.817603] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-08T18:04:45.617698] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-08T18:04:45.863046] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T18:04:45.859187] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T18:04:46.417574] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-08T18:04:47.190325] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T18:04:47.217582] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-08T18:04:47.662427] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T18:04:48.017610] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-08T18:04:48.436181] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T18:04:48.817617] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-08T18:04:49.617580] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-08T18:04:49.697332] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:04:49.736061] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:04:50.417598] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-08T18:04:51.217535] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-08T18:04:51.278607] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T18:04:51.563339] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T18:04:52.017543] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-08T18:04:52.227625] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T18:04:52.817608] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-08T18:04:53.500469] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T18:04:53.617633] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-08T18:04:54.417570] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-08T18:04:54.591591] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T18:04:54.790563] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T18:04:55.217569] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-08T18:04:55.814769] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T18:04:56.017547] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-08T18:04:56.817538] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-08T18:04:57.109570] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T18:04:57.154284] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T18:04:57.617571] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-08T18:04:58.417572] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-08T18:04:58.609801] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:04:58.650681] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:04:59.217633] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-08T18:04:59.956674] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:05:00.017529] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-08T18:05:00.817519] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-08T18:05:01.015530] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T18:05:01.617531] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-08T18:05:01.687716] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T18:05:02.417558] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-08T18:05:03.208879] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-08T18:05:03.223139] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-08T18:05:03.239671] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T18:05:03.243791] [INFO ] [REMOTE ] CM: Full fetch complete (69563 records). [2025-10-08T18:05:03.243960] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-08T18:05:03.654554] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:05:03.695002] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-08T18:05:03.695083] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-08T18:05:03.695851] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-08T18:05:03.695915] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-08T18:05:03.697893] [DEBUG] [LOCAL ] CM: Trimmed 69563 records to 48747 (keeping 200 days of data) [2025-10-08T18:05:03.993343] [DEBUG] [LOCAL ] CM: Primary data saved (48747 records). [2025-10-08T18:05:03.993476] [INFO ] [MAIN ] CM: Full history saved. [2025-10-08T18:05:03.993551] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CM took 36.8s. Estimated remaining: 4h 22m 13s. Rate: 7.2 symbols/min [2025-10-08T18:05:04.022719] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-08T18:05:04.162299] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:04.168121] [DEBUG] [LOCAL ] CMCM: Loaded 4731 existing records from primary storage. [2025-10-08T18:05:04.168295] [INFO ] [MAIN ] CMCM: Loaded 4731 existing records. [2025-10-08T18:05:04.342618] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:04.342880] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-08T18:05:04.342940] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-08T18:05:04.343258] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-08T18:05:04.343316] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-08T18:05:04.698128] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:04.817521] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-08T18:05:04.958231] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:05:05.617543] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-08T18:05:05.683793] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T18:05:06.381119] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:05:06.417511] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-08T18:05:06.495046] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:05:07.217606] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-08T18:05:07.872752] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T18:05:08.017495] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-08T18:05:08.058788] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:05:08.817713] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-08T18:05:09.486942] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T18:05:09.617521] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-08T18:05:09.972922] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-08T18:05:10.417562] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-08T18:05:10.981579] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T18:05:11.001674] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T18:05:11.217566] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-08T18:05:11.704622] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T18:05:12.017556] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-08T18:05:12.466322] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T18:05:12.817614] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-08T18:05:13.389132] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T18:05:13.617598] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-08T18:05:14.417622] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-08T18:05:15.044388] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T18:05:15.204462] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:05:15.208119] [INFO ] [REMOTE ] CMBT: Full fetch complete (31356 records). [2025-10-08T18:05:15.208202] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-08T18:05:15.222767] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-08T18:05:15.584088] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-08T18:05:15.584175] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-08T18:05:15.584704] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-08T18:05:15.584774] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-08T18:05:15.586038] [DEBUG] [LOCAL ] CMBT: Trimmed 31356 records to 24761 (keeping 200 days of data) [2025-10-08T18:05:15.733458] [DEBUG] [LOCAL ] CMBT: Primary data saved (24761 records). [2025-10-08T18:05:15.733593] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-08T18:05:15.733816] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 37.7s. Estimated remaining: 4h 22m 19s. Rate: 7.2 symbols/min [2025-10-08T18:05:15.901600] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:15.901823] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-08T18:05:15.901865] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-08T18:05:15.901983] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-08T18:05:15.902024] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-08T18:05:15.902065] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-08T18:05:15.902096] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-08T18:05:16.022726] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-08T18:05:16.258026] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:16.817567] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-08T18:05:17.036631] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T18:05:17.066704] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T18:05:17.617626] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-08T18:05:18.364414] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T18:05:18.417499] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-08T18:05:19.087918] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:05:19.091752] [INFO ] [REMOTE ] CMA: Full fetch complete (73112 records). [2025-10-08T18:05:19.091883] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-08T18:05:19.229742] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-08T18:05:19.525304] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-08T18:05:19.525447] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-08T18:05:19.526289] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-08T18:05:19.526351] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-08T18:05:19.527767] [DEBUG] [LOCAL ] CMA: Trimmed 73112 records to 49919 (keeping 200 days of data) [2025-10-08T18:05:19.842885] [DEBUG] [LOCAL ] CMA: Primary data saved (49919 records). [2025-10-08T18:05:19.843023] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-08T18:05:19.843110] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMA took 47.0s. Estimated remaining: 4h 21m 54s. Rate: 7.2 symbols/min [2025-10-08T18:05:19.983163] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T18:05:20.021050] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-08T18:05:20.040902] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:20.071681] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T18:05:20.126951] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-08T18:05:20.127296] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-08T18:05:20.252251] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:05:20.288004] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-08T18:05:20.307962] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:05:20.312198] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:20.312290] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-08T18:05:20.312622] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-08T18:05:20.312736] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-08T18:05:20.312562] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:05:20.312899] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-08T18:05:20.312988] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-08T18:05:20.313067] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-08T18:05:20.313164] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-08T18:05:20.313028] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-08T18:05:20.380732] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-08T18:05:20.391764] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMDB took 4.7s. Estimated remaining: 4h 21m 15s. Rate: 7.3 symbols/min [2025-10-08T18:05:20.806457] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:20.840178] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-08T18:05:20.872099] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:20.913977] [DEBUG] [LOCAL ] CMI: Loaded 41708 existing records from primary storage. [2025-10-08T18:05:20.914381] [INFO ] [MAIN ] CMI: Loaded 41708 existing records. [2025-10-08T18:05:21.133043] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:21.133290] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-08T18:05:21.133337] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-08T18:05:21.133716] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-08T18:05:21.133777] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-08T18:05:21.480598] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:21.617516] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-08T18:05:22.417513] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-08T18:05:22.504233] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T18:05:22.507827] [INFO ] [REMOTE ] CMC: Full fetch complete (66885 records). [2025-10-08T18:05:22.507951] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-08T18:05:22.907036] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-08T18:05:22.907185] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-08T18:05:22.908194] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-08T18:05:22.908324] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-08T18:05:22.909771] [DEBUG] [LOCAL ] CMC: Trimmed 66885 records to 45379 (keeping 200 days of data) [2025-10-08T18:05:23.031260] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:05:23.125965] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T18:05:23.152838] [INFO ] [REMOTE ] CMCM: Full fetch complete (6857 records). [2025-10-08T18:05:23.153199] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-08T18:05:23.222624] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-08T18:05:23.563871] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-08T18:05:23.564342] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-08T18:05:23.564558] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-08T18:05:23.565354] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-08T18:05:23.569020] [DEBUG] [LOCAL ] CMCM: Trimmed 6857 records to 4735 (keeping 200 days of data) [2025-10-08T18:05:23.601533] [DEBUG] [LOCAL ] CMCM: Primary data saved (4735 records). [2025-10-08T18:05:23.602421] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-08T18:05:23.602917] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMCM took 19.6s. Estimated remaining: 4h 20m 46s. Rate: 7.3 symbols/min [2025-10-08T18:05:23.814674] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:23.823835] [DEBUG] [LOCAL ] CMC: Primary data saved (45379 records). [2025-10-08T18:05:23.823984] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-08T18:05:23.824076] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMC took 40.3s. Estimated remaining: 4h 20m 6s. Rate: 7.3 symbols/min [2025-10-08T18:05:24.034862] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:24.036092] [DEBUG] [LOCAL ] CMP: Loaded 36085 existing records from primary storage. [2025-10-08T18:05:24.032766] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-08T18:05:24.038342] [INFO ] [MAIN ] CMP: Loaded 36085 existing records. [2025-10-08T18:05:24.262965] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:24.277200] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-08T18:05:24.277303] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-08T18:05:24.278191] [DEBUG] [LOCAL ] CMPO: Loaded 39033 existing records from primary storage. [2025-10-08T18:05:24.278699] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-08T18:05:24.278800] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-08T18:05:24.278639] [INFO ] [MAIN ] CMPO: Loaded 39033 existing records. [2025-10-08T18:05:24.726202] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:24.742050] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-08T18:05:24.748739] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-08T18:05:24.774798] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-08T18:05:24.775087] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-08T18:05:25.003023] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:25.019246] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-08T18:05:25.220593] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-08T18:05:25.304085] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:25.617583] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-08T18:05:26.279391] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-08T18:05:26.417621] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-08T18:05:26.555979] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:05:26.964059] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:05:27.217603] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-08T18:05:28.017598] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-08T18:05:28.307270] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T18:05:28.817514] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-08T18:05:29.002935] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T18:05:29.264794] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T18:05:29.617551] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-08T18:05:30.417573] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-08T18:05:30.878585] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T18:05:30.978639] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T18:05:31.217690] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-08T18:05:32.017620] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-08T18:05:32.153269] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T18:05:32.603706] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T18:05:32.817555] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-08T18:05:33.617621] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-08T18:05:34.180581] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:05:34.279583] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-08T18:05:34.417589] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-08T18:05:34.976939] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T18:05:35.217619] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-08T18:05:36.017589] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-08T18:05:36.543786] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:05:36.709902] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-08T18:05:36.817595] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-08T18:05:37.405193] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:05:37.617586] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-08T18:05:38.256776] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:05:38.417594] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-08T18:05:39.217587] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-08T18:05:39.242177] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T18:05:39.744500] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:05:40.017562] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-08T18:05:40.565994] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T18:05:40.817600] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-08T18:05:41.617591] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-08T18:05:42.417724] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-08T18:05:42.812721] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-08T18:05:43.059045] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-08T18:05:43.155405] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:05:43.217548] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-08T18:05:43.881298] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T18:05:44.017578] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-08T18:05:44.633874] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T18:05:44.817546] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-08T18:05:45.617591] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-08T18:05:46.077956] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-08T18:05:46.297157] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:05:46.417598] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-08T18:05:47.071752] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T18:05:47.217524] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-08T18:05:48.018068] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-08T18:05:48.017987] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T18:05:48.817603] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-08T18:05:49.280903] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T18:05:49.555549] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T18:05:49.617565] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-08T18:05:50.002000] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T18:05:50.417564] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-08T18:05:50.920127] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T18:05:50.924125] [INFO ] [REMOTE ] CMI: Full fetch complete (60182 records). [2025-10-08T18:05:50.924308] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-08T18:05:51.222741] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-08T18:05:51.368361] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-08T18:05:51.368453] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-08T18:05:51.369196] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-08T18:05:51.369261] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-08T18:05:51.370439] [DEBUG] [LOCAL ] CMI: Trimmed 60182 records to 41656 (keeping 200 days of data) [2025-10-08T18:05:51.638248] [DEBUG] [LOCAL ] CMI: Primary data saved (41656 records). [2025-10-08T18:05:51.638388] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-08T18:05:51.638485] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMI took 31.2s. Estimated remaining: 4h 21m 15s. Rate: 7.2 symbols/min [2025-10-08T18:05:51.725126] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:05:52.017568] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-08T18:05:52.817598] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-08T18:05:53.585432] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-08T18:05:53.617505] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-08T18:05:53.651484] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:05:54.215974] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T18:05:54.417547] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-08T18:05:55.217611] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-08T18:05:55.778094] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:05:55.781016] [INFO ] [REMOTE ] CMPO: Full fetch complete (58678 records). [2025-10-08T18:05:55.781119] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-08T18:05:56.191049] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-08T18:05:56.191172] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-08T18:05:56.192037] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-08T18:05:56.208138] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-08T18:05:56.243288] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-08T18:05:56.255504] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:05:56.263142] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-08T18:05:56.263709] [DEBUG] [LOCAL ] CMPO: Trimmed 58678 records to 38977 (keeping 200 days of data) [2025-10-08T18:05:56.499030] [DEBUG] [LOCAL ] CMPO: Primary data saved (38977 records). [2025-10-08T18:05:56.499174] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-08T18:05:56.499254] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMPO took 32.7s. Estimated remaining: 4h 20m 54s. Rate: 7.3 symbols/min [2025-10-08T18:05:56.817510] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-08T18:05:57.916187] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:05:57.918676] [INFO ] [REMOTE ] CMP: Full fetch complete (52018 records). [2025-10-08T18:05:57.918762] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-08T18:05:58.311836] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-08T18:05:58.311950] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-08T18:05:58.312567] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-08T18:05:58.312607] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-08T18:05:58.313678] [DEBUG] [LOCAL ] CMP: Trimmed 52018 records to 36066 (keeping 200 days of data) [2025-10-08T18:05:58.522050] [DEBUG] [LOCAL ] CMP: Primary data saved (36066 records). [2025-10-08T18:05:58.522213] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-08T18:05:58.523274] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMP took 34.9s. Estimated remaining: 4h 20m 21s. Rate: 7.3 symbols/min [2025-10-08T18:05:58.637936] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-08T18:05:58.641885] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-08T18:05:58.642000] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-08T18:05:59.026370] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-08T18:05:59.026443] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-08T18:05:59.027274] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-08T18:05:59.027337] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-08T18:05:59.028777] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-10-08T18:05:59.340292] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-10-08T18:05:59.340424] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-08T18:05:59.340505] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMG took 39.5s. Estimated remaining: 4h 19m 43s. Rate: 7.3 symbols/min [2025-10-08T18:05:59.971935] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:59.923039] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:00.025511] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:00.051518] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:00.057340] [DEBUG] [LOCAL ] CMSA: Loaded 3514 existing records from primary storage. [2025-10-08T18:06:00.059300] [INFO ] [MAIN ] CMSA: Loaded 3514 existing records. [2025-10-08T18:06:00.108326] [DEBUG] [LOCAL ] CMSC: Loaded 5021 existing records from primary storage. [2025-10-08T18:06:00.151584] [INFO ] [MAIN ] CMSC: Loaded 5021 existing records. [2025-10-08T18:06:00.324866] [DEBUG] [LOCAL ] CMRE: Loaded 35498 existing records from primary storage. [2025-10-08T18:06:00.372772] [INFO ] [MAIN ] CMRE: Loaded 35498 existing records. [2025-10-08T18:06:00.372525] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:00.430796] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-08T18:06:00.430913] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-08T18:06:00.518515] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-08T18:06:00.544836] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-08T18:06:00.618813] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:00.615426] [DEBUG] [LOCAL ] CMS: Loaded 52626 existing records from primary storage. [2025-10-08T18:06:00.674335] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-08T18:06:00.653679] [INFO ] [MAIN ] CMS: Loaded 52626 existing records. [2025-10-08T18:06:00.727916] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-08T18:06:00.813871] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-08T18:06:00.865836] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:00.892403] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-08T18:06:00.871361] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-08T18:06:00.902794] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-08T18:06:01.016910] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-08T18:06:01.084110] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-08T18:06:01.439106] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:01.462692] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-08T18:06:01.473136] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-08T18:06:01.502763] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-08T18:06:01.523785] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-08T18:06:01.741954] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:01.869174] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-08T18:06:02.147803] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:02.202764] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-08T18:06:02.316446] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:02.329100] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-08T18:06:02.440883] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:02.441208] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-08T18:06:02.782116] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T18:06:02.784111] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-08T18:06:02.934551] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T18:06:02.936389] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-08T18:06:03.142156] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-08T18:06:03.143694] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-08T18:06:03.421040] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T18:06:03.422751] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-08T18:06:03.656770] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T18:06:03.719323] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T18:06:03.774322] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T18:06:04.017491] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-08T18:06:04.107219] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-08T18:06:04.437762] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T18:06:04.817606] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-08T18:06:05.582639] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T18:06:05.617494] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-08T18:06:06.102701] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T18:06:06.417565] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-08T18:06:06.870576] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T18:06:07.217552] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-08T18:06:07.796265] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T18:06:08.017569] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-08T18:06:08.817583] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-08T18:06:09.574854] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T18:06:09.617617] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-08T18:06:09.956537] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T18:06:10.417563] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-08T18:06:11.217555] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-08T18:06:11.339033] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:06:11.809005] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T18:06:11.828806] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T18:06:12.017561] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-08T18:06:12.646452] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T18:06:12.817526] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-08T18:06:13.580292] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T18:06:13.617521] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-08T18:06:14.417556] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-08T18:06:14.879893] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-08T18:06:15.217589] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-08T18:06:15.570511] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T18:06:15.811635] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T18:06:15.812616] [INFO ] [REMOTE ] CMSC: Full fetch complete (7147 records). [2025-10-08T18:06:15.812711] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-08T18:06:16.022717] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-08T18:06:16.177082] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-08T18:06:16.177161] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-08T18:06:16.177428] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-08T18:06:16.177485] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-08T18:06:16.177925] [DEBUG] [LOCAL ] CMSC: Trimmed 7147 records to 5006 (keeping 200 days of data) [2025-10-08T18:06:16.208416] [DEBUG] [LOCAL ] CMSC: Primary data saved (5006 records). [2025-10-08T18:06:16.208530] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-08T18:06:16.208681] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSC took 16.9s. Estimated remaining: 4h 20m 9s. Rate: 7.3 symbols/min [2025-10-08T18:06:16.375133] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:16.385177] [DEBUG] [LOCAL ] CMSD: Loaded 8015 existing records from primary storage. [2025-10-08T18:06:16.385368] [INFO ] [MAIN ] CMSD: Loaded 8015 existing records. [2025-10-08T18:06:16.575083] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:16.575303] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-08T18:06:16.575362] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-08T18:06:16.575594] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-08T18:06:16.575682] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-08T18:06:16.836502] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T18:06:16.823972] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-08T18:06:16.937715] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:17.617588] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-08T18:06:18.168125] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T18:06:18.417548] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-08T18:06:18.557832] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T18:06:18.888737] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T18:06:19.217561] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-08T18:06:19.765464] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T18:06:20.017586] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-08T18:06:20.817540] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-08T18:06:20.887903] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T18:06:21.617572] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-08T18:06:22.169302] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T18:06:22.362050] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:06:22.417552] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-08T18:06:23.217623] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-08T18:06:24.017599] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-08T18:06:24.175802] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T18:06:24.210379] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T18:06:24.574121] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T18:06:24.574959] [INFO ] [REMOTE ] CMSA: Full fetch complete (5087 records). [2025-10-08T18:06:24.575029] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-08T18:06:24.822833] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-08T18:06:24.943123] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-08T18:06:24.943261] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-08T18:06:24.943450] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-08T18:06:24.943513] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-08T18:06:24.943930] [DEBUG] [LOCAL ] CMSA: Trimmed 5087 records to 3509 (keeping 200 days of data) [2025-10-08T18:06:24.966398] [DEBUG] [LOCAL ] CMSA: Primary data saved (3509 records). [2025-10-08T18:06:24.966528] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-08T18:06:24.966620] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSA took 25.6s. Estimated remaining: 4h 20m 2s. Rate: 7.3 symbols/min [2025-10-08T18:06:25.134445] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:25.172889] [DEBUG] [LOCAL ] CMTG: Loaded 36360 existing records from primary storage. [2025-10-08T18:06:25.173204] [INFO ] [MAIN ] CMTG: Loaded 36360 existing records. [2025-10-08T18:06:25.349595] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:25.349855] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-08T18:06:25.349902] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-08T18:06:25.350431] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-08T18:06:25.350489] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-08T18:06:25.622789] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-08T18:06:25.708452] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:26.417611] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-08T18:06:26.457285] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:06:27.217576] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-08T18:06:27.544374] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T18:06:27.725282] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T18:06:28.017547] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-08T18:06:28.389362] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T18:06:28.817581] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-08T18:06:29.327100] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T18:06:29.617583] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-08T18:06:30.197055] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T18:06:30.417518] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-08T18:06:30.518611] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T18:06:31.217609] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-08T18:06:31.934980] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T18:06:32.017508] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-08T18:06:32.659560] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T18:06:32.817564] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-08T18:06:33.127275] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T18:06:33.617561] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-08T18:06:34.121098] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T18:06:34.417569] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-08T18:06:34.589113] [DEBUG] [REMOTE ] CMRE: Error fetching primary data for 2025-07: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-08T18:06:34.589298] [WARN ] [REMOTE ] CMRE: No data returned for month 2025-07 [2025-10-08T18:06:34.589388] [FATAL] [REMOTE ] CMRE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:06:34.589472] [FATAL] [MAIN ] CMRE: Failed to fetch primary data. [2025-10-08T18:06:34.589544] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:06:34.589615] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-08T18:06:34.589719] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-08T18:06:34.589772] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-10-08T18:06:34.590074] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-10-08T18:06:34.590169] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMRE took 35.2s. Estimated remaining: 4h 19m 59s. Rate: 7.3 symbols/min [2025-10-08T18:06:34.819539] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:34.819873] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-08T18:06:34.819937] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-08T18:06:34.820062] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-08T18:06:34.820105] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-08T18:06:34.820146] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-08T18:06:34.820177] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-08T18:06:35.199129] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:35.217493] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-08T18:06:35.321637] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T18:06:35.829163] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T18:06:36.017554] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-08T18:06:36.548832] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T18:06:36.817536] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-08T18:06:37.617572] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-08T18:06:38.417683] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-08T18:06:38.703077] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-08T18:06:38.707622] [INFO ] [REMOTE ] CMS: Full fetch complete (75987 records). [2025-10-08T18:06:38.707805] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-08T18:06:39.218415] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-08T18:06:39.237439] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T18:06:39.267044] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-08T18:06:39.267510] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-08T18:06:39.269142] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-08T18:06:39.269290] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-08T18:06:39.301695] [DEBUG] [LOCAL ] CMS: Trimmed 75987 records to 52610 (keeping 200 days of data) [2025-10-08T18:06:39.306334] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T18:06:39.773454] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:06:39.797073] [DEBUG] [LOCAL ] CMS: Primary data saved (52610 records). [2025-10-08T18:06:39.797261] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-08T18:06:39.797371] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 40.4s. Estimated remaining: 4h 19m 39s. Rate: 7.3 symbols/min [2025-10-08T18:06:40.030966] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-08T18:06:40.035701] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:40.037324] [DEBUG] [LOCAL ] CNA: No existing data file found in primary storage. [2025-10-08T18:06:40.037391] [WARN ] [MAIN ] CNA: No existing data found, performing full refresh instead. [2025-10-08T18:06:40.037536] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-08T18:06:40.037594] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-08T18:06:40.037706] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-08T18:06:40.037775] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-08T18:06:40.405709] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:40.524057] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T18:06:40.817565] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-08T18:06:41.564445] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T18:06:41.617567] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-08T18:06:42.417553] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-08T18:06:42.515381] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T18:06:43.217605] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-08T18:06:43.789285] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:06:43.844133] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T18:06:44.017529] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-08T18:06:44.817523] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-08T18:06:45.480321] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T18:06:45.617572] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-08T18:06:45.997292] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T18:06:46.419039] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:06:46.418062] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-08T18:06:47.217547] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-08T18:06:47.771811] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:06:47.924306] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T18:06:48.017492] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-08T18:06:48.582919] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T18:06:48.817506] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-08T18:06:49.617562] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-08T18:06:50.133995] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T18:06:50.134823] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T18:06:50.417557] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-08T18:06:51.217560] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-08T18:06:51.707485] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T18:06:51.946049] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T18:06:52.017535] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-08T18:06:52.817554] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-08T18:06:53.144207] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T18:06:53.617529] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-08T18:06:53.870250] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T18:06:54.136811] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:06:54.138023] [INFO ] [REMOTE ] CMSD: Full fetch complete (12151 records). [2025-10-08T18:06:54.138113] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-08T18:06:54.422678] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-08T18:06:54.585458] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-08T18:06:54.585538] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-08T18:06:54.585865] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-08T18:06:54.585927] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-08T18:06:54.586377] [DEBUG] [LOCAL ] CMSD: Trimmed 12151 records to 8001 (keeping 200 days of data) [2025-10-08T18:06:54.635258] [DEBUG] [LOCAL ] CMSD: Primary data saved (8001 records). [2025-10-08T18:06:54.635406] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-08T18:06:54.635506] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMSD took 38.4s. Estimated remaining: 4h 19m 57s. Rate: 7.3 symbols/min [2025-10-08T18:06:54.801224] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:54.857924] [DEBUG] [LOCAL ] CNC: Loaded 53752 existing records from primary storage. [2025-10-08T18:06:54.858266] [INFO ] [MAIN ] CNC: Loaded 53752 existing records. [2025-10-08T18:06:55.037023] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:55.037315] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-08T18:06:55.037370] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-08T18:06:55.037771] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-08T18:06:55.037828] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-08T18:06:55.219155] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-08T18:06:55.400693] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:55.562845] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T18:06:56.017539] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-08T18:06:56.234144] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T18:06:56.811588] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T18:06:56.817495] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-08T18:06:57.617634] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-08T18:06:58.302960] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:06:58.416130] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T18:06:58.422589] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-08T18:06:59.216275] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:06:59.217760] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-08T18:07:00.017588] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-08T18:07:00.530695] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:07:00.817576] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-08T18:07:01.617553] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-08T18:07:01.946780] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T18:07:02.423729] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-08T18:07:02.429191] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T18:07:02.590860] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T18:07:02.593581] [INFO ] [REMOTE ] CMTG: Full fetch complete (53513 records). [2025-10-08T18:07:02.593738] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-08T18:07:02.991261] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-08T18:07:02.991370] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-08T18:07:02.992044] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-08T18:07:02.992108] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-08T18:07:02.993394] [DEBUG] [LOCAL ] CMTG: Trimmed 53513 records to 36233 (keeping 200 days of data) [2025-10-08T18:07:03.094282] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:07:03.215303] [DEBUG] [LOCAL ] CMTG: Primary data saved (36233 records). [2025-10-08T18:07:03.215467] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-08T18:07:03.215575] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 38.2s. Estimated remaining: 4h 19m 50s. Rate: 7.3 symbols/min [2025-10-08T18:07:03.227822] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-08T18:07:03.401111] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:03.413721] [DEBUG] [LOCAL ] CNF: Loaded 10538 existing records from primary storage. [2025-10-08T18:07:03.413976] [INFO ] [MAIN ] CNF: Loaded 10538 existing records. [2025-10-08T18:07:03.609089] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:03.609377] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-08T18:07:03.609443] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-08T18:07:03.609704] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-08T18:07:03.609764] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-08T18:07:03.975070] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:04.017510] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-08T18:07:04.660723] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T18:07:04.817626] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-08T18:07:05.023861] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T18:07:05.384956] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T18:07:05.385899] [INFO ] [REMOTE ] CMU: Full fetch complete (9593 records). [2025-10-08T18:07:05.385980] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-08T18:07:05.622735] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-08T18:07:05.778600] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-08T18:07:05.778713] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-08T18:07:05.779020] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-08T18:07:05.779060] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-08T18:07:05.779561] [DEBUG] [LOCAL ] CMU: Trimmed 9593 records to 6347 (keeping 200 days of data) [2025-10-08T18:07:05.819161] [DEBUG] [LOCAL ] CMU: Primary data saved (6347 records). [2025-10-08T18:07:05.819326] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-08T18:07:05.819416] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 31.2s. Estimated remaining: 4h 19m 19s. Rate: 7.3 symbols/min [2025-10-08T18:07:06.003241] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:06.061033] [DEBUG] [LOCAL ] CNH: Loaded 53551 existing records from primary storage. [2025-10-08T18:07:06.061389] [INFO ] [MAIN ] CNH: Loaded 53551 existing records. [2025-10-08T18:07:06.246109] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:06.246406] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-08T18:07:06.246454] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-08T18:07:06.246936] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-08T18:07:06.246994] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-08T18:07:06.322628] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T18:07:06.417842] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-08T18:07:06.623894] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:06.813664] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T18:07:07.217604] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-08T18:07:08.017551] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-08T18:07:08.587425] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:07:08.817562] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-08T18:07:08.910366] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T18:07:09.617581] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-08T18:07:10.417514] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-08T18:07:10.843541] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-08T18:07:11.052636] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T18:07:11.217543] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-08T18:07:11.270683] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T18:07:12.017559] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-08T18:07:12.817583] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-08T18:07:13.358525] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-08T18:07:13.471772] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T18:07:13.617554] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-08T18:07:13.977024] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-08T18:07:14.363285] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T18:07:14.417595] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-08T18:07:15.217580] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-08T18:07:15.706856] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T18:07:16.017522] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-08T18:07:16.819487] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-08T18:07:16.832116] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T18:07:16.840568] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T18:07:17.617572] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-08T18:07:18.246091] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T18:07:18.368117] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T18:07:18.417564] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-08T18:07:19.217526] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-08T18:07:19.373116] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T18:07:20.017565] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-08T18:07:20.817533] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-08T18:07:21.012002] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T18:07:21.582827] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T18:07:21.614821] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T18:07:21.616216] [INFO ] [REMOTE ] CNF: Full fetch complete (13119 records). [2025-10-08T18:07:21.616295] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-08T18:07:21.622608] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-08T18:07:22.055812] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-08T18:07:22.055912] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-08T18:07:22.056282] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-08T18:07:22.056342] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-08T18:07:22.056872] [DEBUG] [LOCAL ] CNF: Trimmed 13119 records to 10508 (keeping 200 days of data) [2025-10-08T18:07:22.116858] [DEBUG] [LOCAL ] CNF: Primary data saved (10508 records). [2025-10-08T18:07:22.117005] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-08T18:07:22.117093] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNF took 18.9s. Estimated remaining: 4h 19m 42s. Rate: 7.3 symbols/min [2025-10-08T18:07:22.283183] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:22.341452] [DEBUG] [LOCAL ] CNI: Loaded 51675 existing records from primary storage. [2025-10-08T18:07:22.341837] [INFO ] [MAIN ] CNI: Loaded 51675 existing records. [2025-10-08T18:07:22.422712] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-08T18:07:22.521167] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:22.521446] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-08T18:07:22.521576] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-08T18:07:22.521947] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-08T18:07:22.522027] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-08T18:07:22.875147] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:23.117801] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:07:23.120565] [INFO ] [REMOTE ] CNA: Full fetch complete (45682 records). [2025-10-08T18:07:23.120794] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-08T18:07:23.221924] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-08T18:07:23.510678] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-08T18:07:23.510774] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-08T18:07:23.511394] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-08T18:07:23.511436] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-08T18:07:23.512476] [DEBUG] [LOCAL ] CNA: Trimmed 45682 records to 32849 (keeping 200 days of data) [2025-10-08T18:07:23.714039] [DEBUG] [LOCAL ] CNA: Primary data saved (32849 records). [2025-10-08T18:07:23.714178] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-08T18:07:23.714269] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNA took 43.9s. Estimated remaining: 4h 19m 8s. Rate: 7.3 symbols/min [2025-10-08T18:07:23.894943] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:23.946281] [DEBUG] [LOCAL ] CNK: Loaded 52883 existing records from primary storage. [2025-10-08T18:07:23.946672] [INFO ] [MAIN ] CNK: Loaded 52883 existing records. [2025-10-08T18:07:24.023440] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-08T18:07:24.137231] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:24.137468] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-08T18:07:24.137518] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-08T18:07:24.137881] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-08T18:07:24.137942] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-08T18:07:24.515315] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:24.602748] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-08T18:07:24.817523] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-08T18:07:25.144551] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T18:07:25.617504] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-08T18:07:25.657666] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:07:26.417582] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-08T18:07:26.669493] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:07:27.202960] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T18:07:27.217497] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-08T18:07:27.985331] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:07:28.017500] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-08T18:07:28.550527] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:07:28.817598] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-08T18:07:29.611453] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:07:29.620616] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-08T18:07:30.332784] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:07:30.417554] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-08T18:07:31.217706] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-08T18:07:32.014757] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-08T18:07:32.021532] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-08T18:07:32.416634] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T18:07:32.588249] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:07:32.817574] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-08T18:07:33.484029] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T18:07:33.617621] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-08T18:07:34.417560] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-08T18:07:34.501448] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:07:35.217554] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-08T18:07:35.786466] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-08T18:07:36.017524] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-08T18:07:36.097795] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:07:36.817634] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-08T18:07:37.020618] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:07:37.617555] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-08T18:07:37.923147] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T18:07:38.417591] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-08T18:07:39.217797] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-08T18:07:39.694289] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-08T18:07:39.742431] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-08T18:07:40.017595] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-08T18:07:40.119295] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T18:07:40.817514] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-08T18:07:40.895729] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T18:07:40.900028] [INFO ] [REMOTE ] CNH: Full fetch complete (77539 records). [2025-10-08T18:07:40.900195] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-08T18:07:41.295774] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-08T18:07:41.295869] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-08T18:07:41.296710] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-08T18:07:41.296773] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-08T18:07:41.298273] [DEBUG] [LOCAL ] CNH: Trimmed 77539 records to 53551 (keeping 200 days of data) [2025-10-08T18:07:41.617623] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-08T18:07:41.631299] [DEBUG] [LOCAL ] CNH: Primary data saved (53551 records). [2025-10-08T18:07:41.631446] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-08T18:07:41.632479] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNH took 35.8s. Estimated remaining: 4h 19m 37s. Rate: 7.2 symbols/min [2025-10-08T18:07:41.800142] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:41.859239] [DEBUG] [LOCAL ] CNM: Loaded 51054 existing records from primary storage. [2025-10-08T18:07:41.859616] [INFO ] [MAIN ] CNM: Loaded 51054 existing records. [2025-10-08T18:07:42.037943] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:42.038279] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-08T18:07:42.038360] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-08T18:07:42.038963] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-08T18:07:42.039024] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-08T18:07:42.149879] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-08T18:07:42.175337] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-10-08T18:07:42.204295] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-08T18:07:42.592431] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:42.616289] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-08T18:07:42.809346] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-08T18:07:42.809430] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-08T18:07:42.810283] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-08T18:07:42.810348] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-08T18:07:42.811928] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 53755 (keeping 200 days of data) [2025-10-08T18:07:43.158784] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T18:07:43.190065] [DEBUG] [LOCAL ] CNC: Primary data saved (53755 records). [2025-10-08T18:07:43.190196] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-08T18:07:43.190277] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNC took 48.6s. Estimated remaining: 4h 19m 3s. Rate: 7.3 symbols/min [2025-10-08T18:07:43.221987] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-08T18:07:43.368875] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:43.369153] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-08T18:07:43.369304] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-08T18:07:43.369444] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-08T18:07:43.369510] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-08T18:07:43.369589] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-08T18:07:43.369638] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-08T18:07:43.529769] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-08T18:07:43.772707] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:43.966525] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:07:44.017517] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-08T18:07:44.817557] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-08T18:07:44.998386] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:07:45.617522] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-08T18:07:45.667413] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:07:46.417625] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-08T18:07:46.756363] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T18:07:46.831511] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T18:07:47.217550] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-08T18:07:48.017518] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-08T18:07:48.297110] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:07:48.817530] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-08T18:07:49.103259] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T18:07:49.366359] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T18:07:49.617547] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-08T18:07:50.417552] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-08T18:07:51.088635] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T18:07:51.182215] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-08T18:07:51.185547] [INFO ] [REMOTE ] CNI: Full fetch complete (74202 records). [2025-10-08T18:07:51.185712] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-08T18:07:51.186571] [FATAL] [VALIDATOR ] CNI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:07:51.186712] [FATAL] [MAIN ] CNI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:07:51.186789] [WARN ] [MAIN ] CNI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:07:51.186880] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-08T18:07:51.186977] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-08T18:07:51.187034] [INFO ] [LOCAL ] CNI: Starting deletion of derivative data. [2025-10-08T18:07:51.187266] [DEBUG] [LOCAL ] CNI: Deleted derivative data file. [2025-10-08T18:07:51.188036] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNI took 29.1s. Estimated remaining: 4h 18m 54s. Rate: 7.3 symbols/min [2025-10-08T18:07:51.222637] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-08T18:07:51.360188] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:51.398694] [DEBUG] [LOCAL ] CNNE: Loaded 36320 existing records from primary storage. [2025-10-08T18:07:51.399014] [INFO ] [MAIN ] CNNE: Loaded 36320 existing records. [2025-10-08T18:07:51.571708] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:51.571947] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-08T18:07:51.571993] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-08T18:07:51.572318] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-08T18:07:51.572375] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-08T18:07:51.935622] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:51.990912] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T18:07:52.017493] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-08T18:07:52.774227] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T18:07:52.817496] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-08T18:07:53.617526] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-08T18:07:53.743222] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T18:07:53.924091] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T18:07:54.417513] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-08T18:07:54.813891] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:07:55.217600] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-08T18:07:56.017548] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-08T18:07:56.110828] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T18:07:56.408292] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:07:56.817588] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-08T18:07:57.019737] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T18:07:57.617581] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-08T18:07:58.212342] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T18:07:58.417577] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-08T18:07:58.476577] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T18:07:59.217596] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-08T18:07:59.983316] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T18:08:00.017516] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-08T18:08:00.436761] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T18:08:00.817550] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-08T18:08:01.617529] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-08T18:08:01.695124] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:08:02.417597] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-08T18:08:02.562302] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T18:08:02.567209] [INFO ] [REMOTE ] CNK: Full fetch complete (75852 records). [2025-10-08T18:08:02.567383] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-08T18:08:03.102445] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:08:03.102602] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-08T18:08:03.110080] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-08T18:08:03.111761] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-08T18:08:03.111861] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-08T18:08:03.113939] [DEBUG] [LOCAL ] CNK: Trimmed 75852 records to 52888 (keeping 200 days of data) [2025-10-08T18:08:03.219215] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-08T18:08:03.443071] [DEBUG] [LOCAL ] CNK: Primary data saved (52888 records). [2025-10-08T18:08:03.443239] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-08T18:08:03.443326] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNK took 39.7s. Estimated remaining: 4h 19m 1s. Rate: 7.3 symbols/min [2025-10-08T18:08:03.614735] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:03.653257] [DEBUG] [LOCAL ] CNO: Loaded 40903 existing records from primary storage. [2025-10-08T18:08:03.653583] [INFO ] [MAIN ] CNO: Loaded 40903 existing records. [2025-10-08T18:08:03.829391] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:03.829637] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-08T18:08:03.829723] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-08T18:08:03.830000] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-08T18:08:03.830058] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-08T18:08:04.037871] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-08T18:08:04.190661] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:04.219601] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:08:04.536611] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T18:08:04.817568] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-08T18:08:05.617525] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-08T18:08:05.652918] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T18:08:05.861715] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T18:08:06.417574] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-08T18:08:06.778689] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T18:08:07.217562] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-08T18:08:08.017713] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-08T18:08:08.075615] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:08:08.193424] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:08:08.817576] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-08T18:08:09.162138] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T18:08:09.617576] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-08T18:08:10.338784] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T18:08:10.417592] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-08T18:08:10.667700] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T18:08:10.670711] [INFO ] [REMOTE ] CNMD: Full fetch complete (47219 records). [2025-10-08T18:08:10.670840] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-08T18:08:11.157137] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-08T18:08:11.157244] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-08T18:08:11.158085] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-08T18:08:11.158173] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-08T18:08:11.159342] [DEBUG] [LOCAL ] CNMD: Trimmed 47219 records to 32106 (keeping 200 days of data) [2025-10-08T18:08:11.219267] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-08T18:08:11.380690] [DEBUG] [LOCAL ] CNMD: Primary data saved (32106 records). [2025-10-08T18:08:11.380837] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-08T18:08:11.380918] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNMD took 28.2s. Estimated remaining: 4h 18m 51s. Rate: 7.3 symbols/min [2025-10-08T18:08:11.605452] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:11.661195] [DEBUG] [LOCAL ] CNP: Loaded 53475 existing records from primary storage. [2025-10-08T18:08:11.661583] [INFO ] [MAIN ] CNP: Loaded 53475 existing records. [2025-10-08T18:08:11.857031] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:11.857278] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-08T18:08:11.857363] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-08T18:08:11.857711] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-08T18:08:11.857769] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-08T18:08:12.032144] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-08T18:08:12.222437] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:12.411081] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-08T18:08:12.817570] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-08T18:08:13.106690] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T18:08:13.617587] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-08T18:08:13.680048] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:08:14.374129] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T18:08:14.417639] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-08T18:08:15.081848] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T18:08:15.086048] [INFO ] [REMOTE ] CNM: Full fetch complete (73618 records). [2025-10-08T18:08:15.086179] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-08T18:08:15.223854] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-08T18:08:15.483087] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-08T18:08:15.483187] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-08T18:08:15.484061] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-08T18:08:15.484143] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-08T18:08:15.485783] [DEBUG] [LOCAL ] CNM: Trimmed 73618 records to 51046 (keeping 200 days of data) [2025-10-08T18:08:15.799001] [DEBUG] [LOCAL ] CNM: Primary data saved (51046 records). [2025-10-08T18:08:15.799293] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-08T18:08:15.799978] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNM took 34.2s. Estimated remaining: 4h 18m 28s. Rate: 7.3 symbols/min [2025-10-08T18:08:15.974686] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:16.027365] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-08T18:08:16.030793] [DEBUG] [LOCAL ] CNQ: Loaded 53577 existing records from primary storage. [2025-10-08T18:08:16.031247] [INFO ] [MAIN ] CNQ: Loaded 53577 existing records. [2025-10-08T18:08:16.152118] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T18:08:16.247808] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:16.248088] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-08T18:08:16.248136] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-08T18:08:16.248488] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-08T18:08:16.248570] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-08T18:08:16.610245] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:16.687506] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:08:16.817559] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-08T18:08:17.617582] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-08T18:08:17.907853] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T18:08:18.417595] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-08T18:08:18.564439] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T18:08:18.991992] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T18:08:19.217552] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-08T18:08:19.742167] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:08:20.017592] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-08T18:08:20.817538] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-08T18:08:20.903330] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T18:08:21.159279] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T18:08:21.617596] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-08T18:08:22.199417] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T18:08:22.417610] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-08T18:08:23.076372] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:08:23.217718] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-08T18:08:23.969264] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T18:08:24.017699] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-08T18:08:24.710316] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T18:08:24.817604] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-08T18:08:25.210697] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T18:08:25.617566] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-08T18:08:26.050524] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T18:08:26.417605] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-08T18:08:27.100009] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T18:08:27.217538] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-08T18:08:27.965742] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T18:08:28.017540] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-08T18:08:28.501634] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:08:28.504817] [INFO ] [REMOTE ] CNNE: Full fetch complete (50239 records). [2025-10-08T18:08:28.504955] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-08T18:08:28.822623] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-08T18:08:28.903496] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-08T18:08:28.903576] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-08T18:08:28.904191] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-08T18:08:28.904254] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-08T18:08:28.905317] [DEBUG] [LOCAL ] CNNE: Trimmed 50239 records to 36255 (keeping 200 days of data) [2025-10-08T18:08:29.124672] [DEBUG] [LOCAL ] CNNE: Primary data saved (36255 records). [2025-10-08T18:08:29.124813] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-08T18:08:29.125424] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 37.9s. Estimated remaining: 4h 18m 39s. Rate: 7.2 symbols/min [2025-10-08T18:08:29.300989] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:29.301149] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-08T18:08:29.301193] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-08T18:08:29.301325] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-08T18:08:29.301383] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-08T18:08:29.301430] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-08T18:08:29.301463] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-08T18:08:29.622730] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-08T18:08:29.678954] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:29.833241] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T18:08:30.196252] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T18:08:30.417583] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-08T18:08:31.217552] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-08T18:08:31.451795] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:08:31.452156] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-08T18:08:31.452249] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:08:31.452298] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-08T18:08:31.452359] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:08:31.452450] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-08T18:08:31.452516] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-08T18:08:31.452552] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-08T18:08:31.452592] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-08T18:08:31.452661] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNR took 2.3s. Estimated remaining: 4h 18m 8s. Rate: 7.3 symbols/min [2025-10-08T18:08:31.661390] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T18:08:31.665207] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:31.676277] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-08T18:08:31.676675] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-08T18:08:31.676956] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-08T18:08:31.677011] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-08T18:08:31.677439] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-08T18:08:31.677494] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-08T18:08:32.019086] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-08T18:08:32.046692] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:32.212666] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:08:32.817565] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-08T18:08:33.615207] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:08:33.625916] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-08T18:08:34.417581] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-08T18:08:34.642319] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T18:08:34.691312] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T18:08:35.217552] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-08T18:08:35.866887] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T18:08:36.017563] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-08T18:08:36.748163] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T18:08:36.800341] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:08:36.817501] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-08T18:08:37.617580] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-08T18:08:37.844948] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:08:38.417617] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-08T18:08:38.790260] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T18:08:39.217527] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-08T18:08:39.552302] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T18:08:40.017600] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-08T18:08:40.714543] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T18:08:40.817545] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-08T18:08:41.617518] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-08T18:08:41.737918] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T18:08:42.417607] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-08T18:08:42.700714] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T18:08:43.217515] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-08T18:08:43.492912] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T18:08:43.512747] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:08:43.518770] [INFO ] [REMOTE ] CNO: Full fetch complete (60619 records). [2025-10-08T18:08:43.518942] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-08T18:08:43.951866] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-08T18:08:43.951964] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-08T18:08:43.952753] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-08T18:08:43.952819] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-08T18:08:43.954240] [DEBUG] [LOCAL ] CNO: Trimmed 60619 records to 40837 (keeping 200 days of data) [2025-10-08T18:08:44.043081] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-08T18:08:44.203393] [DEBUG] [LOCAL ] CNO: Primary data saved (40837 records). [2025-10-08T18:08:44.203525] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-08T18:08:44.203603] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNO took 40.8s. Estimated remaining: 4h 18m 17s. Rate: 7.3 symbols/min [2025-10-08T18:08:44.369366] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:44.415793] [DEBUG] [LOCAL ] CNX: Loaded 51355 existing records from primary storage. [2025-10-08T18:08:44.416136] [INFO ] [MAIN ] CNX: Loaded 51355 existing records. [2025-10-08T18:08:44.601040] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:44.601399] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-08T18:08:44.601472] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-08T18:08:44.601898] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-08T18:08:44.602081] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-08T18:08:44.820409] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-08T18:08:44.915964] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T18:08:45.000865] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:45.385049] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T18:08:45.617570] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-08T18:08:46.417511] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-08T18:08:46.636922] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T18:08:47.217511] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-08T18:08:47.533060] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T18:08:47.673955] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:08:47.678341] [INFO ] [REMOTE ] CNP: Full fetch complete (77368 records). [2025-10-08T18:08:47.678465] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-08T18:08:48.022670] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-08T18:08:48.117214] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-08T18:08:48.117309] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-08T18:08:48.118216] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-08T18:08:48.118282] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-08T18:08:48.119921] [DEBUG] [LOCAL ] CNP: Trimmed 77368 records to 53476 (keeping 200 days of data) [2025-10-08T18:08:48.465969] [DEBUG] [LOCAL ] CNP: Primary data saved (53476 records). [2025-10-08T18:08:48.466125] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-08T18:08:48.466227] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNP took 37.1s. Estimated remaining: 4h 17m 54s. Rate: 7.3 symbols/min [2025-10-08T18:08:48.643844] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:48.644006] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-10-08T18:08:48.644043] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-10-08T18:08:48.644152] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-08T18:08:48.644194] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-08T18:08:48.644236] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-08T18:08:48.644268] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-08T18:08:48.835954] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-08T18:08:49.029518] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:49.037698] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T18:08:49.068767] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T18:08:49.073983] [INFO ] [REMOTE ] CNQ: Full fetch complete (77554 records). [2025-10-08T18:08:49.074137] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-08T18:08:49.519415] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-08T18:08:49.519509] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-08T18:08:49.520428] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-08T18:08:49.520499] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-08T18:08:49.522323] [DEBUG] [LOCAL ] CNQ: Trimmed 77554 records to 53577 (keeping 200 days of data) [2025-10-08T18:08:49.617680] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-08T18:08:49.855421] [DEBUG] [LOCAL ] CNQ: Primary data saved (53577 records). [2025-10-08T18:08:49.855573] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-08T18:08:49.856352] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNQ took 34.1s. Estimated remaining: 4h 17m 20s. Rate: 7.3 symbols/min [2025-10-08T18:08:50.026236] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:50.084188] [DEBUG] [LOCAL ] COF: Loaded 53609 existing records from primary storage. [2025-10-08T18:08:50.084572] [INFO ] [MAIN ] COF: Loaded 53609 existing records. [2025-10-08T18:08:50.268024] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:50.268242] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-08T18:08:50.268291] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-08T18:08:50.268523] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-08T18:08:50.268601] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-08T18:08:50.426910] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-08T18:08:50.635474] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:50.667031] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:08:51.013454] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T18:08:51.217507] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-08T18:08:51.285827] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T18:08:52.017590] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-08T18:08:52.350683] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T18:08:52.817570] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-08T18:08:53.617518] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-08T18:08:54.078929] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-08T18:08:54.102414] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T18:08:54.417605] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-08T18:08:54.937352] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:08:55.217516] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-08T18:08:55.375773] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:08:56.017568] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-08T18:08:56.278904] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T18:08:56.817597] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-08T18:08:57.603480] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:08:57.617517] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-08T18:08:57.830815] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:08:58.417625] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-08T18:08:58.677110] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T18:08:59.217569] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-08T18:09:00.017607] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-08T18:09:00.245689] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T18:09:00.486402] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T18:09:00.488790] [INFO ] [REMOTE ] CNS: Full fetch complete (30359 records). [2025-10-08T18:09:00.488925] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-08T18:09:00.822628] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-08T18:09:00.887784] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-08T18:09:00.887871] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-08T18:09:00.888351] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-08T18:09:00.888392] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-08T18:09:00.889289] [DEBUG] [LOCAL ] CNS: Trimmed 30359 records to 20802 (keeping 200 days of data) [2025-10-08T18:09:01.027910] [DEBUG] [LOCAL ] CNS: Primary data saved (20802 records). [2025-10-08T18:09:01.028038] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-08T18:09:01.028135] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNS took 29.6s. Estimated remaining: 4h 17m 22s. Rate: 7.3 symbols/min [2025-10-08T18:09:01.208240] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:01.275120] [DEBUG] [LOCAL ] COHR: Loaded 53365 existing records from primary storage. [2025-10-08T18:09:01.275577] [INFO ] [MAIN ] COHR: Loaded 53365 existing records. [2025-10-08T18:09:01.466739] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:01.467102] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-08T18:09:01.467166] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-08T18:09:01.467465] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-08T18:09:01.467521] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-08T18:09:01.627299] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-08T18:09:01.896580] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:01.906930] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T18:09:02.422743] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-08T18:09:02.437410] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:09:03.092070] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T18:09:03.217533] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-08T18:09:04.017531] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-08T18:09:04.105252] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T18:09:04.817533] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-08T18:09:04.929008] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:09:05.617520] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-08T18:09:05.852820] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-08T18:09:06.296349] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:09:06.417566] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-08T18:09:07.063596] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T18:09:07.217605] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-08T18:09:08.017515] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-08T18:09:08.058001] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T18:09:08.817564] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-08T18:09:09.581831] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-08T18:09:09.617507] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-08T18:09:09.944827] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T18:09:10.185278] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:09:10.417589] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-08T18:09:11.217581] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-08T18:09:11.610714] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-08T18:09:12.017624] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-08T18:09:12.550969] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T18:09:12.751589] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-08T18:09:12.817512] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-08T18:09:13.617575] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-08T18:09:13.781249] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:09:14.417566] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-08T18:09:14.497028] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T18:09:14.857072] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T18:09:14.860593] [INFO ] [REMOTE ] CNX: Full fetch complete (74377 records). [2025-10-08T18:09:14.860790] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-08T18:09:14.861945] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:09:14.862080] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:09:14.862123] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:09:14.862163] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-08T18:09:14.862249] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-08T18:09:14.862303] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-10-08T18:09:14.862498] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-10-08T18:09:14.862608] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNX took 30.7s. Estimated remaining: 4h 17m 35s. Rate: 7.3 symbols/min [2025-10-08T18:09:15.040931] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:15.041130] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-10-08T18:09:15.041168] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-10-08T18:09:15.041282] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-08T18:09:15.041323] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-08T18:09:15.041366] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-08T18:09:15.041397] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-08T18:09:15.227106] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-08T18:09:15.431282] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:15.659985] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:09:16.017542] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-08T18:09:16.817636] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-08T18:09:17.275391] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-08T18:09:17.617579] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-08T18:09:17.760474] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T18:09:18.380354] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T18:09:18.417526] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-08T18:09:19.217603] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-08T18:09:19.586987] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T18:09:19.716364] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T18:09:19.719588] [INFO ] [REMOTE ] CODI: Full fetch complete (51521 records). [2025-10-08T18:09:19.719743] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-08T18:09:20.022844] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-08T18:09:20.111308] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-08T18:09:20.111400] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-08T18:09:20.112105] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-08T18:09:20.112167] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-08T18:09:20.113315] [DEBUG] [LOCAL ] CODI: Trimmed 51521 records to 40636 (keeping 200 days of data) [2025-10-08T18:09:20.350444] [DEBUG] [LOCAL ] CODI: Primary data saved (40636 records). [2025-10-08T18:09:20.350590] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-08T18:09:20.350696] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CODI took 31.9s. Estimated remaining: 4h 17m 16s. Rate: 7.3 symbols/min [2025-10-08T18:09:20.526167] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:20.568825] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T18:09:20.615232] [DEBUG] [LOCAL ] COMP: Loaded 53401 existing records from primary storage. [2025-10-08T18:09:20.615588] [INFO ] [MAIN ] COMP: Loaded 53401 existing records. [2025-10-08T18:09:20.804554] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:20.804948] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-08T18:09:20.805018] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-08T18:09:20.805307] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-08T18:09:20.805365] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-08T18:09:20.826225] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-08T18:09:21.168400] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:21.617525] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-08T18:09:21.987295] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T18:09:22.417570] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-08T18:09:22.960908] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-08T18:09:23.014251] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:09:23.217580] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-08T18:09:24.017627] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-08T18:09:24.817618] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-08T18:09:24.899959] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-08T18:09:24.960860] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T18:09:25.617554] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-08T18:09:25.865427] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:09:26.417560] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-08T18:09:27.020559] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-08T18:09:27.217574] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-08T18:09:27.273937] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:09:27.864071] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:09:28.017559] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-08T18:09:28.818082] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-08T18:09:29.357771] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-08T18:09:29.617542] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-08T18:09:29.746381] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T18:09:30.415971] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T18:09:30.426176] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-08T18:09:31.217517] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-08T18:09:31.259367] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T18:09:32.017525] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-08T18:09:32.159474] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T18:09:32.817519] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-08T18:09:32.885684] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T18:09:33.617514] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-08T18:09:33.896102] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T18:09:34.417543] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-08T18:09:34.873719] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T18:09:35.217513] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-08T18:09:35.351635] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T18:09:35.356761] [INFO ] [REMOTE ] COF: Full fetch complete (77446 records). [2025-10-08T18:09:35.356941] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-08T18:09:35.847315] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-08T18:09:35.847419] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-08T18:09:35.848420] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-08T18:09:35.848568] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-08T18:09:35.850337] [DEBUG] [LOCAL ] COF: Trimmed 77446 records to 53612 (keeping 200 days of data) [2025-10-08T18:09:36.016485] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:09:36.019131] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-08T18:09:36.246243] [DEBUG] [LOCAL ] COF: Primary data saved (53612 records). [2025-10-08T18:09:36.246412] [INFO ] [MAIN ] COF: Full history saved. [2025-10-08T18:09:36.247249] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 46.4s. Estimated remaining: 4h 17m 36s. Rate: 7.2 symbols/min [2025-10-08T18:09:36.416468] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:36.455622] [DEBUG] [LOCAL ] CON: Loaded 38863 existing records from primary storage. [2025-10-08T18:09:36.455969] [INFO ] [MAIN ] CON: Loaded 38863 existing records. [2025-10-08T18:09:36.631334] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:36.631555] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-08T18:09:36.631605] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-08T18:09:36.631879] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-08T18:09:36.631939] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-08T18:09:36.843301] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-08T18:09:37.005055] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:37.303965] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-08T18:09:37.308070] [INFO ] [REMOTE ] COHR: Full fetch complete (77174 records). [2025-10-08T18:09:37.308188] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-08T18:09:37.618966] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-08T18:09:37.701086] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-08T18:09:37.701268] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-08T18:09:37.702207] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-08T18:09:37.702293] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-08T18:09:37.704097] [DEBUG] [LOCAL ] COHR: Trimmed 77174 records to 53371 (keeping 200 days of data) [2025-10-08T18:09:37.823357] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T18:09:38.062521] [DEBUG] [LOCAL ] COHR: Primary data saved (53371 records). [2025-10-08T18:09:38.062735] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-08T18:09:38.063913] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COHR took 37.0s. Estimated remaining: 4h 17m 4s. Rate: 7.3 symbols/min [2025-10-08T18:09:38.244618] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:38.274340] [DEBUG] [LOCAL ] COOK: Loaded 24428 existing records from primary storage. [2025-10-08T18:09:38.274736] [INFO ] [MAIN ] COOK: Loaded 24428 existing records. [2025-10-08T18:09:38.422636] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-08T18:09:38.506558] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:38.507445] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-08T18:09:38.507497] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-08T18:09:38.507788] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-08T18:09:38.507853] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-08T18:09:38.913973] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-08T18:09:38.994505] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:39.217513] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-08T18:09:39.244303] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:09:40.022595] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-08T18:09:40.029107] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T18:09:40.603915] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T18:09:40.817555] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-08T18:09:41.184436] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T18:09:41.617601] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-08T18:09:42.417553] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-08T18:09:42.640200] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:09:43.022212] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:09:43.217520] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-08T18:09:44.017606] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-08T18:09:44.129379] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:09:44.817563] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-08T18:09:45.002053] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T18:09:45.112637] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T18:09:45.617538] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-08T18:09:46.417510] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-08T18:09:46.523984] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:09:46.650465] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T18:09:47.217596] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-08T18:09:48.009315] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:09:48.013909] [INFO ] [REMOTE ] COLD: Full fetch complete (74456 records). [2025-10-08T18:09:48.014107] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-08T18:09:48.027465] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-08T18:09:48.297690] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T18:09:48.463131] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-08T18:09:48.463224] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-08T18:09:48.464088] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-08T18:09:48.464163] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-08T18:09:48.465796] [DEBUG] [LOCAL ] COLD: Trimmed 74456 records to 52250 (keeping 200 days of data) [2025-10-08T18:09:48.795134] [DEBUG] [LOCAL ] COLD: Primary data saved (52250 records). [2025-10-08T18:09:48.795299] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-08T18:09:48.795380] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COLD took 33.9s. Estimated remaining: 4h 17m 5s. Rate: 7.3 symbols/min [2025-10-08T18:09:48.824195] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-08T18:09:48.986235] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:49.043725] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-08T18:09:49.044142] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-08T18:09:49.324280] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:49.324552] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-08T18:09:49.324604] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-08T18:09:49.324945] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-08T18:09:49.325004] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-08T18:09:49.619866] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-08T18:09:49.702747] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:49.713358] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T18:09:49.809897] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T18:09:50.417611] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-08T18:09:51.124071] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T18:09:51.217510] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-08T18:09:51.603936] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T18:09:52.017552] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-08T18:09:52.702518] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:09:52.817552] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-08T18:09:53.060409] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T18:09:53.617600] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-08T18:09:54.417586] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-08T18:09:54.529860] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T18:09:54.556428] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T18:09:55.217609] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-08T18:09:55.970724] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T18:09:56.017528] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-08T18:09:56.817534] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-08T18:09:57.366941] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-08T18:09:57.513396] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T18:09:57.617565] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-08T18:09:57.898760] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T18:09:58.417521] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-08T18:09:59.217518] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-08T18:09:59.312467] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:09:59.591430] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T18:10:00.017579] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-08T18:10:00.817710] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-08T18:10:01.046974] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-08T18:10:01.050576] [INFO ] [REMOTE ] COMP: Full fetch complete (76806 records). [2025-10-08T18:10:01.050723] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-08T18:10:01.051535] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:01.051631] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:01.051725] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:01.051770] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-08T18:10:01.051860] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-08T18:10:01.051915] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-10-08T18:10:01.052132] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-10-08T18:10:01.052226] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COMP took 40.7s. Estimated remaining: 4h 17m 11s. Rate: 7.2 symbols/min [2025-10-08T18:10:01.229076] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:01.229292] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-10-08T18:10:01.229356] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-10-08T18:10:01.229531] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-08T18:10:01.229574] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-08T18:10:01.229616] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-08T18:10:01.229679] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-08T18:10:01.348453] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T18:10:01.611849] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:01.617493] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-08T18:10:02.058762] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T18:10:02.417586] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-08T18:10:03.217556] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-08T18:10:03.476110] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T18:10:03.731302] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:10:04.017543] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-08T18:10:04.587228] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T18:10:04.590199] [INFO ] [REMOTE ] CON: Full fetch complete (56528 records). [2025-10-08T18:10:04.590300] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-08T18:10:04.590999] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:04.591111] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:04.591155] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:04.591218] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-08T18:10:04.591311] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-08T18:10:04.591369] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-08T18:10:04.591545] [DEBUG] [LOCAL ] CON: Deleted derivative data file. [2025-10-08T18:10:04.592635] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 28.3s. Estimated remaining: 4h 16m 46s. Rate: 7.3 symbols/min [2025-10-08T18:10:04.761504] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:04.813388] [DEBUG] [LOCAL ] COTY: Loaded 53239 existing records from primary storage. [2025-10-08T18:10:04.813787] [INFO ] [MAIN ] COTY: Loaded 53239 existing records. [2025-10-08T18:10:04.824995] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-08T18:10:04.994628] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:04.994962] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-08T18:10:04.995012] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-08T18:10:04.995245] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-08T18:10:04.995302] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-08T18:10:05.117075] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:10:05.153274] [INFO ] [REMOTE ] COOK: Full fetch complete (32539 records). [2025-10-08T18:10:05.165845] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-08T18:10:05.170478] [FATAL] [VALIDATOR ] COOK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:05.187718] [FATAL] [MAIN ] COOK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:05.233014] [WARN ] [MAIN ] COOK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:05.259087] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-08T18:10:05.270073] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-08T18:10:05.289191] [INFO ] [LOCAL ] COOK: Starting deletion of derivative data. [2025-10-08T18:10:05.291982] [DEBUG] [LOCAL ] COOK: Deleted derivative data file. [2025-10-08T18:10:05.302690] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COOK took 27.2s. Estimated remaining: 4h 16m 10s. Rate: 7.3 symbols/min [2025-10-08T18:10:05.454352] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:05.549615] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:05.595026] [DEBUG] [LOCAL ] COUR: Loaded 49046 existing records from primary storage. [2025-10-08T18:10:05.595371] [INFO ] [MAIN ] COUR: Loaded 49046 existing records. [2025-10-08T18:10:05.626432] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-08T18:10:05.777729] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:05.778015] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-08T18:10:05.778085] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-08T18:10:05.778343] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-08T18:10:05.778423] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-08T18:10:06.160223] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:06.417507] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-08T18:10:06.980265] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-08T18:10:07.217562] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-08T18:10:07.601594] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T18:10:08.017582] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-08T18:10:08.455980] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T18:10:08.549592] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:10:08.817541] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-08T18:10:09.623903] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-08T18:10:09.629892] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:10:10.417540] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-08T18:10:10.479471] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T18:10:11.217530] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-08T18:10:11.373088] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T18:10:12.017512] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-08T18:10:12.119359] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T18:10:12.803678] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:10:12.817505] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-08T18:10:13.617514] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-08T18:10:13.841607] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:10:13.984435] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T18:10:14.417585] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-08T18:10:15.217572] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-08T18:10:15.681714] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T18:10:15.756089] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:10:16.017580] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-08T18:10:16.813970] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:10:16.823822] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-08T18:10:17.617575] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-08T18:10:17.842617] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T18:10:18.368931] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T18:10:18.417545] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-08T18:10:19.217532] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-08T18:10:19.673255] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T18:10:20.017608] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-08T18:10:20.386032] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T18:10:20.817522] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-08T18:10:21.106265] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T18:10:21.617551] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-08T18:10:21.731559] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:10:22.371197] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T18:10:22.417565] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-08T18:10:23.217523] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-08T18:10:23.283350] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T18:10:24.017526] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-08T18:10:24.158398] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:10:24.817505] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-08T18:10:25.013355] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T18:10:25.454787] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T18:10:25.617614] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-08T18:10:26.417627] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-08T18:10:26.512014] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T18:10:27.217563] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-08T18:10:27.376723] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T18:10:28.017633] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-08T18:10:28.183612] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:10:28.817504] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-08T18:10:29.294975] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-08T18:10:29.617563] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-08T18:10:29.848945] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:10:29.969672] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-08T18:10:29.973215] [INFO ] [REMOTE ] COP: Full fetch complete (77379 records). [2025-10-08T18:10:29.973343] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-08T18:10:29.974205] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:29.974302] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:29.974344] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:29.974383] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-08T18:10:29.974440] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-08T18:10:29.974473] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-10-08T18:10:29.974673] [DEBUG] [LOCAL ] COP: Deleted derivative data file. [2025-10-08T18:10:29.974770] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 41.2s. Estimated remaining: 4h 17m 1s. Rate: 7.2 symbols/min [2025-10-08T18:10:30.148874] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:30.202284] [DEBUG] [LOCAL ] CP: Loaded 53265 existing records from primary storage. [2025-10-08T18:10:30.202638] [INFO ] [MAIN ] CP: Loaded 53265 existing records. [2025-10-08T18:10:30.384700] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:30.385057] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-08T18:10:30.385136] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-08T18:10:30.386367] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-08T18:10:30.386432] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-08T18:10:30.417734] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-08T18:10:30.789023] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:30.785070] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T18:10:31.217578] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-08T18:10:32.018441] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-08T18:10:32.021762] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:10:32.817514] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-08T18:10:33.070176] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:10:33.617561] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-08T18:10:33.895702] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:10:34.212949] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T18:10:34.217762] [INFO ] [REMOTE ] COUR: Full fetch complete (70860 records). [2025-10-08T18:10:34.218069] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-08T18:10:34.423084] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-08T18:10:34.605700] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-08T18:10:34.605794] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-08T18:10:34.606635] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-08T18:10:34.606720] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-08T18:10:34.608213] [DEBUG] [LOCAL ] COUR: Trimmed 70860 records to 49053 (keeping 200 days of data) [2025-10-08T18:10:34.886846] [DEBUG] [LOCAL ] COUR: Primary data saved (49053 records). [2025-10-08T18:10:34.886990] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-08T18:10:34.887071] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COUR took 29.6s. Estimated remaining: 4h 16m 41s. Rate: 7.2 symbols/min [2025-10-08T18:10:35.064417] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:35.095064] [DEBUG] [LOCAL ] CPA: Loaded 28274 existing records from primary storage. [2025-10-08T18:10:35.095436] [INFO ] [MAIN ] CPA: Loaded 28274 existing records. [2025-10-08T18:10:35.222695] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-08T18:10:35.276586] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:35.276980] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-08T18:10:35.277129] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-08T18:10:35.277462] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-08T18:10:35.277528] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-08T18:10:35.414733] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T18:10:35.682545] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:35.862770] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T18:10:36.017560] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-08T18:10:36.817543] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-08T18:10:36.921373] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:10:36.924822] [INFO ] [REMOTE ] COR: Full fetch complete (68617 records). [2025-10-08T18:10:36.924999] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-08T18:10:37.316913] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-08T18:10:37.317117] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-08T18:10:37.317980] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-08T18:10:37.318085] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-08T18:10:37.320056] [DEBUG] [LOCAL ] COR: Trimmed 68617 records to 46781 (keeping 200 days of data) [2025-10-08T18:10:37.461976] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T18:10:37.617616] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-08T18:10:37.675125] [DEBUG] [LOCAL ] COR: Primary data saved (46781 records). [2025-10-08T18:10:37.675264] [INFO ] [MAIN ] COR: Full history saved. [2025-10-08T18:10:37.675359] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COR took 36.6s. Estimated remaining: 4h 16m 13s. Rate: 7.3 symbols/min [2025-10-08T18:10:37.854270] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:37.854473] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-08T18:10:37.854518] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-08T18:10:37.854660] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-08T18:10:37.854717] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-08T18:10:37.854765] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-08T18:10:37.854797] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-08T18:10:38.202695] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:38.417513] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-08T18:10:38.494172] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:10:39.092392] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T18:10:39.206497] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T18:10:39.217603] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-08T18:10:39.563166] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T18:10:40.017626] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-08T18:10:40.817528] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-08T18:10:41.152066] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T18:10:41.617533] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-08T18:10:41.876106] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T18:10:42.417553] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-08T18:10:43.217515] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-08T18:10:43.408708] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T18:10:43.486019] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:10:43.570965] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-08T18:10:44.017544] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-08T18:10:44.817512] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-08T18:10:45.210387] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T18:10:45.507838] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:10:45.617508] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-08T18:10:45.731509] [DEBUG] [REMOTE ] CP: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-08T18:10:45.731916] [WARN ] [REMOTE ] CP: No data returned for month 2025-05 [2025-10-08T18:10:45.732008] [FATAL] [REMOTE ] CP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:10:45.732098] [FATAL] [MAIN ] CP: Failed to fetch primary data. [2025-10-08T18:10:45.732170] [WARN ] [MAIN ] CP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:10:45.732217] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-08T18:10:45.732273] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-08T18:10:45.732307] [INFO ] [LOCAL ] CP: Starting deletion of derivative data. [2025-10-08T18:10:45.732667] [DEBUG] [LOCAL ] CP: Deleted derivative data file. [2025-10-08T18:10:45.732780] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CP took 15.8s. Estimated remaining: 4h 16m 3s. Rate: 7.3 symbols/min [2025-10-08T18:10:45.920485] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:45.955637] [DEBUG] [LOCAL ] CPAY: Loaded 30449 existing records from primary storage. [2025-10-08T18:10:45.955985] [INFO ] [MAIN ] CPAY: Loaded 30449 existing records. [2025-10-08T18:10:46.143430] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:46.143679] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-08T18:10:46.143737] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-08T18:10:46.144085] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-08T18:10:46.144142] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-08T18:10:46.420127] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-08T18:10:46.505923] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:47.217553] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-08T18:10:47.671194] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T18:10:48.017506] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-08T18:10:48.175979] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T18:10:48.180006] [INFO ] [REMOTE ] COTY: Full fetch complete (76725 records). [2025-10-08T18:10:48.180146] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-08T18:10:48.181079] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:48.181172] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:48.181238] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:48.181324] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-08T18:10:48.181405] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-08T18:10:48.181453] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-08T18:10:48.181679] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-10-08T18:10:48.182429] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. COTY took 43.6s. Estimated remaining: 4h 15m 34s. Rate: 7.3 symbols/min [2025-10-08T18:10:48.366399] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:48.367024] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T18:10:48.367117] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-08T18:10:48.368301] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-08T18:10:48.368467] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-08T18:10:48.368575] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-08T18:10:48.368672] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-08T18:10:48.368730] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-08T18:10:48.723840] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:48.817568] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-08T18:10:49.617550] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-08T18:10:49.641994] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T18:10:50.417595] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-08T18:10:50.909974] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T18:10:51.217578] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-08T18:10:51.446174] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T18:10:52.017631] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-08T18:10:52.315227] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:10:52.615886] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T18:10:52.817588] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-08T18:10:53.617600] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-08T18:10:53.798461] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T18:10:53.939309] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-08T18:10:54.417560] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-08T18:10:55.217568] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-08T18:10:55.801046] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T18:10:55.823806] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T18:10:56.017529] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-08T18:10:56.817598] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-08T18:10:57.296960] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T18:10:57.297723] [INFO ] [REMOTE ] CPAC: Full fetch complete (1870 records). [2025-10-08T18:10:57.297808] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-08T18:10:57.475777] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T18:10:57.476028] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:57.476138] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:57.476313] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-08T18:10:57.476462] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-08T18:10:57.476510] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-08T18:10:57.476674] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-08T18:10:57.476764] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPAC took 19.8s. Estimated remaining: 4h 15m 30s. Rate: 7.3 symbols/min [2025-10-08T18:10:57.620261] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T18:10:57.619154] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-08T18:10:57.702410] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:57.723835] [DEBUG] [LOCAL ] CPK: Loaded 13627 existing records from primary storage. [2025-10-08T18:10:57.724087] [INFO ] [MAIN ] CPK: Loaded 13627 existing records. [2025-10-08T18:10:57.947407] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:57.947685] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-08T18:10:57.947749] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-08T18:10:57.948012] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-08T18:10:57.948091] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-08T18:10:58.296260] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:58.417495] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-08T18:10:58.773463] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T18:10:59.133096] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T18:10:59.217589] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-08T18:11:00.017572] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-08T18:11:00.505361] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T18:11:00.817590] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-08T18:11:01.151169] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T18:11:01.345672] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T18:11:01.617542] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-08T18:11:02.417544] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-08T18:11:02.993575] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T18:11:03.009977] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T18:11:03.217577] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-08T18:11:04.022802] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-08T18:11:04.025695] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T18:11:04.817590] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-08T18:11:05.011565] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:11:05.617540] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-08T18:11:06.065500] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T18:11:06.417518] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-08T18:11:06.653723] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T18:11:07.217557] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-08T18:11:07.660927] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T18:11:08.017531] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-08T18:11:08.172361] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T18:11:08.817688] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-08T18:11:08.938739] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T18:11:09.617580] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-08T18:11:09.714134] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T18:11:10.417585] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-08T18:11:10.620314] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T18:11:11.217606] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-08T18:11:11.949220] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:11:11.952199] [INFO ] [REMOTE ] CPF: Full fetch complete (23941 records). [2025-10-08T18:11:11.967808] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-08T18:11:12.004884] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:11:12.028327] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-08T18:11:12.392247] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-08T18:11:12.392334] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-08T18:11:12.392788] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-08T18:11:12.392851] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-08T18:11:12.393604] [DEBUG] [LOCAL ] CPF: Trimmed 23941 records to 15169 (keeping 200 days of data) [2025-10-08T18:11:12.486849] [DEBUG] [LOCAL ] CPF: Primary data saved (15169 records). [2025-10-08T18:11:12.486997] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-08T18:11:12.487073] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CPF took 24.3s. Estimated remaining: 4h 15m 46s. Rate: 7.3 symbols/min [2025-10-08T18:11:12.655576] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:12.714209] [DEBUG] [LOCAL ] CPNG: Loaded 53672 existing records from primary storage. [2025-10-08T18:11:12.714622] [INFO ] [MAIN ] CPNG: Loaded 53672 existing records. [2025-10-08T18:11:12.822798] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-08T18:11:12.902563] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:11:12.902827] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-08T18:11:12.902877] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-08T18:11:12.903195] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-08T18:11:12.903253] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-08T18:11:13.264095] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:13.312962] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T18:11:13.617590] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-08T18:11:14.417614] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-08T18:11:14.470762] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:11:15.217576] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-08T18:11:15.356267] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T18:11:15.802380] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-08T18:11:16.017551] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-08T18:11:16.188585] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T18:11:16.817599] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-08T18:11:17.617609] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-08T18:11:18.006588] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-08T18:11:18.092921] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T18:11:18.206998] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T18:11:18.417587] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-08T18:11:19.217560] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-08T18:11:19.873535] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T18:11:19.914339] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T18:11:20.017542] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-08T18:11:20.817709] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-08T18:11:21.617579] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-08T18:11:22.132073] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:11:22.295300] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-08T18:11:22.417565] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-08T18:11:22.991367] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:11:23.217566] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-08T18:11:23.504624] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T18:11:23.779863] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T18:11:24.017562] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-08T18:11:24.817528] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-08T18:11:24.879528] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:11:25.617555] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-08T18:11:25.831508] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T18:11:26.417530] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-08T18:11:26.695060] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T18:11:27.217549] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-08T18:11:27.494491] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T18:11:27.496793] [INFO ] [REMOTE ] CPAY: Full fetch complete (44893 records). [2025-10-08T18:11:27.496891] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-08T18:11:27.874628] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-08T18:11:27.874741] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-08T18:11:27.875303] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-08T18:11:27.875343] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-08T18:11:27.876303] [DEBUG] [LOCAL ] CPAY: Trimmed 44893 records to 30443 (keeping 200 days of data) [2025-10-08T18:11:28.027375] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-08T18:11:28.067853] [DEBUG] [LOCAL ] CPAY: Primary data saved (30443 records). [2025-10-08T18:11:28.067969] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-08T18:11:28.068062] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPAY took 42.3s. Estimated remaining: 4h 16m 4s. Rate: 7.2 symbols/min [2025-10-08T18:11:28.092205] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T18:11:28.093923] [INFO ] [REMOTE ] CPK: Full fetch complete (18109 records). [2025-10-08T18:11:28.093995] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-08T18:11:28.452968] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-08T18:11:28.453049] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-08T18:11:28.453411] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-08T18:11:28.453450] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-08T18:11:28.454066] [DEBUG] [LOCAL ] CPK: Trimmed 18109 records to 13647 (keeping 200 days of data) [2025-10-08T18:11:28.540816] [DEBUG] [LOCAL ] CPK: Primary data saved (13647 records). [2025-10-08T18:11:28.540997] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-08T18:11:28.541112] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 31.1s. Estimated remaining: 4h 15m 27s. Rate: 7.3 symbols/min [2025-10-08T18:11:28.817557] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-08T18:11:29.944994] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T18:11:29.947242] [INFO ] [REMOTE ] CPA: Full fetch complete (41385 records). [2025-10-08T18:11:29.947331] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-08T18:11:30.355914] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-08T18:11:30.356095] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-08T18:11:30.356773] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-08T18:11:30.356890] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-08T18:11:30.358021] [DEBUG] [LOCAL ] CPA: Trimmed 41385 records to 28240 (keeping 200 days of data) [2025-10-08T18:11:30.517300] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-08T18:11:30.530833] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-08T18:11:30.591353] [DEBUG] [LOCAL ] CPA: Primary data saved (28240 records). [2025-10-08T18:11:30.591494] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-08T18:11:30.591576] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPA took 55.7s. Estimated remaining: 4h 14m 57s. Rate: 7.3 symbols/min [2025-10-08T18:11:32.634321] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-08T18:11:32.647245] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-08T18:11:34.986628] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-08T18:11:34.998358] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-08T18:11:37.110942] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T18:11:37.123214] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-08T18:11:39.324686] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T18:11:39.337424] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-08T18:11:41.879722] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-08T18:11:41.892060] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-08T18:11:44.107118] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-08T18:11:44.118604] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-08T18:11:46.321699] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-08T18:11:46.325911] [INFO ] [REMOTE ] CPNG: Full fetch complete (77673 records). [2025-10-08T18:11:46.326050] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-08T18:11:46.721895] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-08T18:11:46.722030] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-08T18:11:46.723158] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-08T18:11:46.723230] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-08T18:11:46.724948] [DEBUG] [LOCAL ] CPNG: Trimmed 77673 records to 53670 (keeping 200 days of data) [2025-10-08T18:11:47.043173] [DEBUG] [LOCAL ] CPNG: Primary data saved (53670 records). [2025-10-08T18:11:47.043311] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-08T18:11:47.043915] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 34.6s. Estimated remaining: 4h 15m 18s. Rate: 7.3 symbols/min [2025-10-08T18:11:47.661005] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:47.682367] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:47.763166] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:47.776913] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-08T18:11:47.812145] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:47.810957] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-08T18:11:47.812778] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-08T18:11:47.813003] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-08T18:11:47.813077] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-08T18:11:47.813115] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-08T18:11:48.038011] [DEBUG] [LOCAL ] CPS: Loaded 25707 existing records from primary storage. [2025-10-08T18:11:48.081277] [INFO ] [MAIN ] CPS: Loaded 25707 existing records. [2025-10-08T18:11:48.194610] [DEBUG] [LOCAL ] CPT: Loaded 44398 existing records from primary storage. [2025-10-08T18:11:48.264889] [DEBUG] [LOCAL ] CPRI: Loaded 52513 existing records from primary storage. [2025-10-08T18:11:48.275518] [INFO ] [MAIN ] CPT: Loaded 44398 existing records. [2025-10-08T18:11:48.304285] [INFO ] [MAIN ] CPRI: Loaded 52513 existing records. [2025-10-08T18:11:48.606960] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:48.626913] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-08T18:11:48.816330] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:11:48.925457] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:11:48.953902] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-08T18:11:48.935168] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-08T18:11:48.954334] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-08T18:11:48.954232] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-08T18:11:48.957751] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:11:48.958094] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-08T18:11:48.958149] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-08T18:11:48.958272] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-08T18:11:48.958238] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-08T18:11:48.958607] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-08T18:11:48.958521] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-08T18:11:48.958477] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-08T18:11:48.963998] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-08T18:11:49.998765] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:50.009464] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:50.033088] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-08T18:11:50.038599] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-08T18:11:50.155055] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:50.160634] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-08T18:11:50.168365] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:11:50.173255] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-08T18:11:51.277350] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T18:11:51.281979] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-08T18:11:51.366923] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:11:51.372883] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-08T18:11:51.468483] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:11:51.476529] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-08T18:11:51.620180] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T18:11:51.631327] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-08T18:11:52.323349] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T18:11:52.328091] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-08T18:11:52.410274] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T18:11:52.415885] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-08T18:11:52.942414] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:11:52.951342] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-08T18:11:53.407424] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T18:11:53.418894] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-08T18:11:53.451100] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T18:11:53.456580] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-08T18:11:53.591253] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T18:11:53.596765] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-08T18:11:54.690543] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:11:54.697587] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-08T18:11:54.709952] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T18:11:54.715068] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-08T18:11:54.877603] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T18:11:54.886667] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-08T18:11:54.942181] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T18:11:54.952144] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-08T18:11:55.628158] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T18:11:55.636222] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-08T18:11:55.822811] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T18:11:55.830219] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-08T18:11:56.237702] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T18:11:56.247104] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-08T18:11:56.549403] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T18:11:56.562838] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-08T18:11:56.695567] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T18:11:56.701763] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-08T18:11:57.471521] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T18:11:57.478809] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-08T18:11:57.914759] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T18:11:57.925148] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-08T18:11:57.962093] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T18:11:57.968128] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-08T18:11:58.002505] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T18:11:58.014564] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-08T18:11:58.196403] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T18:11:58.201800] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-08T18:11:58.895772] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T18:11:58.899420] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-08T18:11:59.247577] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T18:11:59.257894] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-08T18:11:59.289327] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T18:11:59.650604] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T18:11:59.830155] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T18:12:00.017595] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-08T18:12:00.732871] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:12:00.817512] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-08T18:12:01.617626] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-08T18:12:01.928278] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:12:02.100981] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T18:12:02.417578] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-08T18:12:02.578969] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:12:02.580455] [INFO ] [REMOTE ] CQP: Full fetch complete (30358 records). [2025-10-08T18:12:02.580547] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-08T18:12:02.953006] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-08T18:12:02.953120] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-08T18:12:02.953605] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-08T18:12:02.953675] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-08T18:12:02.954668] [DEBUG] [LOCAL ] CQP: Trimmed 30358 records to 18929 (keeping 200 days of data) [2025-10-08T18:12:03.071757] [DEBUG] [LOCAL ] CQP: Primary data saved (18929 records). [2025-10-08T18:12:03.071923] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-08T18:12:03.072024] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 16.0s. Estimated remaining: 4h 15m 37s. Rate: 7.2 symbols/min [2025-10-08T18:12:03.223944] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-08T18:12:03.243039] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:03.267709] [DEBUG] [LOCAL ] CR: Loaded 24194 existing records from primary storage. [2025-10-08T18:12:03.267990] [INFO ] [MAIN ] CR: Loaded 24194 existing records. [2025-10-08T18:12:03.448978] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:03.449237] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-08T18:12:03.449330] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-08T18:12:03.450116] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-08T18:12:03.450176] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-08T18:12:03.802969] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:04.017540] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-08T18:12:04.352227] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T18:12:04.376989] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:12:04.817560] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-08T18:12:05.303870] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T18:12:05.617588] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-08T18:12:06.256798] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:12:06.258815] [INFO ] [REMOTE ] CPS: Full fetch complete (36388 records). [2025-10-08T18:12:06.258909] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-08T18:12:06.421924] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-08T18:12:06.649288] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-08T18:12:06.649374] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-08T18:12:06.649973] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-08T18:12:06.650036] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-08T18:12:06.650911] [DEBUG] [LOCAL ] CPS: Trimmed 36388 records to 25526 (keeping 200 days of data) [2025-10-08T18:12:06.803299] [DEBUG] [LOCAL ] CPS: Primary data saved (25526 records). [2025-10-08T18:12:06.803456] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-08T18:12:06.803603] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 19.8s. Estimated remaining: 4h 15m 13s. Rate: 7.2 symbols/min [2025-10-08T18:12:06.984435] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:06.995153] [DEBUG] [LOCAL ] CRBD: Loaded 8964 existing records from primary storage. [2025-10-08T18:12:06.995391] [INFO ] [MAIN ] CRBD: Loaded 8964 existing records. [2025-10-08T18:12:07.182704] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:07.183215] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-08T18:12:07.183362] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-08T18:12:07.183925] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-08T18:12:07.184041] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-08T18:12:07.217695] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-08T18:12:07.332206] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T18:12:07.607130] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:08.017553] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-08T18:12:08.170156] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T18:12:08.555462] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T18:12:08.817588] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-08T18:12:09.259785] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T18:12:09.617573] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-08T18:12:09.980096] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T18:12:10.417631] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-08T18:12:11.217521] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-08T18:12:11.249520] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:12:11.299474] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T18:12:12.017604] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-08T18:12:12.460294] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:12:12.612846] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T18:12:12.817587] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-08T18:12:13.617595] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-08T18:12:14.417553] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-08T18:12:14.662361] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T18:12:14.666338] [INFO ] [REMOTE ] CPRI: Full fetch complete (76103 records). [2025-10-08T18:12:14.666447] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-08T18:12:15.071469] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-08T18:12:15.071560] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-08T18:12:15.072407] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-08T18:12:15.072473] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-08T18:12:15.074000] [DEBUG] [LOCAL ] CPRI: Trimmed 76103 records to 52519 (keeping 200 days of data) [2025-10-08T18:12:15.196750] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:12:15.217891] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-08T18:12:15.422286] [DEBUG] [LOCAL ] CPRI: Primary data saved (52519 records). [2025-10-08T18:12:15.422447] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-08T18:12:15.422564] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPRI took 28.4s. Estimated remaining: 4h 15m 6s. Rate: 7.2 symbols/min [2025-10-08T18:12:15.598937] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:15.649847] [DEBUG] [LOCAL ] CRBG: Loaded 52422 existing records from primary storage. [2025-10-08T18:12:15.650173] [INFO ] [MAIN ] CRBG: Loaded 52422 existing records. [2025-10-08T18:12:15.830717] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:15.831048] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-08T18:12:15.831145] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-08T18:12:15.832744] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-08T18:12:15.832808] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-08T18:12:16.031493] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-08T18:12:16.207694] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:16.235065] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T18:12:16.503535] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T18:12:16.817580] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-08T18:12:16.825022] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T18:12:17.617571] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-08T18:12:17.944909] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T18:12:18.417560] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-08T18:12:19.056473] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:12:19.217520] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-08T18:12:19.400593] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T18:12:20.017559] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-08T18:12:20.275510] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T18:12:20.818385] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-08T18:12:20.821992] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T18:12:21.617577] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-08T18:12:22.417609] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-08T18:12:22.547690] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:12:23.220218] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-08T18:12:23.222955] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T18:12:23.227763] [INFO ] [REMOTE ] CPT: Full fetch complete (63979 records). [2025-10-08T18:12:23.227924] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-08T18:12:23.568623] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T18:12:23.693105] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-08T18:12:23.693347] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-08T18:12:23.700531] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T18:12:23.700239] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-08T18:12:23.704017] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-08T18:12:23.705601] [DEBUG] [LOCAL ] CPT: Trimmed 63979 records to 44405 (keeping 200 days of data) [2025-10-08T18:12:23.998688] [DEBUG] [LOCAL ] CPT: Primary data saved (44405 records). [2025-10-08T18:12:23.998839] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-08T18:12:23.998926] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPT took 36.9s. Estimated remaining: 4h 14m 58s. Rate: 7.2 symbols/min [2025-10-08T18:12:24.022741] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-08T18:12:24.178626] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:24.222384] [DEBUG] [LOCAL ] CRC: Loaded 43850 existing records from primary storage. [2025-10-08T18:12:24.222723] [INFO ] [MAIN ] CRC: Loaded 43850 existing records. [2025-10-08T18:12:24.397051] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:24.397298] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-08T18:12:24.397344] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-08T18:12:24.397815] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-08T18:12:24.397873] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-08T18:12:24.744354] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:24.817493] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-08T18:12:25.617596] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-08T18:12:25.853114] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T18:12:26.324228] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T18:12:26.370085] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T18:12:26.417544] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-08T18:12:27.217603] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-08T18:12:27.724278] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T18:12:28.017548] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-08T18:12:28.810876] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:12:28.821033] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-08T18:12:29.366071] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:12:29.617526] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-08T18:12:29.822413] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T18:12:30.417585] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-08T18:12:30.459271] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T18:12:31.217554] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-08T18:12:31.949714] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:12:32.017530] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-08T18:12:32.406114] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T18:12:32.408094] [INFO ] [REMOTE ] CR: Full fetch complete (34686 records). [2025-10-08T18:12:32.408178] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-08T18:12:32.789178] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-08T18:12:32.789268] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-08T18:12:32.789885] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-08T18:12:32.789968] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-08T18:12:32.791249] [DEBUG] [LOCAL ] CR: Trimmed 34686 records to 24113 (keeping 200 days of data) [2025-10-08T18:12:32.851219] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-08T18:12:32.952400] [DEBUG] [LOCAL ] CR: Primary data saved (24113 records). [2025-10-08T18:12:32.952540] [INFO ] [MAIN ] CR: Full history saved. [2025-10-08T18:12:32.952625] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CR took 29.9s. Estimated remaining: 4h 14m 52s. Rate: 7.2 symbols/min [2025-10-08T18:12:33.120212] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:33.120394] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-08T18:12:33.120448] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-08T18:12:33.120558] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-08T18:12:33.120599] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-08T18:12:33.120659] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-08T18:12:33.120716] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-08T18:12:33.490996] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:33.617540] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-08T18:12:33.676248] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:12:33.813590] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:12:33.813946] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-08T18:12:33.814035] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:12:33.814083] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-08T18:12:33.814161] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:12:33.814233] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-08T18:12:33.814297] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-08T18:12:33.814331] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-08T18:12:33.814371] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-08T18:12:33.814418] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRCL took 0.9s. Estimated remaining: 4h 14m 18s. Rate: 7.3 symbols/min [2025-10-08T18:12:33.998005] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:34.048774] [DEBUG] [LOCAL ] CRGY: Loaded 52498 existing records from primary storage. [2025-10-08T18:12:34.049131] [INFO ] [MAIN ] CRGY: Loaded 52498 existing records. [2025-10-08T18:12:34.238102] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:34.238358] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-08T18:12:34.238436] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-08T18:12:34.239044] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-08T18:12:34.239141] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-08T18:12:34.429572] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-08T18:12:34.645558] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:34.676377] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T18:12:35.217567] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-08T18:12:35.867783] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T18:12:36.017554] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-08T18:12:36.817544] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-08T18:12:36.956507] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T18:12:37.591970] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T18:12:37.617501] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-08T18:12:37.646816] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:12:38.173327] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T18:12:38.417542] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-08T18:12:39.217557] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-08T18:12:40.026464] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-08T18:12:40.032578] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:12:40.817554] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-08T18:12:41.016489] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:12:41.378481] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T18:12:41.617570] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-08T18:12:42.114227] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:12:42.417576] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-08T18:12:43.217547] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-08T18:12:43.344046] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:12:43.786385] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:12:44.017628] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-08T18:12:44.817611] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-08T18:12:45.039668] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T18:12:45.605579] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T18:12:45.607154] [INFO ] [REMOTE ] CRBD: Full fetch complete (14028 records). [2025-10-08T18:12:45.607374] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-08T18:12:45.627943] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-08T18:12:45.851876] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T18:12:46.094290] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-08T18:12:46.094376] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-08T18:12:46.094816] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-08T18:12:46.094880] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-08T18:12:46.095386] [DEBUG] [LOCAL ] CRBD: Trimmed 14028 records to 9039 (keeping 200 days of data) [2025-10-08T18:12:46.150924] [DEBUG] [LOCAL ] CRBD: Primary data saved (9039 records). [2025-10-08T18:12:46.151083] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-08T18:12:46.151176] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBD took 39.3s. Estimated remaining: 4h 14m 24s. Rate: 7.2 symbols/min [2025-10-08T18:12:46.324125] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:46.379965] [DEBUG] [LOCAL ] CRH: Loaded 53462 existing records from primary storage. [2025-10-08T18:12:46.380313] [INFO ] [MAIN ] CRH: Loaded 53462 existing records. [2025-10-08T18:12:46.422729] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-08T18:12:46.570742] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:46.571025] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-08T18:12:46.571078] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-08T18:12:46.571628] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-08T18:12:46.571730] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-08T18:12:46.972126] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:47.217512] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-08T18:12:47.417137] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:12:48.017509] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-08T18:12:48.168473] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T18:12:48.172039] [INFO ] [REMOTE ] CRC: Full fetch complete (62540 records). [2025-10-08T18:12:48.172136] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-08T18:12:48.551313] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-08T18:12:48.551395] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-08T18:12:48.552124] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-08T18:12:48.552195] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-08T18:12:48.553409] [DEBUG] [LOCAL ] CRC: Trimmed 62540 records to 43809 (keeping 200 days of data) [2025-10-08T18:12:48.812454] [DEBUG] [LOCAL ] CRC: Primary data saved (43809 records). [2025-10-08T18:12:48.812584] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-08T18:12:48.812683] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 24.8s. Estimated remaining: 4h 13m 56s. Rate: 7.3 symbols/min [2025-10-08T18:12:48.848743] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-08T18:12:48.984280] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:49.016015] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:12:49.066685] [DEBUG] [LOCAL ] CRI: Loaded 49806 existing records from primary storage. [2025-10-08T18:12:49.067006] [INFO ] [MAIN ] CRI: Loaded 49806 existing records. [2025-10-08T18:12:49.247758] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:49.248180] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-08T18:12:49.248232] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-08T18:12:49.248826] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-08T18:12:49.248885] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-08T18:12:49.600353] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:49.617487] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-08T18:12:49.725483] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T18:12:50.417593] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-08T18:12:50.722716] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:12:50.968677] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:12:51.217571] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-08T18:12:51.732257] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T18:12:51.736195] [INFO ] [REMOTE ] CRBG: Full fetch complete (75761 records). [2025-10-08T18:12:51.736315] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-08T18:12:52.022746] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-08T18:12:52.133818] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-08T18:12:52.133907] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-08T18:12:52.135060] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-08T18:12:52.135124] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-08T18:12:52.136628] [DEBUG] [LOCAL ] CRBG: Trimmed 75761 records to 52448 (keeping 200 days of data) [2025-10-08T18:12:52.461150] [DEBUG] [LOCAL ] CRBG: Primary data saved (52448 records). [2025-10-08T18:12:52.461324] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-08T18:12:52.461421] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRBG took 37.0s. Estimated remaining: 4h 13m 32s. Rate: 7.3 symbols/min [2025-10-08T18:12:52.630935] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:52.684697] [DEBUG] [LOCAL ] CRK: Loaded 52197 existing records from primary storage. [2025-10-08T18:12:52.685227] [INFO ] [MAIN ] CRK: Loaded 52197 existing records. [2025-10-08T18:12:52.827853] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-08T18:12:52.863395] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:52.864739] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-08T18:12:52.864916] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-08T18:12:52.900238] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-08T18:12:52.907925] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-08T18:12:53.010190] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T18:12:53.280401] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:53.617532] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-08T18:12:53.796320] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T18:12:54.417628] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-08T18:12:54.544590] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T18:12:55.225063] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-08T18:12:55.228186] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T18:12:56.017523] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-08T18:12:56.177829] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T18:12:56.769382] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:12:56.817563] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-08T18:12:57.355050] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T18:12:57.617558] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-08T18:12:58.266331] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:12:58.417553] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-08T18:12:59.217547] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-08T18:12:59.616854] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T18:12:59.978663] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T18:13:00.017534] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-08T18:13:00.817522] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-08T18:13:00.940497] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:13:01.617525] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-08T18:13:01.826296] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T18:13:02.417563] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-08T18:13:02.789113] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T18:13:03.217562] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-08T18:13:03.290418] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:13:04.027571] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-08T18:13:04.033609] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T18:13:04.817594] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-08T18:13:04.868582] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:13:05.617509] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-08T18:13:05.798977] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:13:06.417523] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-08T18:13:06.582174] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T18:13:07.120533] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:13:07.217585] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-08T18:13:08.017621] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-08T18:13:08.268255] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T18:13:08.817556] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-08T18:13:09.234573] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T18:13:09.513122] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:13:09.518202] [INFO ] [REMOTE ] CRGY: Full fetch complete (75952 records). [2025-10-08T18:13:09.518486] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-08T18:13:09.618852] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-08T18:13:09.914978] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-08T18:13:09.915078] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-08T18:13:09.915989] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-08T18:13:09.916058] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-08T18:13:09.917692] [DEBUG] [LOCAL ] CRGY: Trimmed 75952 records to 52481 (keeping 200 days of data) [2025-10-08T18:13:10.252335] [DEBUG] [LOCAL ] CRGY: Primary data saved (52481 records). [2025-10-08T18:13:10.252496] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-08T18:13:10.253137] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRGY took 36.4s. Estimated remaining: 4h 13m 57s. Rate: 7.2 symbols/min [2025-10-08T18:13:10.430542] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-08T18:13:10.434397] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:10.487303] [DEBUG] [LOCAL ] CRL: Loaded 42802 existing records from primary storage. [2025-10-08T18:13:10.487619] [INFO ] [MAIN ] CRL: Loaded 42802 existing records. [2025-10-08T18:13:10.673113] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:10.673554] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-08T18:13:10.673632] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-08T18:13:10.674203] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-08T18:13:10.674266] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-08T18:13:10.813477] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:13:11.121133] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:11.155405] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T18:13:11.217525] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-08T18:13:12.017611] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-08T18:13:12.385341] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T18:13:12.796802] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T18:13:12.817511] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-08T18:13:13.591916] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T18:13:13.617585] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-08T18:13:14.417543] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-08T18:13:14.511573] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T18:13:15.220479] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-08T18:13:15.225329] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:13:16.017522] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-08T18:13:16.361071] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T18:13:16.822941] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-08T18:13:16.854479] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T18:13:17.516465] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T18:13:17.617509] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-08T18:13:18.417568] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-08T18:13:18.588434] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T18:13:19.217506] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-08T18:13:19.252174] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:13:20.017564] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-08T18:13:20.078512] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T18:13:20.817559] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-08T18:13:21.230368] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-08T18:13:21.617608] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-08T18:13:21.662688] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:13:22.417635] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-08T18:13:22.635223] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:13:23.217532] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-08T18:13:23.436181] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T18:13:23.441248] [INFO ] [REMOTE ] CRK: Full fetch complete (75623 records). [2025-10-08T18:13:23.441536] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-08T18:13:23.903145] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-08T18:13:23.903252] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-08T18:13:23.904164] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-08T18:13:23.904234] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-08T18:13:23.905968] [DEBUG] [LOCAL ] CRK: Trimmed 75623 records to 52203 (keeping 200 days of data) [2025-10-08T18:13:24.017707] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-08T18:13:24.101507] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T18:13:24.133945] [INFO ] [REMOTE ] CRH: Full fetch complete (76917 records). [2025-10-08T18:13:24.135752] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-08T18:13:24.137370] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:13:24.138692] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:13:24.139034] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:13:24.140506] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-08T18:13:24.142014] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-08T18:13:24.142384] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-10-08T18:13:24.143546] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-10-08T18:13:24.144233] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 38.0s. Estimated remaining: 4h 14m 8s. Rate: 7.2 symbols/min [2025-10-08T18:13:24.356293] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:24.471699] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-08T18:13:24.472743] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-08T18:13:24.625143] [DEBUG] [LOCAL ] CRK: Primary data saved (52203 records). [2025-10-08T18:13:24.638550] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-08T18:13:24.660577] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRK took 32.2s. Estimated remaining: 4h 13m 33s. Rate: 7.3 symbols/min [2025-10-08T18:13:24.666306] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:24.710452] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-08T18:13:24.722672] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-08T18:13:24.766819] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-08T18:13:24.770772] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-08T18:13:24.943923] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:25.184235] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T18:13:25.263580] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:25.264324] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-08T18:13:25.278891] [DEBUG] [LOCAL ] CRS: Loaded 43173 existing records from primary storage. [2025-10-08T18:13:25.279158] [INFO ] [MAIN ] CRS: Loaded 43173 existing records. [2025-10-08T18:13:25.469959] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:25.470425] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-08T18:13:25.470522] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-08T18:13:25.471015] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-08T18:13:25.471191] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-08T18:13:25.627484] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-08T18:13:25.737484] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T18:13:25.892813] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:26.417551] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-08T18:13:27.217551] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-08T18:13:27.548750] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-08T18:13:27.586716] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T18:13:28.017519] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-08T18:13:28.235926] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T18:13:28.551827] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T18:13:28.556913] [INFO ] [REMOTE ] CRI: Full fetch complete (70829 records). [2025-10-08T18:13:28.557202] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-08T18:13:28.822851] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-08T18:13:28.956560] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-08T18:13:28.956703] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-08T18:13:28.957587] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-08T18:13:28.957687] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-08T18:13:28.959396] [DEBUG] [LOCAL ] CRI: Trimmed 70829 records to 49762 (keeping 200 days of data) [2025-10-08T18:13:29.220311] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T18:13:29.296817] [DEBUG] [LOCAL ] CRI: Primary data saved (49762 records). [2025-10-08T18:13:29.296956] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-08T18:13:29.297050] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRI took 40.5s. Estimated remaining: 4h 13m 12s. Rate: 7.3 symbols/min [2025-10-08T18:13:29.469855] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:29.477695] [DEBUG] [LOCAL ] CRT: Loaded 5025 existing records from primary storage. [2025-10-08T18:13:29.477923] [INFO ] [MAIN ] CRT: Loaded 5025 existing records. [2025-10-08T18:13:29.624957] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-08T18:13:29.667443] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:29.668455] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-08T18:13:29.668509] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-08T18:13:29.668784] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-08T18:13:29.668850] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-08T18:13:30.022701] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:30.417519] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-08T18:13:31.070463] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T18:13:31.217539] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-08T18:13:31.390533] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-08T18:13:31.478352] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T18:13:31.893925] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T18:13:32.017549] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-08T18:13:32.817601] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-08T18:13:33.617544] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-08T18:13:34.252507] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-08T18:13:34.417559] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-08T18:13:34.647129] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T18:13:34.874803] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:13:35.217563] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-08T18:13:36.017553] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-08T18:13:36.525694] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T18:13:36.705431] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-08T18:13:36.743891] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T18:13:36.817612] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-08T18:13:37.617582] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-08T18:13:38.417586] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-08T18:13:39.077143] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-08T18:13:39.115330] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:13:39.217554] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-08T18:13:39.757217] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T18:13:40.017587] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-08T18:13:40.568274] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T18:13:40.659387] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:13:40.663031] [INFO ] [REMOTE ] CRL: Full fetch complete (63251 records). [2025-10-08T18:13:40.663161] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-08T18:13:40.824184] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-08T18:13:41.067406] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-08T18:13:41.067507] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-08T18:13:41.068309] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-08T18:13:41.068390] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-08T18:13:41.069837] [DEBUG] [LOCAL ] CRL: Trimmed 63251 records to 42811 (keeping 200 days of data) [2025-10-08T18:13:41.334828] [DEBUG] [LOCAL ] CRL: Primary data saved (42811 records). [2025-10-08T18:13:41.334966] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-08T18:13:41.336019] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRL took 31.1s. Estimated remaining: 4h 13m 17s. Rate: 7.3 symbols/min [2025-10-08T18:13:41.504801] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:41.567257] [DEBUG] [LOCAL ] CSAN: Loaded 42225 existing records from primary storage. [2025-10-08T18:13:41.567632] [INFO ] [MAIN ] CSAN: Loaded 42225 existing records. [2025-10-08T18:13:41.622887] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-08T18:13:41.761790] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:41.762907] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T18:13:41.763073] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-08T18:13:41.765339] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-08T18:13:41.765594] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-08T18:13:41.765680] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-08T18:13:42.126794] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:42.417553] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-08T18:13:43.110438] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:13:43.217544] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-08T18:13:44.003438] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T18:13:44.017492] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-08T18:13:44.817542] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-08T18:13:45.486488] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:13:45.574209] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-08T18:13:45.617522] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-08T18:13:46.417530] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-08T18:13:46.674970] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T18:13:46.798397] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T18:13:47.027376] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T18:13:47.217567] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-08T18:13:48.017634] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-08T18:13:48.628051] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T18:13:48.817617] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-08T18:13:49.437927] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T18:13:49.617613] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-08T18:13:50.161085] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-08T18:13:50.417618] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-08T18:13:51.110480] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:13:51.217587] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-08T18:13:52.017558] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-08T18:13:52.692543] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-08T18:13:52.817956] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-08T18:13:52.817886] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:13:53.341798] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T18:13:53.617564] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-08T18:13:54.417563] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-08T18:13:55.217733] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-08T18:13:55.220515] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-08T18:13:55.355591] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:13:55.787248] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T18:13:55.952083] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T18:13:56.017624] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-08T18:13:56.817571] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-08T18:13:57.617541] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-08T18:13:58.408102] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T18:13:58.417578] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-08T18:13:58.521934] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-08T18:13:58.864329] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T18:13:59.217553] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-08T18:13:59.588319] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-08T18:13:59.589753] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T18:14:00.017582] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-08T18:14:00.749461] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:14:00.817517] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-08T18:14:01.507292] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T18:14:01.508250] [INFO ] [REMOTE ] CRT: Full fetch complete (7478 records). [2025-10-08T18:14:01.508323] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-08T18:14:01.509253] [FATAL] [VALIDATOR ] CRT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:14:01.509375] [FATAL] [MAIN ] CRT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:14:01.509418] [WARN ] [MAIN ] CRT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:14:01.509475] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-08T18:14:01.509588] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-08T18:14:01.509664] [INFO ] [LOCAL ] CRT: Starting deletion of derivative data. [2025-10-08T18:14:01.509900] [DEBUG] [LOCAL ] CRT: Deleted derivative data file. [2025-10-08T18:14:01.510005] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRT took 32.2s. Estimated remaining: 4h 13m 49s. Rate: 7.2 symbols/min [2025-10-08T18:14:01.622706] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-08T18:14:01.699795] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:01.743011] [DEBUG] [LOCAL ] CSL: Loaded 31514 existing records from primary storage. [2025-10-08T18:14:01.743406] [INFO ] [MAIN ] CSL: Loaded 31514 existing records. [2025-10-08T18:14:01.985187] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:01.985497] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-08T18:14:01.985554] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-08T18:14:01.986111] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-08T18:14:01.986189] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-08T18:14:02.433408] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-08T18:14:02.441701] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:03.131027] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T18:14:03.135592] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-08T18:14:03.135782] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-08T18:14:03.143901] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T18:14:03.152841] [INFO ] [REMOTE ] CRS: Full fetch complete (62631 records). [2025-10-08T18:14:03.194331] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-08T18:14:03.220839] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-08T18:14:04.000585] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-08T18:14:04.004200] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-08T18:14:04.004044] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-08T18:14:04.006117] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-08T18:14:04.006231] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-08T18:14:04.007212] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-08T18:14:04.007299] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-08T18:14:04.007682] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-08T18:14:04.009871] [DEBUG] [LOCAL ] CRS: Trimmed 62631 records to 43154 (keeping 200 days of data) [2025-10-08T18:14:04.011192] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-10-08T18:14:04.068884] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-08T18:14:04.630538] [DEBUG] [LOCAL ] CRS: Primary data saved (43154 records). [2025-10-08T18:14:04.633877] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-08T18:14:04.634380] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRS took 40.0s. Estimated remaining: 4h 13m 23s. Rate: 7.2 symbols/min [2025-10-08T18:14:04.633797] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:14:04.820604] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-08T18:14:04.890356] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:04.908978] [DEBUG] [LOCAL ] CSR: Loaded 12957 existing records from primary storage. [2025-10-08T18:14:04.910086] [INFO ] [MAIN ] CSR: Loaded 12957 existing records. [2025-10-08T18:14:05.100713] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:05.102312] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-08T18:14:05.102780] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-08T18:14:05.103708] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-08T18:14:05.104071] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-08T18:14:05.272744] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-08T18:14:05.300360] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-08T18:14:05.346195] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRM took 41.2s. Estimated remaining: 4h 12m 49s. Rate: 7.3 symbols/min [2025-10-08T18:14:05.622557] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:05.649035] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-08T18:14:05.670465] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:05.722931] [DEBUG] [LOCAL ] CSTM: Loaded 47537 existing records from primary storage. [2025-10-08T18:14:05.723258] [INFO ] [MAIN ] CSTM: Loaded 47537 existing records. [2025-10-08T18:14:05.902453] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:05.919906] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-08T18:14:05.920050] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-08T18:14:05.920769] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-08T18:14:05.921454] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:14:05.921537] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-08T18:14:06.340111] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:06.370029] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T18:14:06.417587] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-08T18:14:06.830401] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T18:14:07.217701] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-08T18:14:08.017606] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-08T18:14:08.063679] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T18:14:08.093905] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T18:14:08.817615] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-08T18:14:09.169152] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T18:14:09.617607] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-08T18:14:10.113194] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T18:14:10.417739] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-08T18:14:10.879192] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:14:11.217689] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-08T18:14:11.449144] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T18:14:11.452216] [INFO ] [REMOTE ] CSAN: Full fetch complete (60427 records). [2025-10-08T18:14:11.452336] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-08T18:14:11.832018] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-08T18:14:11.832098] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-08T18:14:11.832798] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-08T18:14:11.832862] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-08T18:14:11.834155] [DEBUG] [LOCAL ] CSAN: Trimmed 60427 records to 42145 (keeping 200 days of data) [2025-10-08T18:14:12.031492] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-08T18:14:12.079693] [DEBUG] [LOCAL ] CSAN: Primary data saved (42145 records). [2025-10-08T18:14:12.079824] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-08T18:14:12.080626] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 30.7s. Estimated remaining: 4h 12m 35s. Rate: 7.3 symbols/min [2025-10-08T18:14:12.256197] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:12.274485] [DEBUG] [LOCAL ] CSV: Loaded 12795 existing records from primary storage. [2025-10-08T18:14:12.274834] [INFO ] [MAIN ] CSV: Loaded 12795 existing records. [2025-10-08T18:14:12.468118] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:12.468577] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-08T18:14:12.468672] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-08T18:14:12.468906] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-08T18:14:12.468968] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-08T18:14:12.838051] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-08T18:14:13.033003] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T18:14:13.108189] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:13.196806] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T18:14:13.409893] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T18:14:13.617607] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-08T18:14:14.220385] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:14:14.417611] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-08T18:14:15.217563] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-08T18:14:16.017601] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-08T18:14:16.072189] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:14:16.823564] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-08T18:14:16.851790] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:14:16.867821] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T18:14:17.617574] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-08T18:14:18.167365] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T18:14:18.417526] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-08T18:14:18.560568] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T18:14:19.217574] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-08T18:14:19.964067] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T18:14:20.017542] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-08T18:14:20.079768] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:14:20.708067] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T18:14:20.817544] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-08T18:14:21.507066] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T18:14:21.617568] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-08T18:14:22.315559] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T18:14:22.417565] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-08T18:14:23.217555] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-08T18:14:23.646872] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T18:14:24.017586] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-08T18:14:24.183582] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T18:14:24.817558] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-08T18:14:25.619395] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-08T18:14:25.626485] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T18:14:25.653273] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T18:14:26.417528] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-08T18:14:26.428888] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T18:14:27.217594] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-08T18:14:27.621500] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T18:14:28.017595] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-08T18:14:28.627701] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T18:14:28.657296] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T18:14:28.817546] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-08T18:14:29.617548] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-08T18:14:29.816467] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T18:14:30.417560] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-08T18:14:30.750082] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T18:14:31.217564] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-08T18:14:32.017547] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-08T18:14:32.222873] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T18:14:32.718318] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:14:32.817595] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-08T18:14:32.912275] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:14:33.617570] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-08T18:14:34.070477] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T18:14:34.073538] [INFO ] [REMOTE ] CSL: Full fetch complete (45333 records). [2025-10-08T18:14:34.073663] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-08T18:14:34.425178] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-08T18:14:34.470562] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-08T18:14:34.470684] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-08T18:14:34.471322] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-08T18:14:34.471368] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-08T18:14:34.474255] [DEBUG] [LOCAL ] CSL: Trimmed 45333 records to 31443 (keeping 200 days of data) [2025-10-08T18:14:34.667275] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T18:14:34.695774] [DEBUG] [LOCAL ] CSL: Primary data saved (31443 records). [2025-10-08T18:14:34.695984] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-08T18:14:34.696105] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSL took 33.2s. Estimated remaining: 4h 13m 16s. Rate: 7.2 symbols/min [2025-10-08T18:14:34.906311] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:34.906582] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-08T18:14:34.906634] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-08T18:14:34.906789] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-08T18:14:34.906831] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-08T18:14:34.906871] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-08T18:14:34.906903] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-08T18:14:35.222829] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-08T18:14:35.292318] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:35.943543] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T18:14:35.965988] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T18:14:36.017518] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-08T18:14:36.817554] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-08T18:14:37.158592] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:14:37.159133] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-08T18:14:37.159256] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:14:37.159305] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-08T18:14:37.159341] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:14:37.159412] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-08T18:14:37.159516] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-08T18:14:37.159574] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-08T18:14:37.159636] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-08T18:14:37.159741] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSW took 2.5s. Estimated remaining: 4h 12m 48s. Rate: 7.2 symbols/min [2025-10-08T18:14:37.347802] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:37.380505] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T18:14:37.398009] [DEBUG] [LOCAL ] CTBB: Loaded 7035 existing records from primary storage. [2025-10-08T18:14:37.398360] [INFO ] [MAIN ] CTBB: Loaded 7035 existing records. [2025-10-08T18:14:37.590515] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:37.590807] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-08T18:14:37.590859] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-08T18:14:37.591254] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-08T18:14:37.591546] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-08T18:14:37.623604] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-08T18:14:37.976284] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:38.417615] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-08T18:14:39.154302] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:14:39.158180] [INFO ] [REMOTE ] CSTM: Full fetch complete (69358 records). [2025-10-08T18:14:39.158383] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-08T18:14:39.221896] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-08T18:14:39.339892] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T18:14:39.583955] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-08T18:14:39.584047] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-08T18:14:39.584916] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-08T18:14:39.584982] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-08T18:14:39.586407] [DEBUG] [LOCAL ] CSTM: Trimmed 69358 records to 47541 (keeping 200 days of data) [2025-10-08T18:14:39.866245] [DEBUG] [LOCAL ] CSTM: Primary data saved (47541 records). [2025-10-08T18:14:39.866355] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-08T18:14:39.866443] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSTM took 34.5s. Estimated remaining: 4h 12m 21s. Rate: 7.3 symbols/min [2025-10-08T18:14:40.036404] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-08T18:14:40.039913] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:40.049095] [DEBUG] [LOCAL ] CTDD: Loaded 5824 existing records from primary storage. [2025-10-08T18:14:40.049303] [INFO ] [MAIN ] CTDD: Loaded 5824 existing records. [2025-10-08T18:14:40.227191] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:40.227455] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-08T18:14:40.227517] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-08T18:14:40.227717] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-08T18:14:40.227773] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-08T18:14:40.409718] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T18:14:40.593497] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:40.817538] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-08T18:14:41.096183] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T18:14:41.097875] [INFO ] [REMOTE ] CSR: Full fetch complete (17756 records). [2025-10-08T18:14:41.097957] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-08T18:14:41.428452] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T18:14:41.563347] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-08T18:14:41.563455] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-08T18:14:41.563994] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-08T18:14:41.564059] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-08T18:14:41.564845] [DEBUG] [LOCAL ] CSR: Trimmed 17756 records to 12972 (keeping 200 days of data) [2025-10-08T18:14:41.628597] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-08T18:14:41.656703] [DEBUG] [LOCAL ] CSR: Primary data saved (12972 records). [2025-10-08T18:14:41.656854] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-08T18:14:41.656993] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSR took 37.0s. Estimated remaining: 4h 11m 51s. Rate: 7.3 symbols/min [2025-10-08T18:14:41.855141] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:41.855348] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-08T18:14:41.855403] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-08T18:14:41.855513] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-08T18:14:41.855554] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-08T18:14:41.855639] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-08T18:14:41.855717] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-08T18:14:42.148593] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T18:14:42.218975] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:42.417495] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-08T18:14:42.731287] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:14:42.731621] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-08T18:14:42.731731] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:14:42.731783] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-08T18:14:42.731844] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:14:42.731916] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-08T18:14:42.731979] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-08T18:14:42.732016] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-08T18:14:42.732056] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-08T18:14:42.732105] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 1.1s. Estimated remaining: 4h 11m 18s. Rate: 7.3 symbols/min [2025-10-08T18:14:42.901873] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:42.902001] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-08T18:14:42.902038] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-08T18:14:42.902147] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-08T18:14:42.902186] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-08T18:14:42.902227] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-08T18:14:42.902258] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-08T18:14:43.224966] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-08T18:14:43.256717] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:43.847345] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T18:14:44.017566] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-08T18:14:44.817559] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-08T18:14:44.922525] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T18:14:45.265938] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T18:14:45.617606] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-08T18:14:46.227539] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T18:14:46.417564] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-08T18:14:47.217554] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-08T18:14:47.301077] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T18:14:47.302519] [INFO ] [REMOTE ] CSV: Full fetch complete (19371 records). [2025-10-08T18:14:47.302590] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-08T18:14:47.425397] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:14:47.465701] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-08T18:14:47.466801] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:14:47.494872] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-08T18:14:47.553533] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:14:47.606488] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-08T18:14:47.622843] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-08T18:14:47.658477] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-08T18:14:47.689016] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-08T18:14:47.697355] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-08T18:14:47.697553] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-08T18:14:47.697496] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEV took 5.0s. Estimated remaining: 4h 10m 59s. Rate: 7.3 symbols/min [2025-10-08T18:14:47.698025] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-08T18:14:47.698101] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-08T18:14:47.704348] [DEBUG] [LOCAL ] CSV: Trimmed 19371 records to 12748 (keeping 200 days of data) [2025-10-08T18:14:47.957095] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:47.986434] [DEBUG] [LOCAL ] CSV: Primary data saved (12748 records). [2025-10-08T18:14:47.995477] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-08T18:14:47.995676] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CSV took 35.9s. Estimated remaining: 4h 10m 24s. Rate: 7.3 symbols/min [2025-10-08T18:14:48.001929] [DEBUG] [LOCAL ] CTO: Loaded 27731 existing records from primary storage. [2025-10-08T18:14:48.025996] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-08T18:14:48.031910] [INFO ] [MAIN ] CTO: Loaded 27731 existing records. [2025-10-08T18:14:48.349341] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:48.383566] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:48.383893] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-08T18:14:48.383942] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-08T18:14:48.384189] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-08T18:14:48.384248] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-08T18:14:48.699702] [DEBUG] [LOCAL ] CTOS: Loaded 36691 existing records from primary storage. [2025-10-08T18:14:48.704135] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T18:14:48.712852] [INFO ] [MAIN ] CTOS: Loaded 36691 existing records. [2025-10-08T18:14:48.827784] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-08T18:14:48.879089] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:48.973005] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:48.973270] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-08T18:14:48.973323] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-08T18:14:48.973628] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-08T18:14:48.973711] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-08T18:14:49.342101] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:49.617559] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-08T18:14:49.637416] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T18:14:50.417593] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-08T18:14:51.132125] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T18:14:51.217563] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-08T18:14:52.017562] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-08T18:14:52.042954] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:14:52.350430] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T18:14:52.700617] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T18:14:52.817580] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-08T18:14:53.617600] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-08T18:14:54.073207] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:14:54.317375] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T18:14:54.417566] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-08T18:14:55.153793] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T18:14:55.217517] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-08T18:14:56.017580] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-08T18:14:56.615760] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:14:56.657522] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:14:56.817551] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-08T18:14:57.442377] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T18:14:57.617579] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-08T18:14:58.225028] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T18:14:58.417617] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-08T18:14:59.217542] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-08T18:14:59.831021] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T18:14:59.922345] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T18:15:00.017595] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-08T18:15:00.817591] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-08T18:15:01.543037] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:15:01.617586] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-08T18:15:01.874767] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T18:15:02.417619] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-08T18:15:03.033373] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T18:15:03.094820] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T18:15:03.096020] [INFO ] [REMOTE ] CTDD: Full fetch complete (8322 records). [2025-10-08T18:15:03.096098] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-08T18:15:03.217849] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-08T18:15:03.534121] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-08T18:15:03.534502] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-08T18:15:03.535046] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-08T18:15:03.535124] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-08T18:15:03.535683] [DEBUG] [LOCAL ] CTDD: Trimmed 8322 records to 5820 (keeping 200 days of data) [2025-10-08T18:15:03.573817] [DEBUG] [LOCAL ] CTDD: Primary data saved (5820 records). [2025-10-08T18:15:03.573977] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-08T18:15:03.574079] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTDD took 23.7s. Estimated remaining: 4h 10m 40s. Rate: 7.3 symbols/min [2025-10-08T18:15:03.751847] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:03.807554] [DEBUG] [LOCAL ] CTRA: Loaded 53646 existing records from primary storage. [2025-10-08T18:15:03.807995] [INFO ] [MAIN ] CTRA: Loaded 53646 existing records. [2025-10-08T18:15:03.989819] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:15:03.990115] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-08T18:15:03.990162] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-08T18:15:03.990794] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-08T18:15:03.990854] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-08T18:15:04.022736] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-08T18:15:04.405507] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:04.708459] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:15:04.723694] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T18:15:04.817712] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-08T18:15:05.617720] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-08T18:15:06.140090] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:15:06.417574] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-08T18:15:07.217605] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-08T18:15:07.652144] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:15:07.914971] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T18:15:07.917787] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-08T18:15:08.017566] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-08T18:15:08.817584] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-08T18:15:09.617583] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-08T18:15:09.988938] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T18:15:10.089882] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T18:15:10.409598] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:15:10.417490] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-08T18:15:11.145028] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:15:11.217580] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-08T18:15:12.017636] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-08T18:15:12.309327] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T18:15:12.817589] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-08T18:15:13.518963] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T18:15:13.520257] [INFO ] [REMOTE ] CTBB: Full fetch complete (10602 records). [2025-10-08T18:15:13.520379] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-08T18:15:13.626140] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-08T18:15:13.757364] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T18:15:13.952021] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-08T18:15:13.952109] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-08T18:15:13.952406] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-08T18:15:13.952446] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-08T18:15:13.952925] [DEBUG] [LOCAL ] CTBB: Trimmed 10602 records to 7044 (keeping 200 days of data) [2025-10-08T18:15:13.997850] [DEBUG] [LOCAL ] CTBB: Primary data saved (7044 records). [2025-10-08T18:15:13.998004] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-08T18:15:13.998097] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTBB took 36.8s. Estimated remaining: 4h 10m 39s. Rate: 7.3 symbols/min [2025-10-08T18:15:14.171578] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:14.220452] [DEBUG] [LOCAL ] CTRE: Loaded 49274 existing records from primary storage. [2025-10-08T18:15:14.220882] [INFO ] [MAIN ] CTRE: Loaded 49274 existing records. [2025-10-08T18:15:14.406268] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:15:14.406516] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-08T18:15:14.406566] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-08T18:15:14.406912] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-08T18:15:14.406973] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-08T18:15:14.422771] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-08T18:15:14.781221] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:14.960408] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T18:15:15.217579] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-08T18:15:16.017688] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-08T18:15:16.306307] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-08T18:15:16.379822] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T18:15:16.817512] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-08T18:15:16.848087] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T18:15:17.617571] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-08T18:15:18.417602] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-08T18:15:18.747416] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T18:15:18.750738] [INFO ] [REMOTE ] CTOS: Full fetch complete (53362 records). [2025-10-08T18:15:18.750900] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-08T18:15:18.751814] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:15:18.751939] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:15:18.751985] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:15:18.752034] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-08T18:15:18.752135] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-08T18:15:18.752189] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-08T18:15:18.752474] [DEBUG] [LOCAL ] CTOS: Deleted derivative data file. [2025-10-08T18:15:18.752602] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTOS took 30.8s. Estimated remaining: 4h 10m 20s. Rate: 7.3 symbols/min [2025-10-08T18:15:18.948126] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:19.021206] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-08T18:15:19.048902] [DEBUG] [LOCAL ] CTRI: Loaded 39307 existing records from primary storage. [2025-10-08T18:15:19.049310] [INFO ] [MAIN ] CTRI: Loaded 39307 existing records. [2025-10-08T18:15:19.221113] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-08T18:15:19.257693] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:15:19.258045] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-08T18:15:19.258105] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-08T18:15:19.258507] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-08T18:15:19.258759] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-08T18:15:19.660285] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:20.017608] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-08T18:15:20.399207] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T18:15:20.726703] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-08T18:15:20.817583] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-08T18:15:20.951828] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T18:15:21.617562] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-08T18:15:22.417538] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-08T18:15:22.474203] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T18:15:23.190718] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T18:15:23.217519] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-08T18:15:23.259211] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T18:15:24.017577] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-08T18:15:24.817605] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-08T18:15:24.940541] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:15:24.987912] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T18:15:25.617550] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-08T18:15:26.417549] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-08T18:15:26.865696] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-08T18:15:27.217616] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-08T18:15:27.658825] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T18:15:27.690983] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T18:15:28.017619] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-08T18:15:28.561876] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T18:15:28.817550] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-08T18:15:29.617509] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-08T18:15:29.885811] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T18:15:30.102776] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T18:15:30.105715] [INFO ] [REMOTE ] CTO: Full fetch complete (41740 records). [2025-10-08T18:15:30.105827] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-08T18:15:30.429473] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-08T18:15:30.484039] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-08T18:15:30.484336] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-08T18:15:30.484949] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-08T18:15:30.485013] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-08T18:15:30.486148] [DEBUG] [LOCAL ] CTO: Trimmed 41740 records to 27825 (keeping 200 days of data) [2025-10-08T18:15:30.613814] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T18:15:30.681808] [DEBUG] [LOCAL ] CTO: Primary data saved (27825 records). [2025-10-08T18:15:30.681955] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-08T18:15:30.682044] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTO took 43.0s. Estimated remaining: 4h 10m 24s. Rate: 7.3 symbols/min [2025-10-08T18:15:30.854436] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:30.875115] [DEBUG] [LOCAL ] CTS: Loaded 19410 existing records from primary storage. [2025-10-08T18:15:30.875395] [INFO ] [MAIN ] CTS: Loaded 19410 existing records. [2025-10-08T18:15:31.056544] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:15:31.056819] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-08T18:15:31.056872] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-08T18:15:31.057133] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-08T18:15:31.057193] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-08T18:15:31.221105] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-08T18:15:31.430068] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:32.017510] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-08T18:15:32.433147] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T18:15:32.817568] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-08T18:15:33.012734] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:15:33.299194] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T18:15:33.617574] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-08T18:15:33.954782] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T18:15:34.417529] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-08T18:15:34.547198] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:15:35.217568] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-08T18:15:35.894337] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:15:36.017570] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-08T18:15:36.817565] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-08T18:15:37.080918] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T18:15:37.622735] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-08T18:15:37.648595] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:15:37.659554] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T18:15:38.417593] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-08T18:15:39.069792] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T18:15:39.217568] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-08T18:15:40.017519] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-08T18:15:40.285409] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T18:15:40.293190] [INFO ] [REMOTE ] CTRA: Full fetch complete (77661 records). [2025-10-08T18:15:40.293381] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-08T18:15:40.699011] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-08T18:15:40.699286] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-08T18:15:40.700243] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-08T18:15:40.700552] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-08T18:15:40.730848] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T18:15:40.740093] [DEBUG] [LOCAL ] CTRA: Trimmed 77661 records to 53646 (keeping 200 days of data) [2025-10-08T18:15:40.816491] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T18:15:40.821104] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-08T18:15:41.104456] [DEBUG] [LOCAL ] CTRA: Primary data saved (53646 records). [2025-10-08T18:15:41.104673] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-08T18:15:41.104797] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 37.5s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-08T18:15:41.272761] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:41.272950] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-08T18:15:41.272987] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-08T18:15:41.273099] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-08T18:15:41.273141] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-08T18:15:41.273182] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-08T18:15:41.273215] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-08T18:15:41.620950] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-08T18:15:41.624574] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:42.422764] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-08T18:15:42.445905] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T18:15:43.217574] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-08T18:15:43.553058] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T18:15:43.765793] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T18:15:44.017546] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-08T18:15:44.615748] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T18:15:44.817579] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-08T18:15:45.561962] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:15:45.617497] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-08T18:15:46.311408] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T18:15:46.315599] [INFO ] [REMOTE ] CTRI: Full fetch complete (52513 records). [2025-10-08T18:15:46.315785] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-08T18:15:46.423099] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-08T18:15:46.712815] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-08T18:15:46.712925] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-08T18:15:46.713581] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-08T18:15:46.713631] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-08T18:15:46.714999] [DEBUG] [LOCAL ] CTRI: Trimmed 52513 records to 39419 (keeping 200 days of data) [2025-10-08T18:15:46.988817] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T18:15:47.006253] [DEBUG] [LOCAL ] CTRI: Primary data saved (39419 records). [2025-10-08T18:15:47.006436] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-08T18:15:47.007412] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRI took 28.3s. Estimated remaining: 4h 10m 7s. Rate: 7.3 symbols/min [2025-10-08T18:15:47.179241] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:47.179442] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-08T18:15:47.179479] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-08T18:15:47.179599] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-08T18:15:47.179638] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-08T18:15:47.179728] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-08T18:15:47.179779] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-08T18:15:47.223022] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-08T18:15:47.538370] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:48.017542] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-08T18:15:48.066707] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T18:15:48.123463] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T18:15:48.817551] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-08T18:15:49.617557] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-08T18:15:49.759813] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T18:15:50.417523] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-08T18:15:50.539772] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:15:50.560338] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T18:15:51.217571] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-08T18:15:51.937539] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T18:15:52.017533] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-08T18:15:52.406456] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:15:52.817572] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-08T18:15:53.617536] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-08T18:15:53.781098] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T18:15:54.112604] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-08T18:15:54.241212] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T18:15:54.417570] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-08T18:15:54.753120] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T18:15:55.217573] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-08T18:15:56.017582] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-08T18:15:56.345435] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T18:15:56.817582] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-08T18:15:57.617639] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-08T18:15:57.748972] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-08T18:15:58.417523] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-08T18:15:58.533223] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:15:58.788151] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T18:15:59.217577] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-08T18:16:00.010080] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:16:00.015159] [INFO ] [REMOTE ] CTRE: Full fetch complete (71183 records). [2025-10-08T18:16:00.015532] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-08T18:16:00.017591] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-08T18:16:00.438903] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T18:16:00.470683] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T18:16:00.471065] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-08T18:16:00.472152] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-08T18:16:00.473343] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-08T18:16:00.473416] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-08T18:16:00.475402] [DEBUG] [LOCAL ] CTRE: Trimmed 71183 records to 49289 (keeping 200 days of data) [2025-10-08T18:16:00.769721] [DEBUG] [LOCAL ] CTRE: Primary data saved (49289 records). [2025-10-08T18:16:00.769856] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-08T18:16:00.769961] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRE took 46.8s. Estimated remaining: 4h 10m 16s. Rate: 7.3 symbols/min [2025-10-08T18:16:00.822785] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-08T18:16:00.940117] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:00.992202] [DEBUG] [LOCAL ] CUBE: Loaded 50776 existing records from primary storage. [2025-10-08T18:16:00.992543] [INFO ] [MAIN ] CUBE: Loaded 50776 existing records. [2025-10-08T18:16:01.172148] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:01.172395] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-08T18:16:01.172455] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-08T18:16:01.172915] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-08T18:16:01.172977] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-08T18:16:01.521774] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:01.617501] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-08T18:16:01.746741] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T18:16:01.748605] [INFO ] [REMOTE ] CTS: Full fetch complete (26666 records). [2025-10-08T18:16:01.748732] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-08T18:16:01.749299] [FATAL] [VALIDATOR ] CTS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:16:01.749396] [FATAL] [MAIN ] CTS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:16:01.749550] [WARN ] [MAIN ] CTS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:16:01.749630] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-08T18:16:01.749748] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-08T18:16:01.749806] [INFO ] [LOCAL ] CTS: Starting deletion of derivative data. [2025-10-08T18:16:01.750035] [DEBUG] [LOCAL ] CTS: Deleted derivative data file. [2025-10-08T18:16:01.750141] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTS took 31.1s. Estimated remaining: 4h 9m 44s. Rate: 7.3 symbols/min [2025-10-08T18:16:01.977370] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:02.006489] [DEBUG] [LOCAL ] CUBI: Loaded 27078 existing records from primary storage. [2025-10-08T18:16:02.006902] [INFO ] [MAIN ] CUBI: Loaded 27078 existing records. [2025-10-08T18:16:02.241885] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:02.242160] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-08T18:16:02.242220] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-08T18:16:02.242491] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-08T18:16:02.242558] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-08T18:16:02.429325] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-08T18:16:02.657084] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:03.217623] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-08T18:16:03.357076] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T18:16:04.017530] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-08T18:16:04.144871] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T18:16:04.327489] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T18:16:04.817595] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-08T18:16:05.241200] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T18:16:05.534667] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T18:16:05.617606] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-08T18:16:06.417630] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-08T18:16:07.217557] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-08T18:16:07.359372] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T18:16:07.557020] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T18:16:07.700612] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T18:16:08.017545] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-08T18:16:08.817622] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-08T18:16:09.599968] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T18:16:09.617491] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-08T18:16:09.635314] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T18:16:10.417552] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-08T18:16:10.687663] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T18:16:11.107689] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:16:11.217535] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-08T18:16:12.017558] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-08T18:16:12.817535] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-08T18:16:13.097700] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:16:13.581637] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T18:16:13.617502] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-08T18:16:13.635363] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T18:16:14.417551] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-08T18:16:14.696158] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-08T18:16:15.217628] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-08T18:16:15.402666] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:16:16.017601] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-08T18:16:16.755615] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T18:16:16.817541] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-08T18:16:17.617617] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-08T18:16:17.902613] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T18:16:17.975580] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:16:18.417586] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-08T18:16:18.603224] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T18:16:19.217574] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-08T18:16:20.017633] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-08T18:16:20.046805] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T18:16:20.050862] [INFO ] [REMOTE ] CTVA: Full fetch complete (76607 records). [2025-10-08T18:16:20.051042] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-08T18:16:20.052105] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:16:20.052207] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:16:20.052254] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:16:20.052325] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-08T18:16:20.052410] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-08T18:16:20.052468] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-08T18:16:20.052530] [DEBUG] [LOCAL ] CTVA: No derivative data file found to delete. [2025-10-08T18:16:20.052637] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTVA took 38.9s. Estimated remaining: 4h 10m 9s. Rate: 7.3 symbols/min [2025-10-08T18:16:20.243749] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:20.296740] [DEBUG] [LOCAL ] CUK: Loaded 50976 existing records from primary storage. [2025-10-08T18:16:20.297134] [INFO ] [MAIN ] CUK: Loaded 50976 existing records. [2025-10-08T18:16:20.515663] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:20.516040] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-08T18:16:20.516101] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-08T18:16:20.516781] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-08T18:16:20.516876] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-08T18:16:20.818678] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-08T18:16:20.892674] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:20.925264] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:16:21.079597] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T18:16:21.248487] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T18:16:21.617559] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-08T18:16:22.417578] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-08T18:16:22.486617] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T18:16:22.808286] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T18:16:22.809079] [INFO ] [REMOTE ] CUBB: Full fetch complete (926 records). [2025-10-08T18:16:22.809154] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-08T18:16:23.024447] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-08T18:16:23.024736] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:16:23.024798] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:16:23.024842] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-08T18:16:23.024911] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-08T18:16:23.024970] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-08T18:16:23.025015] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-08T18:16:23.025072] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CUBB took 36.0s. Estimated remaining: 4h 9m 43s. Rate: 7.3 symbols/min [2025-10-08T18:16:23.207159] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:23.214952] [DEBUG] [LOCAL ] CULP: Loaded 2898 existing records from primary storage. [2025-10-08T18:16:23.215190] [INFO ] [MAIN ] CULP: Loaded 2898 existing records. [2025-10-08T18:16:23.226055] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-08T18:16:23.401026] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:23.401254] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-08T18:16:23.401302] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-08T18:16:23.401513] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-08T18:16:23.401573] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-08T18:16:23.762744] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:24.017603] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-08T18:16:24.629257] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T18:16:24.817591] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-08T18:16:25.592298] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T18:16:25.617493] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-08T18:16:25.883437] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T18:16:26.190426] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T18:16:26.417609] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-08T18:16:27.217564] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-08T18:16:27.592986] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-08T18:16:27.859969] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T18:16:28.017553] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-08T18:16:28.817613] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-08T18:16:29.617576] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-08T18:16:29.898169] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-08T18:16:30.098352] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T18:16:30.417557] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-08T18:16:31.217530] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-08T18:16:31.277465] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T18:16:31.673249] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T18:16:31.896922] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T18:16:32.017602] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-08T18:16:32.498294] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T18:16:32.817613] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-08T18:16:33.617623] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-08T18:16:34.417519] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-08T18:16:34.857538] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-08T18:16:34.877076] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:16:34.880155] [INFO ] [REMOTE ] CUBI: Full fetch complete (39093 records). [2025-10-08T18:16:34.880268] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-08T18:16:35.222811] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-08T18:16:35.295832] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-08T18:16:35.296128] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-08T18:16:35.296824] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-08T18:16:35.296920] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-08T18:16:35.298111] [DEBUG] [LOCAL ] CUBI: Trimmed 39093 records to 26977 (keeping 200 days of data) [2025-10-08T18:16:35.455838] [DEBUG] [LOCAL ] CUBI: Primary data saved (26977 records). [2025-10-08T18:16:35.455989] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-08T18:16:35.456075] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBI took 33.7s. Estimated remaining: 4h 9m 49s. Rate: 7.3 symbols/min [2025-10-08T18:16:35.631127] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:35.664216] [DEBUG] [LOCAL ] CURB: Loaded 32683 existing records from primary storage. [2025-10-08T18:16:35.664519] [INFO ] [MAIN ] CURB: Loaded 32683 existing records. [2025-10-08T18:16:35.845903] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:35.846609] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-08T18:16:35.846723] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-08T18:16:35.847520] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-08T18:16:35.847679] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-08T18:16:36.042366] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T18:16:36.038607] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-08T18:16:36.311151] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:36.641498] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:16:36.817578] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-08T18:16:37.312107] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T18:16:37.353089] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T18:16:37.617710] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-08T18:16:38.135871] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T18:16:38.417589] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-08T18:16:39.217613] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-08T18:16:39.621880] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-08T18:16:39.891165] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:16:40.017580] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-08T18:16:40.817520] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-08T18:16:41.617552] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-08T18:16:41.922357] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T18:16:41.926722] [INFO ] [REMOTE ] CUBE: Full fetch complete (73068 records). [2025-10-08T18:16:41.926851] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-08T18:16:42.259286] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T18:16:42.358124] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-08T18:16:42.358204] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-08T18:16:42.359010] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-08T18:16:42.359075] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-08T18:16:42.360556] [DEBUG] [LOCAL ] CUBE: Trimmed 73068 records to 50778 (keeping 200 days of data) [2025-10-08T18:16:42.422054] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-08T18:16:42.675275] [DEBUG] [LOCAL ] CUBE: Primary data saved (50778 records). [2025-10-08T18:16:42.675417] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-08T18:16:42.675503] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBE took 41.9s. Estimated remaining: 4h 9m 37s. Rate: 7.3 symbols/min [2025-10-08T18:16:43.217523] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-08T18:16:43.435616] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T18:16:43.757604] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:16:43.845113] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T18:16:44.017582] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-08T18:16:44.817592] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-08T18:16:45.617529] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-08T18:16:45.962393] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T18:16:46.072691] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T18:16:46.083225] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T18:16:46.083978] [INFO ] [REMOTE ] CULP: Full fetch complete (4618 records). [2025-10-08T18:16:46.084048] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-08T18:16:46.419872] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-08T18:16:46.447334] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-08T18:16:46.447425] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-08T18:16:46.447590] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-08T18:16:46.447630] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-08T18:16:46.448137] [DEBUG] [LOCAL ] CULP: Trimmed 4618 records to 2885 (keeping 200 days of data) [2025-10-08T18:16:46.467025] [DEBUG] [LOCAL ] CULP: Primary data saved (2885 records). [2025-10-08T18:16:46.467171] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-08T18:16:46.467264] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CULP took 23.4s. Estimated remaining: 4h 9m 14s. Rate: 7.3 symbols/min [2025-10-08T18:16:47.217587] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-08T18:16:48.399770] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-08T18:16:48.412711] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-08T18:16:48.819944] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:16:48.828230] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-08T18:16:50.139200] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T18:16:50.161591] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-08T18:16:50.181326] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T18:16:50.417616] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-08T18:16:51.746149] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:16:51.756893] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-08T18:16:51.824286] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T18:16:52.017563] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-08T18:16:53.204116] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T18:16:53.211588] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-08T18:16:53.419084] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T18:16:53.423400] [INFO ] [REMOTE ] CUK: Full fetch complete (74073 records). [2025-10-08T18:16:53.423562] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-08T18:16:53.847519] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-08T18:16:53.847610] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-08T18:16:53.848543] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-08T18:16:53.848612] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-08T18:16:53.850122] [DEBUG] [LOCAL ] CUK: Trimmed 74073 records to 50970 (keeping 200 days of data) [2025-10-08T18:16:54.166171] [DEBUG] [LOCAL ] CUK: Primary data saved (50970 records). [2025-10-08T18:16:54.166318] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-08T18:16:54.166404] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CUK took 34.1s. Estimated remaining: 4h 9m 4s. Rate: 7.3 symbols/min [2025-10-08T18:16:54.570217] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T18:16:54.578095] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-08T18:16:55.966871] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:16:55.974958] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-08T18:16:57.287507] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T18:16:57.290624] [INFO ] [REMOTE ] CURB: Full fetch complete (47293 records). [2025-10-08T18:16:57.290808] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-08T18:16:57.674203] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-08T18:16:57.674412] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-08T18:16:57.675046] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-08T18:16:57.675107] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-08T18:16:57.676162] [DEBUG] [LOCAL ] CURB: Trimmed 47293 records to 32646 (keeping 200 days of data) [2025-10-08T18:16:57.875187] [DEBUG] [LOCAL ] CURB: Primary data saved (32646 records). [2025-10-08T18:16:57.875338] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-08T18:16:57.875424] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CURB took 22.4s. Estimated remaining: 4h 8m 41s. Rate: 7.3 symbols/min [2025-10-08T18:16:58.567324] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:58.591754] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:58.554784] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:58.618337] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:58.618906] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-10-08T18:16:58.619377] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-10-08T18:16:58.619479] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-08T18:16:58.619522] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-08T18:16:58.619563] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-08T18:16:58.619594] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-08T18:16:58.733699] [DEBUG] [LOCAL ] CVEO: Loaded 15232 existing records from primary storage. [2025-10-08T18:16:58.745266] [INFO ] [MAIN ] CVEO: Loaded 15232 existing records. [2025-10-08T18:16:59.154835] [DEBUG] [LOCAL ] CUZ: Loaded 49405 existing records from primary storage. [2025-10-08T18:16:59.155841] [DEBUG] [LOCAL ] CVE: Loaded 53559 existing records from primary storage. [2025-10-08T18:16:59.196082] [INFO ] [MAIN ] CUZ: Loaded 49405 existing records. [2025-10-08T18:16:59.264784] [INFO ] [MAIN ] CVE: Loaded 53559 existing records. [2025-10-08T18:16:59.248601] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:59.316414] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-08T18:16:59.389239] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-08T18:16:59.479778] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-08T18:16:59.530533] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:59.531109] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-08T18:16:59.530820] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-08T18:16:59.733809] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:59.776287] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-08T18:16:59.767443] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:59.787888] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-08T18:16:59.788087] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-08T18:16:59.793312] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-08T18:16:59.804220] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-08T18:16:59.814510] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-08T18:16:59.814455] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-08T18:16:59.814723] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-08T18:17:00.602334] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:00.640326] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-08T18:17:00.840190] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:00.844506] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:00.844809] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-08T18:17:00.845862] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-08T18:17:01.190013] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T18:17:01.203325] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-08T18:17:01.871865] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T18:17:01.874615] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-08T18:17:02.257209] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:17:02.267139] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-08T18:17:02.396614] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:17:02.402846] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-08T18:17:02.782239] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T18:17:02.785463] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-08T18:17:02.815482] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T18:17:02.826906] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-08T18:17:03.102635] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T18:17:03.217523] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-08T18:17:03.427022] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T18:17:03.446035] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T18:17:04.017497] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-08T18:17:04.334014] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T18:17:04.359412] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T18:17:04.716430] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T18:17:04.817522] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-08T18:17:05.524691] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T18:17:05.617571] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-08T18:17:06.417567] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-08T18:17:06.741048] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T18:17:07.217520] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-08T18:17:07.544354] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T18:17:07.841357] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T18:17:08.017556] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-08T18:17:08.817583] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-08T18:17:09.617530] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-08T18:17:09.807952] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T18:17:10.387619] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T18:17:10.417855] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-08T18:17:10.421323] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T18:17:11.217581] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-08T18:17:11.450332] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T18:17:12.017556] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-08T18:17:12.817570] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-08T18:17:13.159288] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T18:17:13.476965] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T18:17:13.617557] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-08T18:17:14.417503] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-08T18:17:14.576320] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:17:14.714700] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T18:17:15.217627] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-08T18:17:15.732826] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T18:17:15.773515] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T18:17:16.017598] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-08T18:17:16.817558] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-08T18:17:17.429258] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T18:17:17.617546] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-08T18:17:18.354041] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T18:17:18.417494] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-08T18:17:19.110939] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:17:19.217548] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-08T18:17:20.017546] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-08T18:17:20.292504] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:17:20.542981] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T18:17:20.545793] [INFO ] [REMOTE ] CURV: Full fetch complete (38860 records). [2025-10-08T18:17:20.545887] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-08T18:17:20.823435] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-08T18:17:20.943188] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-08T18:17:20.943269] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-08T18:17:20.943891] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-08T18:17:20.943955] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-08T18:17:20.944846] [DEBUG] [LOCAL ] CURV: Trimmed 38860 records to 26786 (keeping 200 days of data) [2025-10-08T18:17:21.093804] [DEBUG] [LOCAL ] CURV: Primary data saved (26786 records). [2025-10-08T18:17:21.093946] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-08T18:17:21.094024] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CURV took 23.2s. Estimated remaining: 4h 9m 22s. Rate: 7.3 symbols/min [2025-10-08T18:17:21.261407] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:21.304469] [DEBUG] [LOCAL ] CVI: Loaded 46516 existing records from primary storage. [2025-10-08T18:17:21.304833] [INFO ] [MAIN ] CVI: Loaded 46516 existing records. [2025-10-08T18:17:21.484334] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:17:21.484588] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-08T18:17:21.484633] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-08T18:17:21.485227] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-08T18:17:21.485285] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-08T18:17:21.625009] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-08T18:17:21.853566] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:21.859708] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:17:21.892610] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:17:22.417601] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-08T18:17:23.155991] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:17:23.217504] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-08T18:17:24.017551] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-08T18:17:24.034161] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T18:17:24.035790] [INFO ] [REMOTE ] CVEO: Full fetch complete (20497 records). [2025-10-08T18:17:24.035863] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-08T18:17:24.440866] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-08T18:17:24.491837] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-08T18:17:24.491919] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-08T18:17:24.492338] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-08T18:17:24.492399] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-08T18:17:24.495463] [DEBUG] [LOCAL ] CVEO: Trimmed 20497 records to 15261 (keeping 200 days of data) [2025-10-08T18:17:24.585955] [DEBUG] [LOCAL ] CVEO: Primary data saved (15261 records). [2025-10-08T18:17:24.586105] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-08T18:17:24.586188] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CVEO took 26.7s. Estimated remaining: 4h 8m 58s. Rate: 7.3 symbols/min [2025-10-08T18:17:24.769322] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:24.786764] [DEBUG] [LOCAL ] CVLG: Loaded 15491 existing records from primary storage. [2025-10-08T18:17:24.787036] [INFO ] [MAIN ] CVLG: Loaded 15491 existing records. [2025-10-08T18:17:24.824525] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-08T18:17:24.979279] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:17:24.979539] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-08T18:17:24.979586] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-08T18:17:24.979814] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-08T18:17:24.979872] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-08T18:17:25.366508] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:25.617508] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-08T18:17:25.752908] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T18:17:26.417609] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-08T18:17:26.920745] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-08T18:17:27.217562] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-08T18:17:27.714005] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T18:17:28.017610] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-08T18:17:28.817551] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-08T18:17:29.247133] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T18:17:29.283570] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T18:17:29.617529] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-08T18:17:30.012238] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T18:17:30.417566] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-08T18:17:30.907263] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (5.29 seconds). [2025-10-08T18:17:31.124935] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T18:17:31.217582] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-08T18:17:32.017551] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-08T18:17:32.317725] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T18:17:32.820517] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-08T18:17:32.856149] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:17:32.856927] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T18:17:33.617542] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-08T18:17:34.310928] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T18:17:34.316877] [INFO ] [REMOTE ] CVE: Full fetch complete (77171 records). [2025-10-08T18:17:34.317295] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-08T18:17:34.319601] [FATAL] [VALIDATOR ] CVE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:17:34.319764] [FATAL] [MAIN ] CVE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:17:34.319810] [WARN ] [MAIN ] CVE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:17:34.319882] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-08T18:17:34.319954] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-08T18:17:34.319994] [INFO ] [LOCAL ] CVE: Starting deletion of derivative data. [2025-10-08T18:17:34.320209] [DEBUG] [LOCAL ] CVE: Deleted derivative data file. [2025-10-08T18:17:34.322182] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CVE took 36.4s. Estimated remaining: 4h 8m 54s. Rate: 7.3 symbols/min [2025-10-08T18:17:34.425179] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-08T18:17:34.472317] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T18:17:34.534737] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:34.534950] [DEBUG] [LOCAL ] CVNA: No existing data file found in primary storage. [2025-10-08T18:17:34.535005] [WARN ] [MAIN ] CVNA: No existing data found, performing full refresh instead. [2025-10-08T18:17:34.535120] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-08T18:17:34.535162] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-08T18:17:34.535202] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-08T18:17:34.535234] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-08T18:17:34.888752] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:35.217590] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-08T18:17:36.006198] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:17:36.017561] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-08T18:17:36.078449] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T18:17:36.817538] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-08T18:17:37.617589] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-08T18:17:37.865501] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:17:38.417609] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-08T18:17:38.698835] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T18:17:38.980792] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:17:38.984849] [INFO ] [REMOTE ] CUZ: Full fetch complete (70764 records). [2025-10-08T18:17:38.985042] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-08T18:17:39.224101] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-08T18:17:39.436408] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-08T18:17:39.436304] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T18:17:39.442003] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-08T18:17:39.443341] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-08T18:17:39.443424] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-08T18:17:39.444988] [DEBUG] [LOCAL ] CUZ: Trimmed 70764 records to 49428 (keeping 200 days of data) [2025-10-08T18:17:39.760724] [DEBUG] [LOCAL ] CUZ: Primary data saved (49428 records). [2025-10-08T18:17:39.760888] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-08T18:17:39.761018] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CUZ took 41.9s. Estimated remaining: 4h 8m 37s. Rate: 7.3 symbols/min [2025-10-08T18:17:39.935222] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:39.990937] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-08T18:17:39.991331] [INFO ] [MAIN ] CVS: Loaded 53696 existing records. [2025-10-08T18:17:40.022779] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-08T18:17:40.194402] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:17:40.194677] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-08T18:17:40.194737] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-08T18:17:40.195205] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-08T18:17:40.195265] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-08T18:17:40.584348] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:40.817572] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-08T18:17:41.452843] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-08T18:17:41.521500] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T18:17:41.617521] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-08T18:17:41.916549] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T18:17:42.417624] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-08T18:17:43.217611] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-08T18:17:43.776156] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T18:17:43.854840] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T18:17:44.017586] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-08T18:17:44.817542] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-08T18:17:45.617532] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-08T18:17:45.689035] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T18:17:45.797960] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T18:17:46.340606] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-08T18:17:46.417578] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-08T18:17:46.880579] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T18:17:47.067302] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T18:17:47.217564] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-08T18:17:48.017526] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-08T18:17:48.067753] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T18:17:48.817541] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-08T18:17:49.455240] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T18:17:49.617544] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-08T18:17:50.151582] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-08T18:17:50.229938] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T18:17:50.232177] [INFO ] [REMOTE ] CVLG: Full fetch complete (21121 records). [2025-10-08T18:17:50.232275] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-08T18:17:50.427453] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-08T18:17:50.626105] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-08T18:17:50.626214] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-08T18:17:50.626716] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-08T18:17:50.626778] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-08T18:17:50.627377] [DEBUG] [LOCAL ] CVLG: Trimmed 21121 records to 15513 (keeping 200 days of data) [2025-10-08T18:17:50.722115] [DEBUG] [LOCAL ] CVLG: Primary data saved (15513 records). [2025-10-08T18:17:50.722270] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-08T18:17:50.722359] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 26.1s. Estimated remaining: 4h 8m 38s. Rate: 7.3 symbols/min [2025-10-08T18:17:50.917467] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:50.917693] [DEBUG] [LOCAL ] CVX: No existing data file found in primary storage. [2025-10-08T18:17:50.917746] [WARN ] [MAIN ] CVX: No existing data found, performing full refresh instead. [2025-10-08T18:17:50.917861] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-08T18:17:50.917904] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-08T18:17:50.917945] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-08T18:17:50.917977] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-08T18:17:51.222606] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-08T18:17:51.325521] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:52.017558] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-08T18:17:52.778969] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-08T18:17:52.825444] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-08T18:17:52.834026] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T18:17:53.617547] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-08T18:17:54.149608] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-08T18:17:54.417636] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-08T18:17:54.703087] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:17:54.878375] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T18:17:55.217579] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-08T18:17:56.017568] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-08T18:17:56.215157] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:17:56.817597] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-08T18:17:57.268270] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-08T18:17:57.623057] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-08T18:17:57.632314] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T18:17:57.636278] [INFO ] [REMOTE ] CVI: Full fetch complete (67342 records). [2025-10-08T18:17:57.636831] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-08T18:17:58.094253] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-08T18:17:58.094370] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-08T18:17:58.095449] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-08T18:17:58.095524] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-08T18:17:58.098027] [DEBUG] [LOCAL ] CVI: Trimmed 67342 records to 46541 (keeping 200 days of data) [2025-10-08T18:17:58.418089] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-08T18:17:58.510605] [DEBUG] [LOCAL ] CVI: Primary data saved (46541 records). [2025-10-08T18:17:58.510859] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-08T18:17:58.511014] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 37.4s. Estimated remaining: 4h 8m 28s. Rate: 7.3 symbols/min [2025-10-08T18:17:58.771363] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:58.809132] [DEBUG] [LOCAL ] CW: Loaded 22229 existing records from primary storage. [2025-10-08T18:17:58.809511] [INFO ] [MAIN ] CW: Loaded 22229 existing records. [2025-10-08T18:17:58.973362] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T18:17:59.090859] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:17:59.091111] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-08T18:17:59.091173] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-08T18:17:59.091501] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-08T18:17:59.091560] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-08T18:17:59.223008] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-08T18:17:59.462358] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:59.995745] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-08T18:18:00.017506] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-08T18:18:00.813590] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-08T18:18:00.825066] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-08T18:18:01.612201] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-08T18:18:01.623323] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-08T18:18:01.895597] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T18:18:02.267408] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:18:02.417554] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-08T18:18:03.217597] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-08T18:18:03.489413] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T18:18:03.744595] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T18:18:04.017568] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-08T18:18:04.817543] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-08T18:18:05.103757] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T18:18:05.181964] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T18:18:05.617614] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-08T18:18:06.417635] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-08T18:18:07.218014] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-08T18:18:07.435768] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-08T18:18:07.639531] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T18:18:07.862546] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-08T18:18:08.017560] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-08T18:18:08.817558] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-08T18:18:09.047935] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T18:18:09.079986] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T18:18:09.617561] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-08T18:18:10.417571] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-08T18:18:10.723835] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T18:18:10.916379] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T18:18:11.217557] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-08T18:18:12.017538] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-08T18:18:12.058791] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:18:12.817553] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-08T18:18:13.242174] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T18:18:13.247241] [INFO ] [REMOTE ] CVNA: Full fetch complete (76657 records). [2025-10-08T18:18:13.247485] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-08T18:18:13.622828] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-08T18:18:13.674045] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-08T18:18:13.674153] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-08T18:18:13.675224] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-08T18:18:13.675304] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-08T18:18:13.676919] [DEBUG] [LOCAL ] CVNA: Trimmed 76657 records to 52896 (keeping 200 days of data) [2025-10-08T18:18:13.993921] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T18:18:14.042130] [DEBUG] [LOCAL ] CVNA: Primary data saved (52896 records). [2025-10-08T18:18:14.042336] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-08T18:18:14.042527] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVNA took 39.7s. Estimated remaining: 4h 8m 43s. Rate: 7.3 symbols/min [2025-10-08T18:18:14.251857] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:14.254754] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-08T18:18:14.319983] [DEBUG] [LOCAL ] CWAN: Loaded 52446 existing records from primary storage. [2025-10-08T18:18:14.320344] [INFO ] [MAIN ] CWAN: Loaded 52446 existing records. [2025-10-08T18:18:14.418487] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-08T18:18:14.499920] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:14.500145] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-08T18:18:14.500194] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-08T18:18:14.500722] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-08T18:18:14.500781] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-08T18:18:14.901178] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:15.217540] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-08T18:18:15.298899] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T18:18:15.751776] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-08T18:18:16.017549] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-08T18:18:16.533486] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:18:16.537995] [INFO ] [REMOTE ] CVS: Full fetch complete (77811 records). [2025-10-08T18:18:16.538125] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-08T18:18:16.822682] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-08T18:18:16.954395] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-08T18:18:16.954606] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-08T18:18:16.955676] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-08T18:18:16.955847] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-08T18:18:16.957733] [DEBUG] [LOCAL ] CVS: Trimmed 77811 records to 53694 (keeping 200 days of data) [2025-10-08T18:18:17.087216] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T18:18:17.343747] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-08T18:18:17.343900] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-08T18:18:17.344684] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVS took 37.6s. Estimated remaining: 4h 8m 19s. Rate: 7.3 symbols/min [2025-10-08T18:18:17.516951] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:17.576363] [DEBUG] [LOCAL ] CWEN: Loaded 45224 existing records from primary storage. [2025-10-08T18:18:17.576706] [INFO ] [MAIN ] CWEN: Loaded 45224 existing records. [2025-10-08T18:18:17.629441] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-08T18:18:17.754914] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:17.755143] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-08T18:18:17.755189] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-08T18:18:17.755632] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-08T18:18:17.755763] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-08T18:18:18.070426] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T18:18:18.139543] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:18.417564] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-08T18:18:19.217520] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-08T18:18:19.357059] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:18:20.017590] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-08T18:18:20.075796] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T18:18:20.139357] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T18:18:20.817607] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-08T18:18:21.617561] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-08T18:18:22.219043] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:18:22.417502] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-08T18:18:22.515727] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:18:22.517610] [INFO ] [REMOTE ] CW: Full fetch complete (33122 records). [2025-10-08T18:18:22.517714] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-08T18:18:22.943372] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-08T18:18:22.962380] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-08T18:18:22.962479] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-08T18:18:22.963899] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-08T18:18:22.964019] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-08T18:18:22.965208] [DEBUG] [LOCAL ] CW: Trimmed 33122 records to 22225 (keeping 200 days of data) [2025-10-08T18:18:23.107506] [DEBUG] [LOCAL ] CW: Primary data saved (22225 records). [2025-10-08T18:18:23.107639] [INFO ] [MAIN ] CW: Full history saved. [2025-10-08T18:18:23.107771] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CW took 24.6s. Estimated remaining: 4h 8m 2s. Rate: 7.3 symbols/min [2025-10-08T18:18:23.222631] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-08T18:18:23.287933] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:23.343518] [DEBUG] [LOCAL ] CWH: Loaded 51310 existing records from primary storage. [2025-10-08T18:18:23.343854] [INFO ] [MAIN ] CWH: Loaded 51310 existing records. [2025-10-08T18:18:23.517456] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:23.517742] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-08T18:18:23.517795] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-08T18:18:23.518323] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-08T18:18:23.518381] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-08T18:18:23.876382] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:24.017548] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-08T18:18:24.147506] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T18:18:24.817545] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-08T18:18:25.331245] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T18:18:25.587937] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:18:25.617508] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-08T18:18:26.312343] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:18:26.417539] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-08T18:18:27.048916] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T18:18:27.217560] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-08T18:18:28.017631] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-08T18:18:28.431386] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T18:18:28.817577] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-08T18:18:29.021445] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:18:29.617536] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-08T18:18:29.949813] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T18:18:30.406321] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:18:30.417490] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-08T18:18:30.963848] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T18:18:31.217557] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-08T18:18:32.027440] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-08T18:18:32.030348] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T18:18:32.817517] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-08T18:18:32.897356] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:18:33.189768] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T18:18:33.617567] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-08T18:18:34.417603] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-08T18:18:34.471741] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T18:18:35.217619] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-08T18:18:36.017522] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-08T18:18:36.707314] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:18:36.817508] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-08T18:18:37.833563] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T18:18:37.845214] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-08T18:18:38.229716] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T18:18:38.417513] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-08T18:18:39.693450] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T18:18:39.705955] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-08T18:18:40.107511] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (6.49 seconds). [2025-10-08T18:18:40.125468] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T18:18:40.136239] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-08T18:18:40.817561] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-08T18:18:41.414538] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T18:18:41.617507] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-08T18:18:42.054159] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (7.64 seconds). [2025-10-08T18:18:42.417512] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-08T18:18:42.473433] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-08T18:18:42.538813] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T18:18:42.902698] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T18:18:42.906838] [INFO ] [REMOTE ] CWAN: Full fetch complete (75196 records). [2025-10-08T18:18:42.906989] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-08T18:18:43.222706] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-08T18:18:43.315707] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-08T18:18:43.315808] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-08T18:18:43.316732] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-08T18:18:43.316801] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-08T18:18:43.318377] [DEBUG] [LOCAL ] CWAN: Trimmed 75196 records to 52465 (keeping 200 days of data) [2025-10-08T18:18:43.627826] [DEBUG] [LOCAL ] CWAN: Primary data saved (52465 records). [2025-10-08T18:18:43.627984] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-08T18:18:43.628067] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CWAN took 29.6s. Estimated remaining: 4h 8m 33s. Rate: 7.2 symbols/min [2025-10-08T18:18:43.805039] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:43.853480] [DEBUG] [LOCAL ] CWK: Loaded 49503 existing records from primary storage. [2025-10-08T18:18:43.853863] [INFO ] [MAIN ] CWK: Loaded 49503 existing records. [2025-10-08T18:18:44.036721] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-08T18:18:44.042400] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:44.043627] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-08T18:18:44.043796] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-08T18:18:44.044318] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-08T18:18:44.044377] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-08T18:18:44.355240] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T18:18:44.479424] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:44.678012] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T18:18:44.681578] [INFO ] [REMOTE ] CWEN: Full fetch complete (64645 records). [2025-10-08T18:18:44.681727] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-08T18:18:44.682529] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:18:44.682619] [FATAL] [MAIN ] CWEN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:18:44.682710] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:18:44.682782] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-08T18:18:44.682847] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-08T18:18:44.682881] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-10-08T18:18:44.683063] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-10-08T18:18:44.683156] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 27.3s. Estimated remaining: 4h 8m 2s. Rate: 7.3 symbols/min [2025-10-08T18:18:44.829754] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-08T18:18:44.860497] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:44.860700] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-08T18:18:44.860750] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-08T18:18:44.860858] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-08T18:18:44.860899] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-08T18:18:44.860940] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-08T18:18:44.860972] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-08T18:18:45.208729] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:45.617600] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-08T18:18:46.303713] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-08T18:18:46.308034] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-08T18:18:46.308169] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-08T18:18:46.419351] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-08T18:18:46.652054] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T18:18:46.750481] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T18:18:46.779159] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-08T18:18:46.779222] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-08T18:18:46.780048] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-08T18:18:46.780112] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-08T18:18:46.781537] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-10-08T18:18:47.131678] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-08T18:18:47.131838] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-08T18:18:47.131919] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CVX took 56.4s. Estimated remaining: 4h 7m 35s. Rate: 7.3 symbols/min [2025-10-08T18:18:47.223013] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-08T18:18:47.307366] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:47.356109] [DEBUG] [LOCAL ] CX: Loaded 52822 existing records from primary storage. [2025-10-08T18:18:47.356437] [INFO ] [MAIN ] CX: Loaded 52822 existing records. [2025-10-08T18:18:47.545346] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:47.545589] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-08T18:18:47.545635] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-08T18:18:47.546174] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-08T18:18:47.546232] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-08T18:18:47.923614] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:48.018060] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-08T18:18:48.498308] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T18:18:48.586571] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-08T18:18:48.817576] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-08T18:18:49.620104] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-08T18:18:49.622936] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:18:50.417572] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-08T18:18:50.546679] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:18:51.190298] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:18:51.217629] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-08T18:18:51.261631] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T18:18:52.017563] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-08T18:18:52.817554] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-08T18:18:52.956695] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T18:18:53.034006] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T18:18:53.617568] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-08T18:18:54.337792] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:18:54.417592] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-08T18:18:54.986915] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:18:55.217535] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-08T18:18:56.017549] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-08T18:18:56.135712] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T18:18:56.185132] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T18:18:56.817555] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-08T18:18:57.617544] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-08T18:18:57.922970] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T18:18:58.142879] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:18:58.417592] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-08T18:18:59.030402] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T18:18:59.217554] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-08T18:19:00.009035] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:19:00.018879] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-08T18:19:00.817552] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-08T18:19:01.258801] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-08T18:19:01.262499] [INFO ] [REMOTE ] CWH: Full fetch complete (72698 records). [2025-10-08T18:19:01.262633] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-08T18:19:01.263521] [FATAL] [VALIDATOR ] CWH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:19:01.263615] [FATAL] [MAIN ] CWH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:19:01.263701] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:19:01.263780] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-08T18:19:01.263865] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-08T18:19:01.263923] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-10-08T18:19:01.264187] [DEBUG] [LOCAL ] CWH: Deleted derivative data file. [2025-10-08T18:19:01.264291] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 38.2s. Estimated remaining: 4h 7m 45s. Rate: 7.3 symbols/min [2025-10-08T18:19:01.441012] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:01.449341] [DEBUG] [LOCAL ] CXE: Loaded 6168 existing records from primary storage. [2025-10-08T18:19:01.449716] [INFO ] [MAIN ] CXE: Loaded 6168 existing records. [2025-10-08T18:19:01.627270] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-08T18:19:01.632092] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:01.633319] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-08T18:19:01.633390] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-08T18:19:01.633712] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-08T18:19:01.633878] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-08T18:19:01.717512] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T18:19:02.048754] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:02.417548] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-08T18:19:02.601842] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T18:19:02.992554] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:19:03.221581] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-08T18:19:03.225948] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T18:19:04.017556] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-08T18:19:04.817576] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-08T18:19:04.908623] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T18:19:04.915408] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T18:19:05.617556] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-08T18:19:05.668416] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T18:19:06.204382] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T18:19:06.417559] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-08T18:19:07.217561] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-08T18:19:07.571208] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T18:19:07.573452] [INFO ] [REMOTE ] CWT: Full fetch complete (40447 records). [2025-10-08T18:19:07.573538] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-08T18:19:07.574086] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:19:07.574174] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:19:07.574216] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:19:07.574254] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-08T18:19:07.574312] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-08T18:19:07.574348] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-10-08T18:19:07.574387] [DEBUG] [LOCAL ] CWT: No derivative data file found to delete. [2025-10-08T18:19:07.574439] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWT took 22.9s. Estimated remaining: 4h 7m 31s. Rate: 7.3 symbols/min [2025-10-08T18:19:07.744174] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:07.744384] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-10-08T18:19:07.744440] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-10-08T18:19:07.744554] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-08T18:19:07.744598] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-08T18:19:07.744693] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-10-08T18:19:07.744741] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-08T18:19:08.020003] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-08T18:19:08.099073] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:08.817563] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-08T18:19:08.952818] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T18:19:09.351081] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T18:19:09.584318] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T18:19:09.617513] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-08T18:19:10.417632] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-08T18:19:11.060094] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T18:19:11.162583] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T18:19:11.217579] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-08T18:19:11.896694] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T18:19:12.017556] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-08T18:19:12.817555] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-08T18:19:13.617588] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-08T18:19:14.264185] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-08T18:19:14.330672] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T18:19:14.385785] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T18:19:14.417541] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-08T18:19:15.217585] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-08T18:19:16.017545] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-08T18:19:16.206767] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:19:16.568320] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T18:19:16.817528] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-08T18:19:16.976432] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T18:19:17.617552] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-08T18:19:18.376456] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T18:19:18.417545] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-08T18:19:18.585248] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T18:19:19.217612] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-08T18:19:19.985732] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T18:19:20.017513] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-08T18:19:20.785638] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T18:19:20.789560] [INFO ] [REMOTE ] CWK: Full fetch complete (71047 records). [2025-10-08T18:19:20.789747] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-08T18:19:20.825320] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-08T18:19:21.187636] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-08T18:19:21.187755] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-08T18:19:21.188617] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-08T18:19:21.188758] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-08T18:19:21.190280] [DEBUG] [LOCAL ] CWK: Trimmed 71047 records to 49460 (keeping 200 days of data) [2025-10-08T18:19:21.396701] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T18:19:21.487794] [DEBUG] [LOCAL ] CWK: Primary data saved (49460 records). [2025-10-08T18:19:21.487945] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-08T18:19:21.488031] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWK took 37.9s. Estimated remaining: 4h 7m 40s. Rate: 7.3 symbols/min [2025-10-08T18:19:21.622482] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-08T18:19:21.677222] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:21.721829] [DEBUG] [LOCAL ] CXM: Loaded 47611 existing records from primary storage. [2025-10-08T18:19:21.722189] [INFO ] [MAIN ] CXM: Loaded 47611 existing records. [2025-10-08T18:19:21.898737] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T18:19:21.951211] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:21.951490] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-08T18:19:21.951537] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-08T18:19:21.951998] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-08T18:19:21.952057] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-08T18:19:22.306435] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:22.342325] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T18:19:22.417567] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-08T18:19:23.217573] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-08T18:19:23.586902] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-08T18:19:23.909028] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T18:19:24.017574] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-08T18:19:24.817554] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-08T18:19:25.533953] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-08T18:19:25.567938] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T18:19:25.617549] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-08T18:19:26.417621] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-08T18:19:27.002313] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T18:19:27.003423] [INFO ] [REMOTE ] CXE: Full fetch complete (11700 records). [2025-10-08T18:19:27.003499] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-08T18:19:27.222697] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-08T18:19:27.444569] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T18:19:27.454680] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-08T18:19:27.455877] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-08T18:19:27.456407] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-08T18:19:27.456484] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-08T18:19:27.457206] [DEBUG] [LOCAL ] CXE: Trimmed 11700 records to 6197 (keeping 200 days of data) [2025-10-08T18:19:27.494796] [DEBUG] [LOCAL ] CXE: Primary data saved (6197 records). [2025-10-08T18:19:27.494954] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-08T18:19:27.495045] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CXE took 26.2s. Estimated remaining: 4h 7m 25s. Rate: 7.3 symbols/min [2025-10-08T18:19:27.669506] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:27.705592] [DEBUG] [LOCAL ] CXT: Loaded 30988 existing records from primary storage. [2025-10-08T18:19:27.705953] [INFO ] [MAIN ] CXT: Loaded 30988 existing records. [2025-10-08T18:19:27.889275] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T18:19:27.895311] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:27.897423] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-08T18:19:27.897483] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-08T18:19:27.897828] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-08T18:19:27.897887] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-08T18:19:28.022713] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-08T18:19:28.260622] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:28.817622] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-08T18:19:29.285928] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T18:19:29.584667] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T18:19:29.617533] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-08T18:19:30.417608] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-08T18:19:31.217569] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-08T18:19:31.457062] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T18:19:32.017567] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-08T18:19:32.299711] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T18:19:32.347188] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T18:19:32.817555] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-08T18:19:33.254798] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T18:19:33.617552] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-08T18:19:33.728954] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T18:19:34.417568] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-08T18:19:35.217506] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-08T18:19:35.298117] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:19:35.425875] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T18:19:35.579675] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-08T18:19:36.017689] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-08T18:19:36.817562] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-08T18:19:37.418726] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:19:37.442810] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:19:37.617566] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-08T18:19:38.417561] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-08T18:19:39.022080] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T18:19:39.217530] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-08T18:19:39.748728] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T18:19:40.017635] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-08T18:19:40.132557] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T18:19:40.137428] [INFO ] [REMOTE ] CX: Full fetch complete (76392 records). [2025-10-08T18:19:40.137773] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-08T18:19:40.539907] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-08T18:19:40.540008] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-08T18:19:40.540919] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-08T18:19:40.540990] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-08T18:19:40.542574] [DEBUG] [LOCAL ] CX: Trimmed 76392 records to 52821 (keeping 200 days of data) [2025-10-08T18:19:40.821538] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-08T18:19:40.864599] [DEBUG] [LOCAL ] CX: Primary data saved (52821 records). [2025-10-08T18:19:40.864799] [INFO ] [MAIN ] CX: Full history saved. [2025-10-08T18:19:40.864927] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CX took 53.7s. Estimated remaining: 4h 7m 33s. Rate: 7.2 symbols/min [2025-10-08T18:19:41.047405] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:41.116360] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T18:19:41.124725] [DEBUG] [LOCAL ] CXW: Loaded 43951 existing records from primary storage. [2025-10-08T18:19:41.125544] [INFO ] [MAIN ] CXW: Loaded 43951 existing records. [2025-10-08T18:19:41.305941] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:41.306292] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-08T18:19:41.306382] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-08T18:19:41.313279] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T18:19:41.312580] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-08T18:19:41.315546] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-08T18:19:41.627844] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-08T18:19:41.667808] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:42.417549] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-08T18:19:43.219360] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-08T18:19:43.229777] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T18:19:43.824994] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T18:19:43.888236] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:19:44.017619] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-08T18:19:44.647420] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T18:19:44.817551] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-08T18:19:45.388727] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T18:19:45.389548] [INFO ] [REMOTE ] CXH: Full fetch complete (5401 records). [2025-10-08T18:19:45.389620] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-08T18:19:45.627351] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-08T18:19:45.757016] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-08T18:19:45.757101] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-08T18:19:45.757257] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-08T18:19:45.757314] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-08T18:19:45.757720] [DEBUG] [LOCAL ] CXH: Trimmed 5401 records to 4425 (keeping 200 days of data) [2025-10-08T18:19:45.783285] [DEBUG] [LOCAL ] CXH: Primary data saved (4425 records). [2025-10-08T18:19:45.783449] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-08T18:19:45.783530] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXH took 38.2s. Estimated remaining: 4h 7m 14s. Rate: 7.3 symbols/min [2025-10-08T18:19:45.950514] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:45.985110] [DEBUG] [LOCAL ] CYD: Loaded 26352 existing records from primary storage. [2025-10-08T18:19:45.985480] [INFO ] [MAIN ] CYD: Loaded 26352 existing records. [2025-10-08T18:19:46.162975] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:46.163242] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-08T18:19:46.163303] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-08T18:19:46.163632] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-08T18:19:46.163724] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-08T18:19:46.425366] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-08T18:19:46.513602] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:47.217525] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-08T18:19:47.370406] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:19:48.017521] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-08T18:19:48.133387] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T18:19:48.283771] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T18:19:48.817596] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-08T18:19:49.617537] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-08T18:19:49.741848] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T18:19:50.169897] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:19:50.199431] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T18:19:50.417637] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-08T18:19:51.217577] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-08T18:19:51.805051] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:19:52.017556] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-08T18:19:52.599077] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T18:19:52.817549] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-08T18:19:53.574487] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T18:19:53.579039] [INFO ] [REMOTE ] CXM: Full fetch complete (68662 records). [2025-10-08T18:19:53.579244] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-08T18:19:53.622726] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-08T18:19:54.058326] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-08T18:19:54.058429] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-08T18:19:54.059504] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-08T18:19:54.059599] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-08T18:19:54.061197] [DEBUG] [LOCAL ] CXM: Trimmed 68662 records to 47580 (keeping 200 days of data) [2025-10-08T18:19:54.345554] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T18:19:54.417599] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-08T18:19:54.421317] [DEBUG] [LOCAL ] CXM: Primary data saved (47580 records). [2025-10-08T18:19:54.421405] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-08T18:19:54.421484] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXM took 32.9s. Estimated remaining: 4h 7m 7s. Rate: 7.3 symbols/min [2025-10-08T18:19:54.643788] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:54.693597] [DEBUG] [LOCAL ] CYH: Loaded 47623 existing records from primary storage. [2025-10-08T18:19:54.701223] [INFO ] [MAIN ] CYH: Loaded 47623 existing records. [2025-10-08T18:19:54.702048] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T18:19:54.748309] [INFO ] [REMOTE ] CXT: Full fetch complete (45534 records). [2025-10-08T18:19:54.780828] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-08T18:19:55.115533] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:55.129797] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-08T18:19:55.190129] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-08T18:19:55.206921] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-08T18:19:55.228168] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-08T18:19:55.224678] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-08T18:19:55.478877] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-08T18:19:55.484094] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-08T18:19:55.489879] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-08T18:19:55.489961] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-08T18:19:55.533940] [DEBUG] [LOCAL ] CXT: Trimmed 45534 records to 30997 (keeping 200 days of data) [2025-10-08T18:19:55.832468] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:55.834635] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:19:55.949878] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:19:55.966165] [DEBUG] [LOCAL ] CXT: Primary data saved (30997 records). [2025-10-08T18:19:55.966264] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-08T18:19:55.966339] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXT took 28.5s. Estimated remaining: 4h 6m 38s. Rate: 7.3 symbols/min [2025-10-08T18:19:56.026913] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-08T18:19:56.134097] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:56.134272] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-08T18:19:56.134309] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-08T18:19:56.134421] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-08T18:19:56.134461] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-08T18:19:56.134501] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-08T18:19:56.134531] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-08T18:19:56.482700] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:56.817583] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-08T18:19:57.219807] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T18:19:57.617609] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-08T18:19:58.417518] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-08T18:19:58.715098] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T18:19:59.217574] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-08T18:19:59.364417] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T18:20:00.017604] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-08T18:20:00.111442] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T18:20:00.691843] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:20:00.817561] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-08T18:20:01.617580] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-08T18:20:01.685715] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T18:20:02.417526] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-08T18:20:02.758217] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T18:20:03.217572] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-08T18:20:03.382823] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T18:20:03.584556] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:20:04.017568] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-08T18:20:04.518285] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:20:04.817567] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-08T18:20:05.617507] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-08T18:20:05.816289] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T18:20:06.417509] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-08T18:20:06.729221] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T18:20:06.947553] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T18:20:07.217616] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-08T18:20:08.017519] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-08T18:20:08.102220] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:20:08.817571] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-08T18:20:09.166285] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T18:20:09.221939] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T18:20:09.617548] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-08T18:20:10.344239] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T18:20:10.417539] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-08T18:20:10.859434] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T18:20:11.217578] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-08T18:20:12.017530] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-08T18:20:12.073079] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T18:20:12.817618] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-08T18:20:13.029264] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:20:13.059283] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T18:20:13.617610] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-08T18:20:14.045393] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T18:20:14.417602] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-08T18:20:14.626439] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T18:20:15.217593] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-08T18:20:16.017558] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-08T18:20:16.160468] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:20:16.695579] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T18:20:16.817569] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-08T18:20:16.936489] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T18:20:17.617555] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-08T18:20:18.246448] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T18:20:18.250045] [INFO ] [REMOTE ] CXW: Full fetch complete (64992 records). [2025-10-08T18:20:18.250192] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-08T18:20:18.422869] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-08T18:20:18.646103] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-08T18:20:18.646221] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-08T18:20:18.647261] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-08T18:20:18.647325] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-08T18:20:18.648772] [DEBUG] [LOCAL ] CXW: Trimmed 64992 records to 43976 (keeping 200 days of data) [2025-10-08T18:20:18.902828] [DEBUG] [LOCAL ] CXW: Primary data saved (43976 records). [2025-10-08T18:20:18.902966] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-08T18:20:18.903065] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXW took 38.0s. Estimated remaining: 4h 7m 15s. Rate: 7.2 symbols/min [2025-10-08T18:20:19.069586] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:19.084677] [DEBUG] [LOCAL ] DAC: Loaded 12546 existing records from primary storage. [2025-10-08T18:20:19.084932] [INFO ] [MAIN ] DAC: Loaded 12546 existing records. [2025-10-08T18:20:19.221066] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-08T18:20:19.265192] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:19.265430] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-08T18:20:19.265496] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-08T18:20:19.266025] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-08T18:20:19.266217] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-08T18:20:19.548677] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T18:20:19.561805] [INFO ] [REMOTE ] CYD: Full fetch complete (33992 records). [2025-10-08T18:20:19.572394] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-08T18:20:19.723036] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:20.016916] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-08T18:20:20.017082] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-08T18:20:20.017730] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-08T18:20:20.018074] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-08T18:20:20.017890] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-08T18:20:20.020779] [DEBUG] [LOCAL ] CYD: Trimmed 33992 records to 26383 (keeping 200 days of data) [2025-10-08T18:20:20.186396] [DEBUG] [LOCAL ] CYD: Primary data saved (26383 records). [2025-10-08T18:20:20.186550] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-08T18:20:20.186692] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYD took 34.4s. Estimated remaining: 4h 6m 45s. Rate: 7.3 symbols/min [2025-10-08T18:20:20.359907] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:20.423042] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T18:20:20.450888] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-08T18:20:20.451222] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-08T18:20:20.626327] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:20.626567] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-08T18:20:20.626616] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-08T18:20:20.627709] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-08T18:20:20.627769] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-08T18:20:20.844169] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-08T18:20:20.995540] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:21.065193] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T18:20:21.471811] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T18:20:21.617575] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-08T18:20:22.417552] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-08T18:20:22.847781] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:20:23.208331] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T18:20:23.217691] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-08T18:20:23.255271] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T18:20:24.017588] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-08T18:20:24.817611] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-08T18:20:25.064077] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T18:20:25.444278] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T18:20:25.449432] [INFO ] [REMOTE ] CYH: Full fetch complete (69807 records). [2025-10-08T18:20:25.449699] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-08T18:20:25.619710] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-08T18:20:25.731417] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T18:20:25.874953] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-08T18:20:25.875041] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-08T18:20:25.876023] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-08T18:20:25.876093] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-08T18:20:25.877478] [DEBUG] [LOCAL ] CYH: Trimmed 69807 records to 47641 (keeping 200 days of data) [2025-10-08T18:20:26.150523] [DEBUG] [LOCAL ] CYH: Primary data saved (47641 records). [2025-10-08T18:20:26.150716] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-08T18:20:26.150846] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CYH took 31.7s. Estimated remaining: 4h 6m 30s. Rate: 7.3 symbols/min [2025-10-08T18:20:26.321694] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:26.366715] [DEBUG] [LOCAL ] DAN: Loaded 49104 existing records from primary storage. [2025-10-08T18:20:26.367102] [INFO ] [MAIN ] DAN: Loaded 49104 existing records. [2025-10-08T18:20:26.428931] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-08T18:20:26.546213] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:26.546471] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-08T18:20:26.546529] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-08T18:20:26.547881] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-08T18:20:26.547941] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-08T18:20:26.930946] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:27.217579] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-08T18:20:27.821519] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T18:20:27.844397] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T18:20:28.017594] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-08T18:20:28.336578] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T18:20:28.817625] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-08T18:20:29.259443] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T18:20:29.617586] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-08T18:20:30.417525] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-08T18:20:30.480476] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T18:20:30.754460] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T18:20:31.217629] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-08T18:20:32.017521] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-08T18:20:32.321384] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T18:20:32.373932] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T18:20:32.817552] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-08T18:20:33.511275] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T18:20:33.617506] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-08T18:20:33.973846] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T18:20:34.122950] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T18:20:34.417575] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-08T18:20:35.217581] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-08T18:20:35.872847] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T18:20:36.017688] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-08T18:20:36.589898] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-08T18:20:36.817577] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-08T18:20:37.617569] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-08T18:20:37.917420] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T18:20:38.412612] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T18:20:38.414162] [INFO ] [REMOTE ] DAC: Full fetch complete (19384 records). [2025-10-08T18:20:38.414239] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-08T18:20:38.426399] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-08T18:20:38.810711] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-08T18:20:38.810852] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-08T18:20:38.811257] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-08T18:20:38.811298] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-08T18:20:38.812004] [DEBUG] [LOCAL ] DAC: Trimmed 19384 records to 12578 (keeping 200 days of data) [2025-10-08T18:20:38.896839] [DEBUG] [LOCAL ] DAC: Primary data saved (12578 records). [2025-10-08T18:20:38.896997] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-08T18:20:38.897097] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. DAC took 20.0s. Estimated remaining: 4h 6m 35s. Rate: 7.2 symbols/min [2025-10-08T18:20:39.073595] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:39.093261] [DEBUG] [LOCAL ] DAO: Loaded 20194 existing records from primary storage. [2025-10-08T18:20:39.093630] [INFO ] [MAIN ] DAO: Loaded 20194 existing records. [2025-10-08T18:20:39.222322] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-08T18:20:39.279895] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:39.280305] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-08T18:20:39.280444] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-08T18:20:39.292277] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-08T18:20:39.297622] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-08T18:20:39.384712] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-08T18:20:39.683244] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:40.017524] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-08T18:20:40.306886] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:20:40.817515] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-08T18:20:40.998349] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T18:20:41.617617] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-08T18:20:41.927895] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T18:20:42.298326] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T18:20:42.303057] [INFO ] [REMOTE ] D: Full fetch complete (77657 records). [2025-10-08T18:20:42.303208] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-08T18:20:42.422733] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-08T18:20:42.727763] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-08T18:20:42.727922] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-08T18:20:42.728908] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-08T18:20:42.728974] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-08T18:20:42.730558] [DEBUG] [LOCAL ] D: Trimmed 77657 records to 53647 (keeping 200 days of data) [2025-10-08T18:20:42.995423] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T18:20:43.107016] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-10-08T18:20:43.107177] [INFO ] [MAIN ] D: Full history saved. [2025-10-08T18:20:43.107258] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 47.1s. Estimated remaining: 4h 6m 14s. Rate: 7.3 symbols/min [2025-10-08T18:20:43.221159] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-08T18:20:43.302100] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:43.355988] [DEBUG] [LOCAL ] DAR: Loaded 51864 existing records from primary storage. [2025-10-08T18:20:43.356554] [INFO ] [MAIN ] DAR: Loaded 51864 existing records. [2025-10-08T18:20:43.561179] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:43.561620] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-08T18:20:43.561894] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-08T18:20:43.563391] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-08T18:20:43.563456] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-08T18:20:43.871265] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T18:20:43.987544] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:44.017698] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-08T18:20:44.817542] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-08T18:20:44.848192] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:20:44.900601] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T18:20:45.617591] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-08T18:20:46.417564] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-08T18:20:46.659942] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T18:20:46.938179] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:20:47.217554] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-08T18:20:48.017535] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-08T18:20:48.120364] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T18:20:48.726938] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:20:48.817536] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-08T18:20:49.401339] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:20:49.617576] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-08T18:20:50.262101] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T18:20:50.417585] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-08T18:20:50.804127] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T18:20:51.217609] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-08T18:20:51.667097] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T18:20:52.017603] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-08T18:20:52.817610] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-08T18:20:53.574096] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T18:20:53.617494] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-08T18:20:53.632815] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T18:20:53.736182] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-08T18:20:54.417598] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-08T18:20:55.217536] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-08T18:20:55.456240] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T18:20:56.017562] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-08T18:20:56.500438] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-08T18:20:56.716076] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T18:20:56.817504] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-08T18:20:56.911903] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T18:20:57.617588] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-08T18:20:58.390783] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T18:20:58.417503] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-08T18:20:58.554490] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T18:20:59.217546] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-08T18:21:00.017564] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-08T18:21:00.073138] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T18:21:00.817513] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-08T18:21:00.990286] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T18:21:01.038178] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T18:21:01.617544] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-08T18:21:02.417568] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-08T18:21:02.574625] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T18:21:03.183995] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T18:21:03.217580] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-08T18:21:03.418418] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T18:21:04.017564] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-08T18:21:04.817608] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-08T18:21:05.297113] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-08T18:21:05.301219] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-08T18:21:05.301355] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-08T18:21:05.622686] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-08T18:21:05.721018] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:21:05.724621] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-08T18:21:05.725138] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-08T18:21:05.726470] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-08T18:21:05.726680] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-08T18:21:05.727408] [INFO ] [REMOTE ] DAN: Full fetch complete (70889 records). [2025-10-08T18:21:05.727521] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-08T18:21:05.785406] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-10-08T18:21:05.833963] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T18:21:05.839300] [INFO ] [REMOTE ] DAO: Full fetch complete (32453 records). [2025-10-08T18:21:05.922191] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-08T18:21:06.519053] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-08T18:21:06.519535] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-08T18:21:06.521218] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-08T18:21:06.538205] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-08T18:21:06.622220] [DEBUG] [LOCAL ] DAN: Trimmed 70889 records to 49113 (keeping 200 days of data) [2025-10-08T18:21:06.837052] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-08T18:21:06.838082] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-08T18:21:06.839002] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-08T18:21:06.840279] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-08T18:21:06.847402] [DEBUG] [LOCAL ] DAO: Trimmed 32453 records to 20100 (keeping 200 days of data) [2025-10-08T18:21:07.118280] [DEBUG] [LOCAL ] DAO: Primary data saved (20100 records). [2025-10-08T18:21:07.120167] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-08T18:21:07.121070] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAO took 28.2s. Estimated remaining: 4h 6m 54s. Rate: 7.2 symbols/min [2025-10-08T18:21:07.398462] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:07.531838] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T18:21:07.563276] [DEBUG] [LOCAL ] DAVA: Loaded 41291 existing records from primary storage. [2025-10-08T18:21:07.564318] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-08T18:21:07.565428] [INFO ] [MAIN ] DAVA: Loaded 41291 existing records. [2025-10-08T18:21:07.767175] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-08T18:21:07.804534] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-08T18:21:07.803232] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:21:07.804863] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-08T18:21:07.808285] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-08T18:21:07.809508] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAL took 47.6s. Estimated remaining: 4h 6m 23s. Rate: 7.2 symbols/min [2025-10-08T18:21:07.813893] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-08T18:21:07.933215] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-08T18:21:08.134176] [DEBUG] [LOCAL ] DAN: Primary data saved (49113 records). [2025-10-08T18:21:08.162132] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-08T18:21:08.168558] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 42.0s. Estimated remaining: 4h 5m 50s. Rate: 7.3 symbols/min [2025-10-08T18:21:08.201333] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:08.237602] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-08T18:21:08.310934] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-08T18:21:08.354585] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-08T18:21:08.419958] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-08T18:21:08.470981] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-08T18:21:08.528438] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-08T18:21:08.559379] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:08.681049] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:08.702285] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-08T18:21:09.051560] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:09.053025] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-08T18:21:09.055208] [DEBUG] [LOCAL ] DB: Loaded 52522 existing records from primary storage. [2025-10-08T18:21:09.055896] [INFO ] [MAIN ] DB: Loaded 52522 existing records. [2025-10-08T18:21:09.261934] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:21:09.278309] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-08T18:21:09.280895] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:21:09.280989] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-08T18:21:09.293189] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-08T18:21:09.293726] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-08T18:21:09.339031] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-08T18:21:09.676784] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:09.677204] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-08T18:21:10.171124] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:21:10.417564] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-08T18:21:10.799583] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T18:21:11.134292] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T18:21:11.217548] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-08T18:21:11.258927] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T18:21:11.313128] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T18:21:12.017586] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-08T18:21:12.525282] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T18:21:12.817584] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-08T18:21:13.367803] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:21:13.617563] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-08T18:21:14.397558] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T18:21:14.417505] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-08T18:21:15.217512] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-08T18:21:15.443504] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:21:16.017522] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-08T18:21:16.395534] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T18:21:16.452727] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T18:21:16.817614] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-08T18:21:17.356099] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:21:17.617722] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-08T18:21:18.243030] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T18:21:18.417610] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-08T18:21:19.217573] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-08T18:21:19.268121] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T18:21:19.272149] [INFO ] [REMOTE ] DAR: Full fetch complete (74639 records). [2025-10-08T18:21:19.272271] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-08T18:21:19.666272] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-08T18:21:19.666425] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-08T18:21:19.667360] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-08T18:21:19.667516] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-08T18:21:19.669229] [DEBUG] [LOCAL ] DAR: Trimmed 74639 records to 51876 (keeping 200 days of data) [2025-10-08T18:21:19.777365] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T18:21:20.003083] [DEBUG] [LOCAL ] DAR: Primary data saved (51876 records). [2025-10-08T18:21:20.003250] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-08T18:21:20.003341] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 36.9s. Estimated remaining: 4h 5m 53s. Rate: 7.2 symbols/min [2025-10-08T18:21:20.024194] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-08T18:21:20.176318] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:20.176538] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-08T18:21:20.176594] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-08T18:21:20.176731] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-08T18:21:20.176776] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-08T18:21:20.176817] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-08T18:21:20.176849] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-08T18:21:20.536819] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:20.817515] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-08T18:21:20.848405] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:21:21.572368] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T18:21:21.617500] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-08T18:21:21.792516] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T18:21:22.417570] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-08T18:21:22.448870] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T18:21:23.217605] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-08T18:21:24.017708] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-08T18:21:24.569300] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T18:21:24.640027] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T18:21:24.817518] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-08T18:21:24.973902] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T18:21:25.617613] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-08T18:21:26.169783] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:21:26.417582] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-08T18:21:27.222617] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-08T18:21:27.234880] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T18:21:27.483051] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T18:21:28.017517] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-08T18:21:28.817527] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-08T18:21:29.091721] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T18:21:29.539229] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T18:21:29.617551] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-08T18:21:30.417528] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-08T18:21:30.759502] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T18:21:30.852972] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T18:21:31.217507] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-08T18:21:31.605182] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T18:21:32.017596] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-08T18:21:32.798117] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T18:21:32.802494] [INFO ] [REMOTE ] DAVA: Full fetch complete (56441 records). [2025-10-08T18:21:32.802621] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-08T18:21:32.827617] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-08T18:21:33.029689] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T18:21:33.244221] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-08T18:21:33.244306] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-08T18:21:33.245002] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-08T18:21:33.245065] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-08T18:21:33.246273] [DEBUG] [LOCAL ] DAVA: Trimmed 56441 records to 41417 (keeping 200 days of data) [2025-10-08T18:21:33.489805] [DEBUG] [LOCAL ] DAVA: Primary data saved (41417 records). [2025-10-08T18:21:33.490068] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-08T18:21:33.490177] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 26.4s. Estimated remaining: 4h 6m 0s. Rate: 7.2 symbols/min [2025-10-08T18:21:33.626825] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-08T18:21:33.658411] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:33.697236] [DEBUG] [LOCAL ] DBI: Loaded 44391 existing records from primary storage. [2025-10-08T18:21:33.697573] [INFO ] [MAIN ] DBI: Loaded 44391 existing records. [2025-10-08T18:21:33.870681] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:21:33.870931] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-08T18:21:33.870978] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-08T18:21:33.872331] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-08T18:21:33.872405] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-08T18:21:34.242858] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:34.417601] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-08T18:21:35.217597] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-08T18:21:35.533886] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-08T18:21:36.017579] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-08T18:21:36.263103] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-08T18:21:36.395815] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T18:21:36.773854] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T18:21:36.817499] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-08T18:21:37.617620] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-08T18:21:38.131468] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:21:38.259866] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-08T18:21:38.417548] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-08T18:21:39.220298] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-08T18:21:39.226548] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:21:39.564610] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T18:21:40.017536] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-08T18:21:40.815881] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T18:21:40.826180] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-08T18:21:41.078115] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T18:21:41.617561] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-08T18:21:42.415291] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:21:42.423701] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-08T18:21:43.200543] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:21:43.217633] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-08T18:21:44.017553] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-08T18:21:44.115011] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T18:21:44.747502] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:21:44.748724] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:21:44.759076] [INFO ] [REMOTE ] DBD: Full fetch complete (30991 records). [2025-10-08T18:21:44.759304] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-08T18:21:44.760479] [INFO ] [REMOTE ] DB: Full fetch complete (74764 records). [2025-10-08T18:21:44.760237] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:21:44.760854] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:21:44.760958] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:21:44.761054] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-08T18:21:44.761153] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-08T18:21:44.761242] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-08T18:21:44.761349] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-08T18:21:44.761478] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DBD took 24.8s. Estimated remaining: 4h 6m 1s. Rate: 7.2 symbols/min [2025-10-08T18:21:44.767430] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-08T18:21:44.819720] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-08T18:21:45.198289] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:45.413473] [DEBUG] [LOCAL ] DBL: Loaded 9263 existing records from primary storage. [2025-10-08T18:21:45.447027] [INFO ] [MAIN ] DBL: Loaded 9263 existing records. [2025-10-08T18:21:45.619040] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-08T18:21:45.770176] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-08T18:21:45.775020] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-08T18:21:45.774954] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:21:45.776322] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-08T18:21:45.776415] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-08T18:21:45.776603] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-08T18:21:45.776684] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-08T18:21:45.777544] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-08T18:21:45.777618] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-08T18:21:45.809321] [DEBUG] [LOCAL ] DB: Trimmed 74764 records to 52514 (keeping 200 days of data) [2025-10-08T18:21:46.287615] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:46.417542] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-08T18:21:46.507108] [DEBUG] [LOCAL ] DB: Primary data saved (52514 records). [2025-10-08T18:21:46.507249] [INFO ] [MAIN ] DB: Full history saved. [2025-10-08T18:21:46.507334] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 38.3s. Estimated remaining: 4h 5m 33s. Rate: 7.2 symbols/min [2025-10-08T18:21:46.682068] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:46.682260] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-08T18:21:46.682501] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-08T18:21:46.682821] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-08T18:21:46.682897] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-08T18:21:46.683001] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-08T18:21:46.683055] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-08T18:21:46.837114] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T18:21:47.087191] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:47.217558] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-08T18:21:47.341493] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:21:47.373537] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T18:21:48.017614] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-08T18:21:48.584191] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:21:48.730350] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T18:21:48.817556] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-08T18:21:49.617613] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-08T18:21:50.417521] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-08T18:21:50.648529] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:21:51.225146] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-08T18:21:51.243372] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T18:21:51.294724] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:21:52.017580] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-08T18:21:52.794988] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T18:21:52.817535] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-08T18:21:52.942055] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T18:21:53.617605] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-08T18:21:53.699388] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T18:21:54.417543] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-08T18:21:55.043934] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T18:21:55.063707] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T18:21:55.066887] [INFO ] [REMOTE ] DAY: Full fetch complete (71089 records). [2025-10-08T18:21:55.067007] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-08T18:21:55.068093] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:21:55.068225] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:21:55.068279] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:21:55.068323] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-08T18:21:55.068392] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-08T18:21:55.068447] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-08T18:21:55.068508] [DEBUG] [LOCAL ] DAY: No derivative data file found to delete. [2025-10-08T18:21:55.068621] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DAY took 47.3s. Estimated remaining: 4h 5m 25s. Rate: 7.2 symbols/min [2025-10-08T18:21:55.218619] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-08T18:21:55.244169] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:55.245296] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-08T18:21:55.245360] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-08T18:21:55.245473] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-08T18:21:55.245513] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-08T18:21:55.245554] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-08T18:21:55.245586] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-08T18:21:55.591700] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:56.017593] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-08T18:21:56.817600] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-08T18:21:57.021148] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T18:21:57.424709] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:21:57.617598] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-08T18:21:58.417515] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-08T18:21:58.518659] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T18:21:58.585010] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T18:21:59.217557] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-08T18:22:00.017563] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-08T18:22:00.096077] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T18:22:00.545394] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:22:00.817575] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-08T18:22:01.579264] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T18:22:01.617573] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-08T18:22:02.256697] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T18:22:02.417561] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-08T18:22:02.675689] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T18:22:03.215084] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:22:03.217824] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-08T18:22:04.017578] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-08T18:22:04.566043] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:22:04.817604] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-08T18:22:05.124935] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T18:22:05.537761] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T18:22:05.617563] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-08T18:22:06.092976] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T18:22:06.417577] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-08T18:22:07.217542] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-08T18:22:08.017535] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-08T18:22:08.058766] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T18:22:08.817576] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-08T18:22:08.860553] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T18:22:08.888203] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T18:22:09.617592] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-08T18:22:10.417560] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-08T18:22:10.478312] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T18:22:10.481145] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:22:10.481375] [INFO ] [REMOTE ] DBL: Full fetch complete (12479 records). [2025-10-08T18:22:10.491556] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-08T18:22:10.492706] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:22:10.492791] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:22:10.492871] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:22:10.492943] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-08T18:22:10.493007] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-08T18:22:10.493042] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-08T18:22:10.493334] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-10-08T18:22:10.493427] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 25.7s. Estimated remaining: 4h 5m 39s. Rate: 7.2 symbols/min [2025-10-08T18:22:10.662725] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:22:10.680152] [DEBUG] [LOCAL ] DCO: Loaded 13934 existing records from primary storage. [2025-10-08T18:22:10.680407] [INFO ] [MAIN ] DCO: Loaded 13934 existing records. [2025-10-08T18:22:10.863967] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:22:10.864250] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-08T18:22:10.864313] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-08T18:22:10.864803] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-08T18:22:10.864875] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-08T18:22:11.224387] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-08T18:22:11.268989] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:22:11.527131] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T18:22:12.017765] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-08T18:22:12.817595] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-08T18:22:12.818949] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:22:12.824043] [INFO ] [REMOTE ] DBI: Full fetch complete (65509 records). [2025-10-08T18:22:12.824194] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-08T18:22:13.213577] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:22:13.265103] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-08T18:22:13.265194] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-08T18:22:13.266302] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-08T18:22:13.266388] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-08T18:22:13.268247] [DEBUG] [LOCAL ] DBI: Trimmed 65509 records to 44280 (keeping 200 days of data) [2025-10-08T18:22:13.541495] [DEBUG] [LOCAL ] DBI: Primary data saved (44280 records). [2025-10-08T18:22:13.541640] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-08T18:22:13.541770] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 40.1s. Estimated remaining: 4h 5m 15s. Rate: 7.2 symbols/min [2025-10-08T18:22:13.622749] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-08T18:22:13.715581] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:22:13.767848] [DEBUG] [LOCAL ] DD: Loaded 52861 existing records from primary storage. [2025-10-08T18:22:13.768185] [INFO ] [MAIN ] DD: Loaded 52861 existing records. [2025-10-08T18:22:13.946705] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:22:13.947113] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-08T18:22:13.947268] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-08T18:22:13.947621] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-08T18:22:13.947718] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-08T18:22:14.319120] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:22:14.341412] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T18:22:14.400262] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:22:14.417494] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-08T18:22:15.217611] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-08T18:22:16.017504] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-08T18:22:16.211838] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T18:22:16.665796] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T18:22:16.774154] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T18:22:16.817506] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-08T18:22:17.617556] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-08T18:22:18.302778] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T18:22:18.417513] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-08T18:22:19.068106] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:22:19.217538] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-08T18:22:20.001536] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:22:20.017485] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-08T18:22:20.752170] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T18:22:20.817538] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-08T18:22:21.223835] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:22:21.226910] [INFO ] [REMOTE ] DCI: Full fetch complete (53678 records). [2025-10-08T18:22:21.227025] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-08T18:22:21.626044] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-08T18:22:21.648112] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-08T18:22:21.648261] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-08T18:22:21.649178] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-08T18:22:21.649254] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-08T18:22:21.650682] [DEBUG] [LOCAL ] DCI: Trimmed 53678 records to 37056 (keeping 200 days of data) [2025-10-08T18:22:21.891333] [DEBUG] [LOCAL ] DCI: Primary data saved (37056 records). [2025-10-08T18:22:21.891500] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-08T18:22:21.891593] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DCI took 26.8s. Estimated remaining: 4h 5m 6s. Rate: 7.2 symbols/min [2025-10-08T18:22:22.060509] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:22:22.116451] [DEBUG] [LOCAL ] DDD: Loaded 50919 existing records from primary storage. [2025-10-08T18:22:22.116836] [INFO ] [MAIN ] DDD: Loaded 50919 existing records. [2025-10-08T18:22:22.298711] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:22:22.299126] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-08T18:22:22.299270] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-08T18:22:22.299611] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-08T18:22:22.299693] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-08T18:22:22.427727] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-08T18:22:22.685754] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:22:22.716258] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T18:22:23.217498] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-08T18:22:23.461617] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T18:22:23.462519] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T18:22:24.017556] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-08T18:22:24.811786] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:22:24.823955] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-08T18:22:25.617534] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-08T18:22:25.717916] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T18:22:26.417523] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-08T18:22:26.497119] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T18:22:26.549418] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T18:22:27.217612] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-08T18:22:28.021720] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-08T18:22:28.024926] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T18:22:28.144284] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:22:28.817616] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-08T18:22:29.617594] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-08T18:22:29.675446] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T18:22:29.848948] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T18:22:30.417597] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-08T18:22:30.992167] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:22:31.217608] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-08T18:22:31.497962] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T18:22:32.017565] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-08T18:22:32.817581] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-08T18:22:32.974533] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T18:22:33.547264] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T18:22:33.617715] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-08T18:22:34.281416] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:22:34.417562] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-08T18:22:34.930081] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T18:22:34.935261] [INFO ] [REMOTE ] DBRG: Full fetch complete (72365 records). [2025-10-08T18:22:34.935442] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-08T18:22:35.226482] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-08T18:22:35.357870] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-08T18:22:35.358005] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-08T18:22:35.358928] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-08T18:22:35.359007] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-08T18:22:35.360872] [DEBUG] [LOCAL ] DBRG: Trimmed 72365 records to 49813 (keeping 200 days of data) [2025-10-08T18:22:35.679288] [DEBUG] [LOCAL ] DBRG: Primary data saved (49813 records). [2025-10-08T18:22:35.679452] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-08T18:22:35.679531] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DBRG took 49.2s. Estimated remaining: 4h 5m 15s. Rate: 7.2 symbols/min [2025-10-08T18:22:35.936216] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:22:36.017544] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-08T18:22:36.817681] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-08T18:22:37.141119] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T18:22:37.617603] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-08T18:22:37.879444] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T18:22:37.930246] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:22:38.417557] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-08T18:22:39.151448] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:22:39.217558] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-08T18:22:39.420301] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T18:22:40.017620] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-08T18:22:40.817512] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-08T18:22:40.863127] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T18:22:40.864714] [INFO ] [REMOTE ] DCO: Full fetch complete (18921 records). [2025-10-08T18:22:40.864892] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-08T18:22:40.865591] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:22:40.865783] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:22:40.865918] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:22:40.866043] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-08T18:22:40.866214] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-08T18:22:40.866263] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-08T18:22:40.876579] [DEBUG] [LOCAL ] DCO: Deleted derivative data file. [2025-10-08T18:22:40.891468] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 30.4s. Estimated remaining: 4h 4m 57s. Rate: 7.2 symbols/min [2025-10-08T18:22:40.896411] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:22:41.617564] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-08T18:22:42.915141] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T18:22:42.927262] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-08T18:22:43.041013] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T18:22:43.217563] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-08T18:22:44.664491] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T18:22:44.669368] [INFO ] [REMOTE ] DD: Full fetch complete (76375 records). [2025-10-08T18:22:44.669876] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-08T18:22:45.154568] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-08T18:22:45.154767] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-08T18:22:45.155677] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-08T18:22:45.155795] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-08T18:22:45.173566] [DEBUG] [LOCAL ] DD: Trimmed 76375 records to 52853 (keeping 200 days of data) [2025-10-08T18:22:45.202406] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-08T18:22:45.306775] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-08T18:22:45.556959] [DEBUG] [LOCAL ] DD: Primary data saved (52853 records). [2025-10-08T18:22:45.557177] [INFO ] [MAIN ] DD: Full history saved. [2025-10-08T18:22:45.557330] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 32.0s. Estimated remaining: 4h 4m 38s. Rate: 7.2 symbols/min [2025-10-08T18:22:47.261850] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T18:22:47.274294] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-08T18:22:49.701147] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-08T18:22:49.713979] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-08T18:22:51.672869] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T18:22:51.685727] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-08T18:23:06.490978] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (14.81 seconds). [2025-10-08T18:23:06.494954] [INFO ] [REMOTE ] DDD: Full fetch complete (73336 records). [2025-10-08T18:23:06.495136] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-08T18:23:06.496561] [FATAL] [VALIDATOR ] DDD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:23:06.496758] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:23:06.496825] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:23:06.496890] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-08T18:23:06.497083] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-08T18:23:06.497156] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-10-08T18:23:06.497454] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-10-08T18:23:06.498583] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 44.6s. Estimated remaining: 4h 5m 7s. Rate: 7.2 symbols/min [2025-10-08T18:23:07.145213] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:07.220971] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:07.273782] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:07.316830] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:07.317705] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-08T18:23:07.317798] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-08T18:23:07.317923] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-08T18:23:07.317964] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-08T18:23:07.318005] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-08T18:23:07.318037] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-08T18:23:07.424916] [DEBUG] [LOCAL ] DDS: Loaded 12873 existing records from primary storage. [2025-10-08T18:23:07.441896] [INFO ] [MAIN ] DDS: Loaded 12873 existing records. [2025-10-08T18:23:07.497700] [DEBUG] [LOCAL ] DDL: Loaded 36762 existing records from primary storage. [2025-10-08T18:23:07.529587] [INFO ] [MAIN ] DDL: Loaded 36762 existing records. [2025-10-08T18:23:07.916663] [DEBUG] [LOCAL ] DE: Loaded 47575 existing records from primary storage. [2025-10-08T18:23:08.012457] [INFO ] [MAIN ] DE: Loaded 47575 existing records. [2025-10-08T18:23:08.077353] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:08.137194] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-08T18:23:08.174071] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-08T18:23:08.248945] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:08.307381] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-08T18:23:08.335455] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-08T18:23:08.326406] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:08.347608] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-08T18:23:08.347175] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-08T18:23:08.347035] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-08T18:23:08.383211] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-08T18:23:08.395618] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-08T18:23:08.580381] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:08.657303] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-08T18:23:08.661708] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-08T18:23:08.715085] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-08T18:23:08.729694] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-08T18:23:09.431283] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:09.480025] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:09.480579] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-08T18:23:09.486177] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-08T18:23:09.584083] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T18:23:09.608576] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-08T18:23:09.655818] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:09.656289] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-08T18:23:10.077793] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T18:23:10.079593] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-08T18:23:10.681775] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T18:23:10.682966] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-08T18:23:10.922991] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:23:10.927705] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-08T18:23:11.152454] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T18:23:11.154884] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-08T18:23:11.158071] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T18:23:11.173126] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-08T18:23:11.282961] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:23:11.297755] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-08T18:23:11.549362] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T18:23:11.553236] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-08T18:23:11.595221] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:23:11.597101] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-08T18:23:12.033474] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T18:23:12.035226] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-08T18:23:12.184885] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T18:23:12.188005] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-08T18:23:12.364689] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T18:23:12.365948] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-08T18:23:12.559372] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T18:23:12.566531] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-08T18:23:12.673726] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T18:23:12.683722] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-08T18:23:12.710390] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T18:23:12.712202] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-08T18:23:12.862344] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T18:23:12.866322] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-08T18:23:13.156475] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T18:23:13.157805] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-08T18:23:13.624630] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T18:23:13.629468] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T18:23:13.630405] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-08T18:23:13.640448] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-08T18:23:13.986294] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T18:23:13.990478] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-08T18:23:14.048925] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T18:23:14.049690] [INFO ] [REMOTE ] DDT: Full fetch complete (2849 records). [2025-10-08T18:23:14.049770] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-08T18:23:14.449470] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-08T18:23:14.449625] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-08T18:23:14.449838] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-08T18:23:14.450050] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-08T18:23:14.450766] [DEBUG] [LOCAL ] DDT: Trimmed 2849 records to 2086 (keeping 200 days of data) [2025-10-08T18:23:14.465076] [DEBUG] [LOCAL ] DDT: Primary data saved (2086 records). [2025-10-08T18:23:14.465228] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-08T18:23:14.465329] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 8.0s. Estimated remaining: 4h 4m 58s. Rate: 7.2 symbols/min [2025-10-08T18:23:14.646389] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:14.686569] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T18:23:14.696796] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-08T18:23:14.738427] [DEBUG] [LOCAL ] DEA: Loaded 40570 existing records from primary storage. [2025-10-08T18:23:14.738935] [INFO ] [MAIN ] DEA: Loaded 40570 existing records. [2025-10-08T18:23:14.943903] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:14.946199] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T18:23:14.946512] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-08T18:23:14.951224] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-08T18:23:14.951311] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-08T18:23:14.952798] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-08T18:23:14.952894] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-08T18:23:15.354229] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:15.355940] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-08T18:23:15.359620] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:23:15.374902] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-08T18:23:15.901076] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T18:23:15.905757] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-08T18:23:16.296246] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T18:23:16.307165] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-08T18:23:16.663624] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T18:23:16.674416] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-08T18:23:16.749856] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:23:16.761254] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-08T18:23:16.779249] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T18:23:16.782515] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-08T18:23:17.397902] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T18:23:17.402099] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-08T18:23:17.894918] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T18:23:17.904520] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-08T18:23:18.251827] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T18:23:18.262084] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-08T18:23:18.271127] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T18:23:18.274794] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-08T18:23:18.393254] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T18:23:18.405900] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-08T18:23:19.031404] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T18:23:19.038560] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-08T18:23:19.057314] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T18:23:19.058673] [INFO ] [REMOTE ] DDS: Full fetch complete (18837 records). [2025-10-08T18:23:19.058759] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-08T18:23:19.497869] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-08T18:23:19.497982] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-08T18:23:19.498560] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-08T18:23:19.498666] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-08T18:23:19.499546] [DEBUG] [LOCAL ] DDS: Trimmed 18837 records to 12832 (keeping 200 days of data) [2025-10-08T18:23:19.588449] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:23:19.600442] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-08T18:23:19.623310] [DEBUG] [LOCAL ] DDS: Primary data saved (12832 records). [2025-10-08T18:23:19.623424] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-08T18:23:19.623520] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 13.1s. Estimated remaining: 4h 4m 40s. Rate: 7.2 symbols/min [2025-10-08T18:23:19.807539] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:19.841195] [DEBUG] [LOCAL ] DEC: Loaded 30438 existing records from primary storage. [2025-10-08T18:23:19.841522] [INFO ] [MAIN ] DEC: Loaded 30438 existing records. [2025-10-08T18:23:20.024768] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:20.025391] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-08T18:23:20.025474] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-08T18:23:20.025909] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-08T18:23:20.026019] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-08T18:23:20.388540] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T18:23:20.466094] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:20.467365] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-08T18:23:20.468624] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T18:23:20.467707] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-08T18:23:20.817629] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-08T18:23:20.949677] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T18:23:21.310989] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T18:23:21.617569] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-08T18:23:21.929007] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:23:22.224537] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:23:22.417605] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-08T18:23:23.205771] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:23:23.217484] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-08T18:23:23.747069] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T18:23:24.017558] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-08T18:23:24.494310] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T18:23:24.817604] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-08T18:23:25.617600] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-08T18:23:25.887714] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T18:23:26.352104] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:23:26.417564] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-08T18:23:26.624254] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T18:23:27.217552] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-08T18:23:28.017547] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-08T18:23:28.117717] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T18:23:28.619305] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T18:23:28.623118] [INFO ] [REMOTE ] DDL: Full fetch complete (53186 records). [2025-10-08T18:23:28.623322] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-08T18:23:28.825154] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-08T18:23:29.039786] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-08T18:23:29.039883] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-08T18:23:29.040555] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-08T18:23:29.040599] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-08T18:23:29.041865] [DEBUG] [LOCAL ] DDL: Trimmed 53186 records to 36794 (keeping 200 days of data) [2025-10-08T18:23:29.258706] [DEBUG] [LOCAL ] DDL: Primary data saved (36794 records). [2025-10-08T18:23:29.258885] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-08T18:23:29.258978] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 22.8s. Estimated remaining: 4h 4m 36s. Rate: 7.2 symbols/min [2025-10-08T18:23:29.446434] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:29.511249] [DEBUG] [LOCAL ] DECK: Loaded 53299 existing records from primary storage. [2025-10-08T18:23:29.511813] [INFO ] [MAIN ] DECK: Loaded 53299 existing records. [2025-10-08T18:23:29.621804] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-08T18:23:29.829618] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:29.829998] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-08T18:23:29.830228] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-08T18:23:29.830861] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-08T18:23:29.830940] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-08T18:23:29.977207] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T18:23:30.127023] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T18:23:30.434308] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-08T18:23:30.497556] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:31.217544] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-08T18:23:31.659574] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T18:23:31.814471] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:23:32.017592] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-08T18:23:32.817532] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-08T18:23:33.149201] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T18:23:33.470439] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T18:23:33.617565] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-08T18:23:34.223808] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T18:23:34.228613] [INFO ] [REMOTE ] DE: Full fetch complete (69493 records). [2025-10-08T18:23:34.228861] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-08T18:23:34.426318] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-08T18:23:34.689805] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-08T18:23:34.689905] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-08T18:23:34.690725] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-08T18:23:34.690793] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-08T18:23:34.692248] [DEBUG] [LOCAL ] DE: Trimmed 69493 records to 47554 (keeping 200 days of data) [2025-10-08T18:23:35.005406] [DEBUG] [LOCAL ] DE: Primary data saved (47554 records). [2025-10-08T18:23:35.005541] [INFO ] [MAIN ] DE: Full history saved. [2025-10-08T18:23:35.005628] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 28.5s. Estimated remaining: 4h 4m 20s. Rate: 7.2 symbols/min [2025-10-08T18:23:35.169135] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T18:23:35.221924] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-08T18:23:35.224957] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:35.226163] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-10-08T18:23:35.226236] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-10-08T18:23:35.226378] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-08T18:23:35.226431] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-08T18:23:35.226488] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-08T18:23:35.226533] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-08T18:23:35.582540] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:36.017533] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-08T18:23:36.129273] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T18:23:36.556802] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T18:23:36.817588] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-08T18:23:37.089361] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T18:23:37.617547] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-08T18:23:38.082853] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T18:23:38.417565] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-08T18:23:39.217569] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-08T18:23:39.388271] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T18:23:39.724221] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T18:23:40.017573] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-08T18:23:40.476878] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:23:40.482344] [INFO ] [REMOTE ] DEA: Full fetch complete (62242 records). [2025-10-08T18:23:40.482543] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-08T18:23:40.822738] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-08T18:23:40.899299] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-08T18:23:40.899408] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-08T18:23:40.900250] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-08T18:23:40.900332] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-08T18:23:40.901932] [DEBUG] [LOCAL ] DEA: Trimmed 62242 records to 40555 (keeping 200 days of data) [2025-10-08T18:23:41.150024] [DEBUG] [LOCAL ] DEA: Primary data saved (40555 records). [2025-10-08T18:23:41.150170] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-08T18:23:41.150261] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 26.7s. Estimated remaining: 4h 4m 6s. Rate: 7.2 symbols/min [2025-10-08T18:23:41.324756] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:41.383795] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-08T18:23:41.384159] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-08T18:23:41.575628] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:41.575986] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-08T18:23:41.576405] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-08T18:23:41.577058] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-08T18:23:41.577196] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-08T18:23:41.623091] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-08T18:23:41.781551] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T18:23:42.012293] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:42.312783] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T18:23:42.417629] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-08T18:23:43.217691] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-08T18:23:43.637990] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-08T18:23:44.017623] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-08T18:23:44.374928] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:23:44.663521] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-08T18:23:44.817572] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-08T18:23:45.617603] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-08T18:23:45.897454] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T18:23:46.396639] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T18:23:46.417508] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-08T18:23:47.217613] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-08T18:23:47.801442] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-08T18:23:47.850911] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:23:48.017548] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-08T18:23:48.607925] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:23:48.817552] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-08T18:23:49.617549] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-08T18:23:50.026328] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:23:50.030229] [INFO ] [REMOTE ] DEC: Full fetch complete (43823 records). [2025-10-08T18:23:50.030359] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-08T18:23:50.417096] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-08T18:23:50.417208] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-08T18:23:50.417901] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-08T18:23:50.418115] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-08T18:23:50.418011] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-08T18:23:50.421711] [DEBUG] [LOCAL ] DEC: Trimmed 43823 records to 30453 (keeping 200 days of data) [2025-10-08T18:23:50.575136] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-08T18:23:50.681591] [DEBUG] [LOCAL ] DEC: Primary data saved (30453 records). [2025-10-08T18:23:50.681833] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-08T18:23:50.681975] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 31.1s. Estimated remaining: 4h 4m 1s. Rate: 7.2 symbols/min [2025-10-08T18:23:50.889126] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:50.889494] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-08T18:23:50.889701] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-08T18:23:50.890036] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-08T18:23:50.890163] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-08T18:23:50.890497] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-08T18:23:50.890564] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-08T18:23:51.224737] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-08T18:23:51.246469] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T18:23:51.341932] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:52.017573] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-08T18:23:52.635950] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-08T18:23:52.817602] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-08T18:23:53.617526] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-08T18:23:53.695841] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-08T18:23:53.738617] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T18:23:54.417579] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-08T18:23:54.674598] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-08T18:23:55.113120] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T18:23:55.217558] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-08T18:23:56.017562] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-08T18:23:56.309615] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T18:23:56.817607] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-08T18:23:57.585392] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T18:23:57.617537] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-08T18:23:58.263879] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-08T18:23:58.417577] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-08T18:23:58.565078] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T18:23:59.217579] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-08T18:23:59.775678] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-08T18:23:59.954864] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:24:00.017568] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-08T18:24:00.817528] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-08T18:24:01.161143] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T18:24:01.617576] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-08T18:24:02.400756] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T18:24:02.417505] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-08T18:24:02.558268] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-08T18:24:03.217603] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-08T18:24:03.303722] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T18:24:03.941464] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T18:24:04.017506] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-08T18:24:04.817520] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-08T18:24:04.915921] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T18:24:05.617562] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-08T18:24:05.685108] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T18:24:06.417559] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-08T18:24:07.082230] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-08T18:24:07.152774] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T18:24:07.156913] [INFO ] [REMOTE ] DECK: Full fetch complete (76780 records). [2025-10-08T18:24:07.157023] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-08T18:24:07.222794] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-08T18:24:07.557921] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-08T18:24:07.558003] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-08T18:24:07.558884] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-08T18:24:07.558950] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-08T18:24:07.560392] [DEBUG] [LOCAL ] DECK: Trimmed 76780 records to 53291 (keeping 200 days of data) [2025-10-08T18:24:07.707727] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T18:24:07.924049] [DEBUG] [LOCAL ] DECK: Primary data saved (53291 records). [2025-10-08T18:24:07.924222] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-08T18:24:07.924335] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 38.7s. Estimated remaining: 4h 4m 19s. Rate: 7.2 symbols/min [2025-10-08T18:24:08.023724] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-08T18:24:08.101252] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:08.133560] [DEBUG] [LOCAL ] DFH: Loaded 32149 existing records from primary storage. [2025-10-08T18:24:08.133885] [INFO ] [MAIN ] DFH: Loaded 32149 existing records. [2025-10-08T18:24:08.310131] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:08.310334] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-08T18:24:08.310380] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-08T18:24:08.310723] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-08T18:24:08.310783] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-08T18:24:08.667370] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:08.693623] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:24:08.817567] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-08T18:24:09.617623] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-08T18:24:10.422725] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-08T18:24:10.438328] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T18:24:10.542620] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-08T18:24:11.217541] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-08T18:24:11.555992] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-08T18:24:11.628311] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T18:24:12.017616] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-08T18:24:12.817701] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-08T18:24:13.133810] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T18:24:13.137731] [INFO ] [REMOTE ] DEI: Full fetch complete (69400 records). [2025-10-08T18:24:13.137884] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-08T18:24:13.138970] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:24:13.139155] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:24:13.139217] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:24:13.139308] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-08T18:24:13.139423] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-08T18:24:13.139484] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-10-08T18:24:13.139547] [DEBUG] [LOCAL ] DEI: No derivative data file found to delete. [2025-10-08T18:24:13.139664] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DEI took 38.1s. Estimated remaining: 4h 4m 1s. Rate: 7.2 symbols/min [2025-10-08T18:24:13.327355] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:13.353039] [DEBUG] [LOCAL ] DFIN: Loaded 22891 existing records from primary storage. [2025-10-08T18:24:13.353330] [INFO ] [MAIN ] DFIN: Loaded 22891 existing records. [2025-10-08T18:24:13.533434] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:13.533825] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-08T18:24:13.533935] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-08T18:24:13.534519] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-08T18:24:13.534629] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-08T18:24:13.643331] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-08T18:24:13.702813] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-08T18:24:13.949837] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:13.968788] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T18:24:14.417570] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-08T18:24:15.217613] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-08T18:24:15.444360] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T18:24:15.474402] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T18:24:16.017585] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-08T18:24:16.817577] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-08T18:24:17.183010] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T18:24:17.616837] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-08T18:24:17.621308] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-08T18:24:17.623335] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-08T18:24:17.623621] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-08T18:24:18.041053] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-08T18:24:18.041146] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-08T18:24:18.042106] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-08T18:24:18.042174] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-08T18:24:18.043821] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53736 (keeping 200 days of data) [2025-10-08T18:24:18.402322] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-08T18:24:18.402487] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-08T18:24:18.402578] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 37.3s. Estimated remaining: 4h 3m 44s. Rate: 7.2 symbols/min [2025-10-08T18:24:18.424173] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-08T18:24:18.606155] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T18:24:18.626102] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:18.654054] [DEBUG] [LOCAL ] DFP: Loaded 11307 existing records from primary storage. [2025-10-08T18:24:18.654358] [INFO ] [MAIN ] DFP: Loaded 11307 existing records. [2025-10-08T18:24:18.844022] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:18.844311] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-08T18:24:18.844360] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-08T18:24:18.844612] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-08T18:24:18.844712] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-08T18:24:19.210680] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:24:19.220515] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-08T18:24:19.241205] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:19.664382] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T18:24:20.017591] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-08T18:24:20.686176] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:24:20.689639] [INFO ] [REMOTE ] DEO: Full fetch complete (71157 records). [2025-10-08T18:24:20.689834] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-08T18:24:20.690536] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:24:20.690678] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:24:20.690755] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:24:20.690851] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-08T18:24:20.690934] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-08T18:24:20.690970] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-08T18:24:20.691009] [DEBUG] [LOCAL ] DEO: No derivative data file found to delete. [2025-10-08T18:24:20.691070] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 30.0s. Estimated remaining: 4h 3m 19s. Rate: 7.2 symbols/min [2025-10-08T18:24:20.823851] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-08T18:24:20.904213] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:20.904414] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-08T18:24:20.904462] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-08T18:24:20.904588] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-08T18:24:20.904629] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-08T18:24:20.904731] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-08T18:24:20.904773] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-08T18:24:21.186147] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T18:24:21.290389] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:21.617631] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-08T18:24:22.262834] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T18:24:22.285748] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T18:24:22.417634] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-08T18:24:23.171824] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T18:24:23.217591] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-08T18:24:24.017573] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-08T18:24:24.817606] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-08T18:24:25.155838] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T18:24:25.411514] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-08T18:24:25.617537] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-08T18:24:25.691494] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T18:24:26.417550] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-08T18:24:26.700958] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T18:24:27.217575] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-08T18:24:27.247151] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T18:24:28.017535] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-08T18:24:28.456515] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:24:28.707567] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T18:24:28.817570] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-08T18:24:29.345390] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T18:24:29.617546] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-08T18:24:30.417595] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-08T18:24:30.833905] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T18:24:30.973638] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T18:24:31.217625] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-08T18:24:32.017570] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-08T18:24:32.244976] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T18:24:32.817555] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-08T18:24:33.617568] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-08T18:24:34.010370] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-08T18:24:34.191284] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:24:34.217207] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T18:24:34.417560] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-08T18:24:35.217659] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-08T18:24:35.296616] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T18:24:36.017557] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-08T18:24:36.323932] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T18:24:36.518173] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T18:24:36.817555] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-08T18:24:37.617588] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-08T18:24:37.940726] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:24:38.417573] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-08T18:24:39.217579] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-08T18:24:39.517474] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T18:24:39.623553] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:24:39.626048] [INFO ] [REMOTE ] DFH: Full fetch complete (48308 records). [2025-10-08T18:24:39.626153] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-08T18:24:39.944219] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:24:39.956140] [INFO ] [REMOTE ] DFP: Full fetch complete (15982 records). [2025-10-08T18:24:39.966465] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-08T18:24:40.023214] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-08T18:24:40.099084] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-08T18:24:40.105438] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-08T18:24:40.112257] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-08T18:24:40.135605] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-08T18:24:40.184993] [DEBUG] [LOCAL ] DFH: Trimmed 48308 records to 32083 (keeping 200 days of data) [2025-10-08T18:24:40.513316] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-08T18:24:40.513421] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-08T18:24:40.514154] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-08T18:24:40.514513] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-08T18:24:40.517170] [DEBUG] [LOCAL ] DFP: Trimmed 15982 records to 11313 (keeping 200 days of data) [2025-10-08T18:24:40.662104] [DEBUG] [LOCAL ] DFP: Primary data saved (11313 records). [2025-10-08T18:24:40.663989] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-08T18:24:40.664154] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFP took 22.3s. Estimated remaining: 4h 3m 44s. Rate: 7.2 symbols/min [2025-10-08T18:24:40.821933] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-08T18:24:40.851013] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:40.859779] [DEBUG] [LOCAL ] DFH: Primary data saved (32083 records). [2025-10-08T18:24:40.860308] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-08T18:24:40.860403] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 32.9s. Estimated remaining: 4h 3m 12s. Rate: 7.2 symbols/min [2025-10-08T18:24:41.046011] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:41.046318] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-08T18:24:41.046376] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-08T18:24:41.046492] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-08T18:24:41.046536] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-08T18:24:41.046578] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-08T18:24:41.046610] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-08T18:24:41.165703] [DEBUG] [LOCAL ] DGX: Loaded 44803 existing records from primary storage. [2025-10-08T18:24:41.205224] [INFO ] [MAIN ] DGX: Loaded 44803 existing records. [2025-10-08T18:24:41.537384] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:24:41.608220] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:41.634801] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-08T18:24:41.639317] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:41.640573] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-08T18:24:41.640623] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-08T18:24:41.640987] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-08T18:24:41.641043] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-08T18:24:42.002257] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:42.417525] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-08T18:24:42.567190] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T18:24:42.825183] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T18:24:43.217573] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-08T18:24:43.671568] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T18:24:44.017524] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-08T18:24:44.033628] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T18:24:44.817574] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-08T18:24:45.617573] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-08T18:24:45.942143] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T18:24:46.143301] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T18:24:46.381097] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T18:24:46.417538] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-08T18:24:47.217577] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-08T18:24:48.017514] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-08T18:24:48.137128] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:24:48.265513] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T18:24:48.268929] [INFO ] [REMOTE ] DFIN: Full fetch complete (33512 records). [2025-10-08T18:24:48.269040] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-08T18:24:48.643415] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-08T18:24:48.643494] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-08T18:24:48.644025] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-08T18:24:48.644087] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-08T18:24:48.644924] [DEBUG] [LOCAL ] DFIN: Trimmed 33512 records to 22871 (keeping 200 days of data) [2025-10-08T18:24:48.779337] [DEBUG] [LOCAL ] DFIN: Primary data saved (22871 records). [2025-10-08T18:24:48.779501] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-08T18:24:48.779606] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 35.6s. Estimated remaining: 4h 3m 3s. Rate: 7.2 symbols/min [2025-10-08T18:24:48.822442] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-08T18:24:48.933222] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T18:24:48.968749] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:49.032547] [DEBUG] [LOCAL ] DHI: Loaded 53341 existing records from primary storage. [2025-10-08T18:24:49.033016] [INFO ] [MAIN ] DHI: Loaded 53341 existing records. [2025-10-08T18:24:49.208886] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:49.209130] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-08T18:24:49.209177] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-08T18:24:49.209449] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-08T18:24:49.209507] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-08T18:24:49.565984] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:49.617509] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-08T18:24:50.417586] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-08T18:24:50.974685] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-08T18:24:51.222701] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-08T18:24:51.242765] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:24:51.839260] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:24:52.017570] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-08T18:24:52.817585] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-08T18:24:53.147697] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T18:24:53.427162] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:24:53.476867] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T18:24:53.617543] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-08T18:24:54.417623] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-08T18:24:55.217564] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-08T18:24:55.418065] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T18:24:55.828973] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T18:24:56.017590] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-08T18:24:56.817753] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-08T18:24:57.309632] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T18:24:57.617562] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-08T18:24:57.855431] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-08T18:24:57.899931] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:24:58.417619] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-08T18:24:59.203328] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T18:24:59.217482] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-08T18:24:59.533018] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T18:25:00.017632] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-08T18:25:00.817568] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-08T18:25:01.561177] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-08T18:25:01.617557] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-08T18:25:02.027177] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T18:25:02.285335] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-08T18:25:02.417586] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-08T18:25:03.217585] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-08T18:25:03.248468] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T18:25:03.254871] [INFO ] [REMOTE ] DG: Full fetch complete (76818 records). [2025-10-08T18:25:03.255004] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-08T18:25:03.259090] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:25:03.259197] [FATAL] [MAIN ] DG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:25:03.259241] [WARN ] [MAIN ] DG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:25:03.259282] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-08T18:25:03.259354] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-08T18:25:03.259409] [INFO ] [LOCAL ] DG: Starting deletion of derivative data. [2025-10-08T18:25:03.259451] [DEBUG] [LOCAL ] DG: No derivative data file found to delete. [2025-10-08T18:25:03.259513] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 42.6s. Estimated remaining: 4h 3m 12s. Rate: 7.2 symbols/min [2025-10-08T18:25:03.435864] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:03.489732] [DEBUG] [LOCAL ] DHR: Loaded 53382 existing records from primary storage. [2025-10-08T18:25:03.490066] [INFO ] [MAIN ] DHR: Loaded 53382 existing records. [2025-10-08T18:25:03.669737] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:03.670184] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-08T18:25:03.670300] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-08T18:25:03.670826] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-08T18:25:03.670884] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-08T18:25:04.028102] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-08T18:25:04.032964] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:04.058344] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T18:25:04.817524] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-08T18:25:04.859865] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T18:25:05.063216] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T18:25:05.617555] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-08T18:25:06.417583] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-08T18:25:06.592444] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T18:25:07.217710] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-08T18:25:07.508910] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T18:25:08.017505] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-08T18:25:08.052116] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T18:25:08.293561] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T18:25:08.817616] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-08T18:25:09.617522] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-08T18:25:09.832013] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T18:25:10.005803] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:25:10.417563] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-08T18:25:11.205442] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T18:25:11.217491] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-08T18:25:12.017529] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-08T18:25:12.376015] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T18:25:12.734110] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:25:12.817521] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-08T18:25:12.852386] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:25:13.617551] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-08T18:25:14.406986] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:25:14.417487] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-08T18:25:15.043473] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T18:25:15.046969] [INFO ] [REMOTE ] DGX: Full fetch complete (65136 records). [2025-10-08T18:25:15.047067] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-08T18:25:15.226602] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-08T18:25:15.444731] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-08T18:25:15.444818] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-08T18:25:15.445597] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-08T18:25:15.445693] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-08T18:25:15.446945] [DEBUG] [LOCAL ] DGX: Trimmed 65136 records to 44756 (keeping 200 days of data) [2025-10-08T18:25:15.725413] [DEBUG] [LOCAL ] DGX: Primary data saved (44756 records). [2025-10-08T18:25:15.725543] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-08T18:25:15.725668] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DGX took 35.1s. Estimated remaining: 4h 3m 16s. Rate: 7.2 symbols/min [2025-10-08T18:25:15.895200] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:15.939423] [DEBUG] [LOCAL ] DHT: Loaded 47896 existing records from primary storage. [2025-10-08T18:25:15.939803] [INFO ] [MAIN ] DHT: Loaded 47896 existing records. [2025-10-08T18:25:16.020090] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-08T18:25:16.131224] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:16.131513] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-08T18:25:16.131583] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-08T18:25:16.132005] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-08T18:25:16.132062] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-08T18:25:16.248029] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T18:25:16.513010] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:16.545356] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T18:25:16.817548] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-08T18:25:17.617531] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-08T18:25:17.754502] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:25:18.417534] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-08T18:25:18.762153] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T18:25:18.791800] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T18:25:18.794220] [INFO ] [REMOTE ] DHF: Full fetch complete (29975 records). [2025-10-08T18:25:18.794342] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-08T18:25:18.795228] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:25:18.795344] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:25:18.795407] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:25:18.795452] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-08T18:25:18.795537] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-08T18:25:18.795595] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-10-08T18:25:18.795672] [DEBUG] [LOCAL ] DHF: No derivative data file found to delete. [2025-10-08T18:25:18.795773] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHF took 37.9s. Estimated remaining: 4h 2m 53s. Rate: 7.2 symbols/min [2025-10-08T18:25:18.975938] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:18.990775] [DEBUG] [LOCAL ] DHX: Loaded 12971 existing records from primary storage. [2025-10-08T18:25:18.991033] [INFO ] [MAIN ] DHX: Loaded 12971 existing records. [2025-10-08T18:25:19.167479] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:19.167752] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-08T18:25:19.167805] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-08T18:25:19.168006] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-08T18:25:19.168063] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-08T18:25:19.229948] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-08T18:25:19.535733] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:20.017527] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-08T18:25:20.456346] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T18:25:20.811748] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T18:25:20.817483] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-08T18:25:21.058898] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:25:21.594535] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:25:21.617490] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-08T18:25:22.417559] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-08T18:25:22.713866] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:25:23.217577] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-08T18:25:24.017544] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-08T18:25:24.099097] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T18:25:24.817556] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-08T18:25:25.572572] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T18:25:25.617512] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-08T18:25:25.741286] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-08T18:25:26.330793] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:25:26.417568] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-08T18:25:27.103817] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T18:25:27.217509] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-08T18:25:28.017523] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-08T18:25:28.480743] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T18:25:28.795359] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:25:28.817495] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-08T18:25:29.617618] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-08T18:25:29.844301] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T18:25:30.144204] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T18:25:30.285770] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T18:25:30.417539] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-08T18:25:31.217615] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-08T18:25:31.882593] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:25:32.017563] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-08T18:25:32.817565] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-08T18:25:32.921746] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:25:32.925730] [INFO ] [REMOTE ] DHI: Full fetch complete (77206 records). [2025-10-08T18:25:32.925907] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-08T18:25:33.352298] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-08T18:25:33.352548] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-08T18:25:33.353560] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-08T18:25:33.353689] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-08T18:25:33.355555] [DEBUG] [LOCAL ] DHI: Trimmed 77206 records to 53342 (keeping 200 days of data) [2025-10-08T18:25:33.492865] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:25:33.617684] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-08T18:25:33.736790] [DEBUG] [LOCAL ] DHI: Primary data saved (53342 records). [2025-10-08T18:25:33.736953] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-08T18:25:33.738075] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHI took 45.0s. Estimated remaining: 4h 3m 3s. Rate: 7.2 symbols/min [2025-10-08T18:25:33.934203] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:33.945933] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T18:25:33.963140] [DEBUG] [LOCAL ] DIAX: Loaded 13133 existing records from primary storage. [2025-10-08T18:25:33.963402] [INFO ] [MAIN ] DIAX: Loaded 13133 existing records. [2025-10-08T18:25:34.161356] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:34.161667] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-08T18:25:34.161729] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-08T18:25:34.161985] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-08T18:25:34.162045] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-08T18:25:34.425437] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-08T18:25:34.603785] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:35.052525] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T18:25:35.217540] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-08T18:25:35.893289] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T18:25:36.017577] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-08T18:25:36.817540] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-08T18:25:36.891176] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T18:25:37.617619] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-08T18:25:37.764947] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T18:25:38.030231] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-08T18:25:38.417560] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-08T18:25:39.111584] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T18:25:39.115767] [INFO ] [REMOTE ] DHR: Full fetch complete (77277 records). [2025-10-08T18:25:39.115882] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-08T18:25:39.222728] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-08T18:25:39.410114] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T18:25:39.448206] [INFO ] [REMOTE ] DHT: Full fetch complete (69934 records). [2025-10-08T18:25:39.458618] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-08T18:25:39.668580] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-08T18:25:39.690009] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-08T18:25:39.701208] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-08T18:25:39.701346] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-08T18:25:39.759248] [DEBUG] [LOCAL ] DHR: Trimmed 77277 records to 53383 (keeping 200 days of data) [2025-10-08T18:25:40.020149] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-08T18:25:40.115807] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-08T18:25:40.117864] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-08T18:25:40.120398] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-08T18:25:40.121209] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-08T18:25:40.132130] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T18:25:40.141411] [DEBUG] [LOCAL ] DHT: Trimmed 69934 records to 47880 (keeping 200 days of data) [2025-10-08T18:25:40.687516] [DEBUG] [LOCAL ] DHT: Primary data saved (47880 records). [2025-10-08T18:25:40.698117] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-08T18:25:40.699920] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHT took 25.0s. Estimated remaining: 4h 2m 51s. Rate: 7.2 symbols/min [2025-10-08T18:25:40.758799] [DEBUG] [LOCAL ] DHR: Primary data saved (53383 records). [2025-10-08T18:25:40.790500] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-08T18:25:40.821600] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T18:25:40.821731] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-08T18:25:40.822044] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHR took 37.6s. Estimated remaining: 4h 2m 20s. Rate: 7.2 symbols/min [2025-10-08T18:25:41.038127] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:41.041461] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-10-08T18:25:41.041879] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-10-08T18:25:41.057836] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-08T18:25:41.063069] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-08T18:25:41.068318] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-08T18:25:41.082957] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-08T18:25:41.189619] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:41.527429] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:41.529168] [DEBUG] [LOCAL ] DINO: Loaded 52913 existing records from primary storage. [2025-10-08T18:25:41.529534] [INFO ] [MAIN ] DINO: Loaded 52913 existing records. [2025-10-08T18:25:41.622101] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-08T18:25:41.725764] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:41.726050] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-08T18:25:41.726156] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-08T18:25:41.726505] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-08T18:25:41.726562] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-08T18:25:41.844800] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T18:25:42.111339] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:42.388258] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T18:25:42.417553] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-08T18:25:43.217546] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-08T18:25:44.017552] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-08T18:25:44.335103] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T18:25:44.570300] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T18:25:44.765134] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T18:25:44.817495] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-08T18:25:45.617599] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-08T18:25:46.417566] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-08T18:25:46.729489] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T18:25:46.748306] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:25:47.217551] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-08T18:25:47.607173] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:25:48.017584] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-08T18:25:48.822679] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-08T18:25:48.842110] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T18:25:49.092166] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T18:25:49.617561] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-08T18:25:49.845395] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T18:25:50.160898] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T18:25:50.417612] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-08T18:25:51.217567] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-08T18:25:52.017521] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-08T18:25:52.235976] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:25:52.728464] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T18:25:52.745071] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T18:25:52.817543] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-08T18:25:53.494116] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T18:25:53.617587] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-08T18:25:54.417534] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-08T18:25:54.481998] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:25:55.217568] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-08T18:25:56.017540] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-08T18:25:56.177308] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T18:25:56.262133] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:25:56.817514] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-08T18:25:56.850323] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T18:25:57.617561] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-08T18:25:58.297165] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T18:25:58.347333] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T18:25:58.417560] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-08T18:25:59.210385] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T18:25:59.211794] [INFO ] [REMOTE ] DHX: Full fetch complete (20690 records). [2025-10-08T18:25:59.211865] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-08T18:25:59.222956] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-08T18:25:59.588483] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-08T18:25:59.588606] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-08T18:25:59.589207] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-08T18:25:59.589267] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-08T18:25:59.589957] [DEBUG] [LOCAL ] DHX: Trimmed 20690 records to 12939 (keeping 200 days of data) [2025-10-08T18:25:59.662220] [DEBUG] [LOCAL ] DHX: Primary data saved (12939 records). [2025-10-08T18:25:59.662369] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-08T18:25:59.662455] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHX took 40.9s. Estimated remaining: 4h 2m 41s. Rate: 7.2 symbols/min [2025-10-08T18:25:59.842507] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:59.898298] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-08T18:25:59.898839] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-08T18:26:00.022629] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-08T18:26:00.104170] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:00.104396] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-08T18:26:00.104462] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-08T18:26:00.104788] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-08T18:26:00.104850] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-08T18:26:00.469929] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:00.817552] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-08T18:26:01.284684] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T18:26:01.305959] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:26:01.307612] [INFO ] [REMOTE ] DIAX: Full fetch complete (17795 records). [2025-10-08T18:26:01.307710] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-08T18:26:01.622752] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-08T18:26:01.698399] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-08T18:26:01.698553] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-08T18:26:01.699074] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-08T18:26:01.699138] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-08T18:26:01.699910] [DEBUG] [LOCAL ] DIAX: Trimmed 17795 records to 13144 (keeping 200 days of data) [2025-10-08T18:26:01.798062] [DEBUG] [LOCAL ] DIAX: Primary data saved (13144 records). [2025-10-08T18:26:01.798221] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-08T18:26:01.798315] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 28.1s. Estimated remaining: 4h 2m 15s. Rate: 7.2 symbols/min [2025-10-08T18:26:02.001503] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:02.001739] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-08T18:26:02.001789] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-08T18:26:02.001910] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-08T18:26:02.002016] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-08T18:26:02.002101] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-08T18:26:02.002158] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-08T18:26:02.385722] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:02.417504] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-08T18:26:02.862804] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-08T18:26:03.217527] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-08T18:26:03.353423] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:26:03.426363] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-08T18:26:04.017551] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-08T18:26:04.429189] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T18:26:04.817581] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-08T18:26:05.182619] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-08T18:26:05.617569] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-08T18:26:06.036879] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T18:26:06.417533] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-08T18:26:06.480176] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-08T18:26:07.217549] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-08T18:26:08.034062] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-08T18:26:08.040687] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:26:08.817545] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-08T18:26:09.524051] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T18:26:09.562852] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-08T18:26:09.617524] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-08T18:26:09.642599] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T18:26:10.026244] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T18:26:10.417553] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-08T18:26:11.217628] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-08T18:26:11.840447] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T18:26:12.017596] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-08T18:26:12.633400] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T18:26:12.817579] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-08T18:26:13.292454] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T18:26:13.341766] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T18:26:13.617576] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-08T18:26:13.969222] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T18:26:14.417624] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-08T18:26:15.217563] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-08T18:26:15.578478] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-08T18:26:16.017581] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-08T18:26:16.130347] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T18:26:16.817562] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-08T18:26:17.176371] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T18:26:17.617577] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-08T18:26:17.952854] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T18:26:18.417681] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-08T18:26:18.638532] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T18:26:18.642592] [INFO ] [REMOTE ] DINO: Full fetch complete (76633 records). [2025-10-08T18:26:18.642776] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-08T18:26:19.033690] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-08T18:26:19.033789] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-08T18:26:19.034838] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-08T18:26:19.034905] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-08T18:26:19.036480] [DEBUG] [LOCAL ] DINO: Trimmed 76633 records to 52894 (keeping 200 days of data) [2025-10-08T18:26:19.226190] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-08T18:26:19.385907] [DEBUG] [LOCAL ] DINO: Primary data saved (52894 records). [2025-10-08T18:26:19.386145] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-08T18:26:19.386250] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DINO took 38.5s. Estimated remaining: 4h 2m 33s. Rate: 7.2 symbols/min [2025-10-08T18:26:19.565754] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:19.612608] [DEBUG] [LOCAL ] DK: Loaded 49328 existing records from primary storage. [2025-10-08T18:26:19.612962] [INFO ] [MAIN ] DK: Loaded 49328 existing records. [2025-10-08T18:26:19.796490] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:19.796845] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-08T18:26:19.796896] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-08T18:26:19.797145] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-08T18:26:19.797204] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-08T18:26:19.931837] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T18:26:19.963862] [INFO ] [REMOTE ] DIN: Full fetch complete (55245 records). [2025-10-08T18:26:19.989669] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-08T18:26:20.023105] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-08T18:26:20.373975] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:20.528005] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T18:26:20.626961] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-08T18:26:20.627060] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-08T18:26:20.627857] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-08T18:26:20.627924] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-08T18:26:20.629288] [DEBUG] [LOCAL ] DIN: Trimmed 55245 records to 37280 (keeping 200 days of data) [2025-10-08T18:26:20.829584] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-08T18:26:20.864438] [DEBUG] [LOCAL ] DIN: Primary data saved (37280 records). [2025-10-08T18:26:20.864592] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-08T18:26:20.864737] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIN took 40.2s. Estimated remaining: 4h 2m 6s. Rate: 7.2 symbols/min [2025-10-08T18:26:21.058863] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:21.080270] [DEBUG] [LOCAL ] DKL: Loaded 18057 existing records from primary storage. [2025-10-08T18:26:21.080555] [INFO ] [MAIN ] DKL: Loaded 18057 existing records. [2025-10-08T18:26:21.275347] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:21.275626] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-08T18:26:21.275719] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-08T18:26:21.276378] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-08T18:26:21.276440] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-08T18:26:21.350004] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:26:21.373300] [INFO ] [REMOTE ] DIVY: Full fetch complete (1708 records). [2025-10-08T18:26:21.397122] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-08T18:26:21.624357] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-08T18:26:21.838441] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T18:26:21.898408] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:21.898586] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:26:21.898815] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:26:21.899134] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-08T18:26:21.899227] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-08T18:26:21.899280] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-08T18:26:21.899451] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-08T18:26:21.899548] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIVY took 20.1s. Estimated remaining: 4h 1m 37s. Rate: 7.2 symbols/min [2025-10-08T18:26:22.073548] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:22.107396] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-08T18:26:22.173821] [DEBUG] [LOCAL ] DKS: Loaded 49700 existing records from primary storage. [2025-10-08T18:26:22.174194] [INFO ] [MAIN ] DKS: Loaded 49700 existing records. [2025-10-08T18:26:22.351238] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:22.351483] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-08T18:26:22.351529] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-08T18:26:22.351965] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-08T18:26:22.352021] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-08T18:26:22.425004] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-08T18:26:22.715211] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:23.051012] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T18:26:23.217577] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-08T18:26:23.620520] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:26:24.017573] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-08T18:26:24.817617] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-08T18:26:25.298287] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T18:26:25.617530] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-08T18:26:25.644665] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T18:26:26.417579] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-08T18:26:26.853998] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T18:26:27.217575] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-08T18:26:27.914018] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T18:26:28.019702] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-08T18:26:28.025936] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-08T18:26:28.762304] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T18:26:28.817615] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-08T18:26:29.617541] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-08T18:26:29.689836] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:26:30.422722] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-08T18:26:30.444684] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T18:26:31.217510] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-08T18:26:31.590017] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:26:32.017530] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-08T18:26:32.066528] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-08T18:26:32.817578] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-08T18:26:32.984260] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:26:33.617564] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-08T18:26:33.750217] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T18:26:33.896478] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T18:26:34.417554] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-08T18:26:35.217505] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-08T18:26:35.336985] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T18:26:35.967868] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-08T18:26:36.017547] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-08T18:26:36.780937] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:26:36.817512] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-08T18:26:37.316407] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T18:26:37.617575] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-08T18:26:38.417549] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-08T18:26:38.723147] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T18:26:39.217579] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-08T18:26:39.976147] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T18:26:40.015701] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-08T18:26:40.025869] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-08T18:26:40.582378] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T18:26:40.817532] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-08T18:26:41.155956] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T18:26:41.617569] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-08T18:26:42.271486] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T18:26:42.417524] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-08T18:26:43.226321] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-08T18:26:43.232073] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T18:26:43.467069] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T18:26:44.017562] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-08T18:26:44.817557] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-08T18:26:44.962243] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T18:26:45.617597] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-08T18:26:46.241139] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T18:26:46.417503] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-08T18:26:46.451159] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-08T18:26:47.217526] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-08T18:26:47.410885] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T18:26:47.655399] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:26:47.761534] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T18:26:48.017569] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-08T18:26:48.817607] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-08T18:26:49.617586] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-08T18:26:49.814430] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T18:26:49.819555] [INFO ] [REMOTE ] DKS: Full fetch complete (71638 records). [2025-10-08T18:26:49.819869] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-08T18:26:50.217064] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-08T18:26:50.217188] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-08T18:26:50.218131] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-08T18:26:50.218201] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-08T18:26:50.222678] [DEBUG] [LOCAL ] DKS: Trimmed 71638 records to 49707 (keeping 200 days of data) [2025-10-08T18:26:50.423216] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-08T18:26:50.555509] [DEBUG] [LOCAL ] DKS: Primary data saved (49707 records). [2025-10-08T18:26:50.555708] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-08T18:26:50.556824] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DKS took 28.7s. Estimated remaining: 4h 2m 26s. Rate: 7.2 symbols/min [2025-10-08T18:26:50.725930] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:50.765218] [DEBUG] [LOCAL ] DLB: Loaded 32090 existing records from primary storage. [2025-10-08T18:26:50.765532] [INFO ] [MAIN ] DLB: Loaded 32090 existing records. [2025-10-08T18:26:50.962813] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-08T18:26:50.961243] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:50.967038] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-08T18:26:50.967379] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-08T18:26:50.967285] [INFO ] [REMOTE ] DIS: Full fetch complete (77555 records). [2025-10-08T18:26:50.967715] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-08T18:26:50.967922] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-08T18:26:50.968001] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-08T18:26:51.011421] [FATAL] [VALIDATOR ] DIS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:26:51.067710] [FATAL] [MAIN ] DIS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:26:51.072176] [WARN ] [MAIN ] DIS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:26:51.072388] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-08T18:26:51.072918] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-08T18:26:51.072988] [INFO ] [LOCAL ] DIS: Starting deletion of derivative data. [2025-10-08T18:26:51.083887] [DEBUG] [LOCAL ] DIS: Deleted derivative data file. [2025-10-08T18:26:51.094330] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DIS took 51.4s. Estimated remaining: 4h 1m 55s. Rate: 7.2 symbols/min [2025-10-08T18:26:51.511181] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:51.517740] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T18:26:51.554920] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:51.557962] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-08T18:26:51.593157] [DEBUG] [LOCAL ] DLNG: Loaded 6093 existing records from primary storage. [2025-10-08T18:26:51.593439] [INFO ] [MAIN ] DLNG: Loaded 6093 existing records. [2025-10-08T18:26:51.639157] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-08T18:26:51.784261] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:51.784510] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-08T18:26:51.784557] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-08T18:26:51.784765] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-08T18:26:51.784825] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-08T18:26:52.030332] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-08T18:26:52.149740] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:52.817517] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-08T18:26:52.879380] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:26:52.976539] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T18:26:53.617530] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-08T18:26:53.652794] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T18:26:54.388484] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T18:26:54.389865] [INFO ] [REMOTE ] DKL: Full fetch complete (28087 records). [2025-10-08T18:26:54.389958] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-08T18:26:54.422805] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-08T18:26:54.772007] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-08T18:26:54.772089] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-08T18:26:54.772573] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-08T18:26:54.772612] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-08T18:26:54.773325] [DEBUG] [LOCAL ] DKL: Trimmed 28087 records to 17900 (keeping 200 days of data) [2025-10-08T18:26:54.884182] [DEBUG] [LOCAL ] DKL: Primary data saved (17900 records). [2025-10-08T18:26:54.884341] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-08T18:26:54.884454] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKL took 34.0s. Estimated remaining: 4h 1m 35s. Rate: 7.2 symbols/min [2025-10-08T18:26:55.053352] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:55.108501] [DEBUG] [LOCAL ] DLR: Loaded 50862 existing records from primary storage. [2025-10-08T18:26:55.108901] [INFO ] [MAIN ] DLR: Loaded 50862 existing records. [2025-10-08T18:26:55.217528] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-08T18:26:55.306439] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:55.306853] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-08T18:26:55.306917] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-08T18:26:55.307144] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-08T18:26:55.307191] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-08T18:26:55.569732] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T18:26:55.690394] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:56.017630] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-08T18:26:56.734720] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T18:26:56.817529] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-08T18:26:57.617605] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-08T18:26:57.840223] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T18:26:58.218819] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:26:58.417689] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-08T18:26:58.867918] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T18:26:58.873382] [INFO ] [REMOTE ] DK: Full fetch complete (70849 records). [2025-10-08T18:26:58.873577] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-08T18:26:59.013976] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T18:26:59.222691] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-08T18:26:59.301554] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-08T18:26:59.301685] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-08T18:26:59.302567] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-08T18:26:59.302619] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-08T18:26:59.304307] [DEBUG] [LOCAL ] DK: Trimmed 70849 records to 49326 (keeping 200 days of data) [2025-10-08T18:26:59.609790] [DEBUG] [LOCAL ] DK: Primary data saved (49326 records). [2025-10-08T18:26:59.609950] [INFO ] [MAIN ] DK: Full history saved. [2025-10-08T18:26:59.610037] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DK took 40.2s. Estimated remaining: 4h 1m 16s. Rate: 7.2 symbols/min [2025-10-08T18:26:59.782013] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:59.812980] [DEBUG] [LOCAL ] DLX: Loaded 28517 existing records from primary storage. [2025-10-08T18:26:59.813278] [INFO ] [MAIN ] DLX: Loaded 28517 existing records. [2025-10-08T18:26:59.987963] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:59.988248] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-08T18:26:59.988311] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-08T18:26:59.988551] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-08T18:26:59.988616] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-08T18:27:00.022776] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-08T18:27:00.350318] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:00.630388] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T18:27:00.817571] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-08T18:27:01.617574] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-08T18:27:01.973955] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T18:27:02.058765] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T18:27:02.067158] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T18:27:02.417585] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-08T18:27:03.217623] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-08T18:27:03.873963] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T18:27:04.017573] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-08T18:27:04.271110] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:27:04.817554] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-08T18:27:05.556749] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:27:05.618084] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-08T18:27:05.618011] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T18:27:05.726192] [DEBUG] [REMOTE ] DLNG: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-08T18:27:05.726489] [WARN ] [REMOTE ] DLNG: No data returned for month 2025-04 [2025-10-08T18:27:05.726582] [FATAL] [REMOTE ] DLNG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:27:05.726716] [FATAL] [MAIN ] DLNG: Failed to fetch primary data. [2025-10-08T18:27:05.726785] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:27:05.726860] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-08T18:27:05.726925] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-08T18:27:05.726959] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-10-08T18:27:05.727126] [DEBUG] [LOCAL ] DLNG: Deleted derivative data file. [2025-10-08T18:27:05.727212] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLNG took 14.6s. Estimated remaining: 4h 1m 2s. Rate: 7.2 symbols/min [2025-10-08T18:27:05.902508] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:05.926317] [DEBUG] [LOCAL ] DLY: Loaded 20249 existing records from primary storage. [2025-10-08T18:27:05.926692] [INFO ] [MAIN ] DLY: Loaded 20249 existing records. [2025-10-08T18:27:06.116498] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:06.116778] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-08T18:27:06.116840] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-08T18:27:06.117077] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-08T18:27:06.117136] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-08T18:27:06.422737] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-08T18:27:06.480317] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:07.217498] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-08T18:27:07.710048] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T18:27:08.017557] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-08T18:27:08.246964] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:27:08.817570] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-08T18:27:09.617554] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-08T18:27:09.863347] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T18:27:09.984057] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T18:27:10.417569] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-08T18:27:10.838434] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T18:27:11.217622] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-08T18:27:11.699275] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T18:27:12.017580] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-08T18:27:12.732500] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:27:12.817549] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-08T18:27:13.483164] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T18:27:13.617625] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-08T18:27:14.417600] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-08T18:27:14.649013] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T18:27:14.969383] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T18:27:15.217527] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-08T18:27:15.953725] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:27:16.017600] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-08T18:27:16.354771] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T18:27:16.817620] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-08T18:27:17.617513] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-08T18:27:17.734227] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:27:18.116128] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T18:27:18.417587] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-08T18:27:18.647905] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T18:27:19.217602] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-08T18:27:19.774424] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:27:19.778779] [INFO ] [REMOTE ] DLB: Full fetch complete (47073 records). [2025-10-08T18:27:19.778887] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-08T18:27:20.022775] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-08T18:27:20.183506] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-08T18:27:20.183596] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-08T18:27:20.184270] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-08T18:27:20.184332] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-08T18:27:20.185393] [DEBUG] [LOCAL ] DLB: Trimmed 47073 records to 32096 (keeping 200 days of data) [2025-10-08T18:27:20.388812] [DEBUG] [LOCAL ] DLB: Primary data saved (32096 records). [2025-10-08T18:27:20.388964] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-08T18:27:20.389059] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLB took 29.8s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-10-08T18:27:20.517716] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:27:20.584256] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:20.591862] [DEBUG] [LOCAL ] DMA: Loaded 4585 existing records from primary storage. [2025-10-08T18:27:20.592037] [INFO ] [MAIN ] DMA: Loaded 4585 existing records. [2025-10-08T18:27:20.771809] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:20.772075] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-08T18:27:20.772143] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-08T18:27:20.772446] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-08T18:27:20.772504] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-08T18:27:20.829625] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-08T18:27:21.135437] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:21.617508] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-08T18:27:21.851908] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T18:27:22.025184] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T18:27:22.417553] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-08T18:27:22.504865] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T18:27:23.217593] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-08T18:27:23.406350] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T18:27:23.754798] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T18:27:24.017579] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-08T18:27:24.817535] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-08T18:27:25.411603] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T18:27:25.414344] [INFO ] [REMOTE ] DLX: Full fetch complete (41318 records). [2025-10-08T18:27:25.414549] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-08T18:27:25.622771] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-08T18:27:25.820552] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-08T18:27:25.820666] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-08T18:27:25.821431] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-08T18:27:25.821493] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-08T18:27:25.822451] [DEBUG] [LOCAL ] DLX: Trimmed 41318 records to 28454 (keeping 200 days of data) [2025-10-08T18:27:25.990778] [DEBUG] [LOCAL ] DLX: Primary data saved (28454 records). [2025-10-08T18:27:25.990900] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-08T18:27:25.990981] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLX took 26.4s. Estimated remaining: 4h 0m 55s. Rate: 7.2 symbols/min [2025-10-08T18:27:26.163855] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:26.177052] [DEBUG] [LOCAL ] DMB: Loaded 10289 existing records from primary storage. [2025-10-08T18:27:26.177278] [INFO ] [MAIN ] DMB: Loaded 10289 existing records. [2025-10-08T18:27:26.365860] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T18:27:26.365469] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:26.368337] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-08T18:27:26.368405] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-08T18:27:26.378157] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-08T18:27:26.394805] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-08T18:27:26.414603] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T18:27:26.421843] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-08T18:27:26.789797] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:26.923007] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T18:27:27.217580] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-08T18:27:27.917147] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T18:27:28.017544] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-08T18:27:28.817538] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-08T18:27:28.999958] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T18:27:29.379291] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T18:27:29.617552] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-08T18:27:30.417554] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-08T18:27:31.217583] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-08T18:27:31.319285] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T18:27:32.017576] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-08T18:27:32.465107] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-08T18:27:32.490801] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T18:27:32.817539] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-08T18:27:32.880883] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T18:27:33.617550] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-08T18:27:34.307581] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T18:27:34.417579] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-08T18:27:34.596124] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-08T18:27:34.600704] [INFO ] [REMOTE ] DLR: Full fetch complete (74027 records). [2025-10-08T18:27:34.600873] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-08T18:27:34.942895] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T18:27:35.022163] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-08T18:27:35.022262] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-08T18:27:35.023128] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-08T18:27:35.023193] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-08T18:27:35.024830] [DEBUG] [LOCAL ] DLR: Trimmed 74027 records to 50850 (keeping 200 days of data) [2025-10-08T18:27:35.220405] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-08T18:27:35.372057] [DEBUG] [LOCAL ] DLR: Primary data saved (50850 records). [2025-10-08T18:27:35.372282] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-08T18:27:35.372426] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLR took 40.5s. Estimated remaining: 4h 0m 50s. Rate: 7.2 symbols/min [2025-10-08T18:27:35.567387] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:35.580185] [DEBUG] [LOCAL ] DMO: Loaded 9932 existing records from primary storage. [2025-10-08T18:27:35.580442] [INFO ] [MAIN ] DMO: Loaded 9932 existing records. [2025-10-08T18:27:35.755739] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T18:27:35.761137] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:35.763519] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-08T18:27:35.763580] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-08T18:27:35.763842] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-08T18:27:35.763901] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-08T18:27:36.022716] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-08T18:27:36.199328] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:36.807791] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T18:27:36.817495] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-08T18:27:37.617517] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-08T18:27:37.777369] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T18:27:38.378205] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:27:38.417557] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-08T18:27:39.083715] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T18:27:39.217538] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-08T18:27:39.921078] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T18:27:40.017493] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-08T18:27:40.536361] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-08T18:27:40.817632] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-08T18:27:41.338321] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T18:27:41.617559] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-08T18:27:42.151110] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T18:27:42.417556] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-08T18:27:43.028845] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:27:43.217554] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-08T18:27:44.017505] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-08T18:27:44.403098] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:27:44.482178] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T18:27:44.817560] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-08T18:27:45.624059] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-08T18:27:45.628502] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T18:27:46.417600] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-08T18:27:46.486939] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:27:47.217558] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-08T18:27:47.267576] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T18:27:47.694739] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T18:27:48.017562] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-08T18:27:48.817543] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-08T18:27:49.092941] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T18:27:49.617560] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-08T18:27:49.813879] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T18:27:50.025700] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T18:27:50.417617] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-08T18:27:50.861518] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T18:27:50.862433] [INFO ] [REMOTE ] DMA: Full fetch complete (6656 records). [2025-10-08T18:27:50.862503] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-08T18:27:51.223164] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-08T18:27:51.232025] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-08T18:27:51.232130] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-08T18:27:51.232391] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-08T18:27:51.232453] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-08T18:27:51.232993] [DEBUG] [LOCAL ] DMA: Trimmed 6656 records to 4615 (keeping 200 days of data) [2025-10-08T18:27:51.261820] [DEBUG] [LOCAL ] DMA: Primary data saved (4615 records). [2025-10-08T18:27:51.261973] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-08T18:27:51.262064] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DMA took 30.9s. Estimated remaining: 4h 1m 3s. Rate: 7.2 symbols/min [2025-10-08T18:27:51.439539] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:51.487528] [DEBUG] [LOCAL ] DNA: Loaded 48427 existing records from primary storage. [2025-10-08T18:27:51.487894] [INFO ] [MAIN ] DNA: Loaded 48427 existing records. [2025-10-08T18:27:51.689301] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:51.689604] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-08T18:27:51.689707] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-08T18:27:51.690046] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-08T18:27:51.690124] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-08T18:27:52.022743] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-08T18:27:52.161132] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:52.208040] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T18:27:52.212200] [INFO ] [REMOTE ] DLY: Full fetch complete (28358 records). [2025-10-08T18:27:52.212461] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-08T18:27:52.602603] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-08T18:27:52.602776] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-08T18:27:52.603300] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-08T18:27:52.603342] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-08T18:27:52.604148] [DEBUG] [LOCAL ] DLY: Trimmed 28358 records to 20261 (keeping 200 days of data) [2025-10-08T18:27:52.733692] [DEBUG] [LOCAL ] DLY: Primary data saved (20261 records). [2025-10-08T18:27:52.733908] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-08T18:27:52.734053] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 47.0s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-08T18:27:52.822890] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-08T18:27:52.860418] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T18:27:52.921022] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:52.968404] [DEBUG] [LOCAL ] DNOW: Loaded 43697 existing records from primary storage. [2025-10-08T18:27:52.968793] [INFO ] [MAIN ] DNOW: Loaded 43697 existing records. [2025-10-08T18:27:53.143255] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:53.143468] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-08T18:27:53.143550] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-08T18:27:53.143798] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-08T18:27:53.143855] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-08T18:27:53.492175] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:53.494909] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T18:27:53.496153] [INFO ] [REMOTE ] DMB: Full fetch complete (14881 records). [2025-10-08T18:27:53.496223] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-08T18:27:53.632789] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-08T18:27:53.854899] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-08T18:27:53.854976] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-08T18:27:53.855280] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-08T18:27:53.855317] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-08T18:27:53.855820] [DEBUG] [LOCAL ] DMB: Trimmed 14881 records to 10262 (keeping 200 days of data) [2025-10-08T18:27:53.915478] [DEBUG] [LOCAL ] DMB: Primary data saved (10262 records). [2025-10-08T18:27:53.915592] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-08T18:27:53.915694] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMB took 27.9s. Estimated remaining: 4h 0m 8s. Rate: 7.2 symbols/min [2025-10-08T18:27:54.080911] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:54.111738] [DEBUG] [LOCAL ] DNP: Loaded 33279 existing records from primary storage. [2025-10-08T18:27:54.112036] [INFO ] [MAIN ] DNP: Loaded 33279 existing records. [2025-10-08T18:27:54.286152] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:54.286352] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-08T18:27:54.286398] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-08T18:27:54.286639] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-08T18:27:54.286729] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-08T18:27:54.422843] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-08T18:27:54.644711] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:55.217634] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-08T18:27:55.261118] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T18:27:55.339984] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:27:56.017584] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-08T18:27:56.817540] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-08T18:27:57.021609] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:27:57.180496] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T18:27:57.617559] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-08T18:27:58.417507] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-08T18:27:58.475977] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T18:27:59.067724] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T18:27:59.085483] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T18:27:59.217568] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-08T18:28:00.017572] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-08T18:28:00.774677] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T18:28:00.817500] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-08T18:28:00.900862] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T18:28:01.617612] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-08T18:28:02.106569] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T18:28:02.417575] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-08T18:28:03.217578] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-08T18:28:03.503314] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T18:28:03.776259] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T18:28:03.872991] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T18:28:04.017528] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-08T18:28:04.817554] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-08T18:28:05.203811] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:28:05.617579] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-08T18:28:05.711616] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T18:28:06.417587] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-08T18:28:07.217584] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-08T18:28:07.358990] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T18:28:07.393173] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T18:28:07.723550] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T18:28:08.017563] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-08T18:28:08.817698] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-08T18:28:09.186240] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:28:09.617604] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-08T18:28:10.275772] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:28:10.417611] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-08T18:28:11.118035] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T18:28:11.119286] [INFO ] [REMOTE ] DMO: Full fetch complete (14427 records). [2025-10-08T18:28:11.119356] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-08T18:28:11.119772] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:28:11.119854] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:28:11.119915] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:28:11.119980] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-08T18:28:11.120045] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-08T18:28:11.120079] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-10-08T18:28:11.120318] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-10-08T18:28:11.120409] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMO took 35.7s. Estimated remaining: 4h 0m 24s. Rate: 7.2 symbols/min [2025-10-08T18:28:11.221289] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-08T18:28:11.325689] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:11.328677] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T18:28:11.387697] [DEBUG] [LOCAL ] DOC: Loaded 53552 existing records from primary storage. [2025-10-08T18:28:11.388050] [INFO ] [MAIN ] DOC: Loaded 53552 existing records. [2025-10-08T18:28:11.563979] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:28:11.564184] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-08T18:28:11.564230] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-08T18:28:11.564460] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-08T18:28:11.564517] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-08T18:28:11.917219] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:12.017551] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-08T18:28:12.817534] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-08T18:28:12.878818] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:28:13.506123] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T18:28:13.617497] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-08T18:28:14.301517] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:28:14.417574] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-08T18:28:15.217549] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-08T18:28:15.428863] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T18:28:16.017522] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-08T18:28:16.159457] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T18:28:16.828157] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-08T18:28:16.831140] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T18:28:17.617545] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-08T18:28:17.669502] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:28:17.923280] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T18:28:18.417515] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-08T18:28:18.879677] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T18:28:19.217569] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-08T18:28:19.734863] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T18:28:20.017547] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-08T18:28:20.798942] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T18:28:20.817507] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-08T18:28:21.617524] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-08T18:28:21.684339] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T18:28:22.417539] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-08T18:28:22.468288] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:28:23.217573] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-08T18:28:23.386447] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T18:28:23.415745] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T18:28:24.017588] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-08T18:28:24.496165] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:28:24.499513] [INFO ] [REMOTE ] DNOW: Full fetch complete (62917 records). [2025-10-08T18:28:24.499610] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-08T18:28:24.822736] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-08T18:28:24.894425] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-08T18:28:24.894508] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-08T18:28:24.895352] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-08T18:28:24.895418] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-08T18:28:24.896699] [DEBUG] [LOCAL ] DNOW: Trimmed 62917 records to 43622 (keeping 200 days of data) [2025-10-08T18:28:25.155179] [DEBUG] [LOCAL ] DNOW: Primary data saved (43622 records). [2025-10-08T18:28:25.155280] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-08T18:28:25.155364] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNOW took 32.4s. Estimated remaining: 4h 0m 31s. Rate: 7.2 symbols/min [2025-10-08T18:28:25.617593] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-08T18:28:25.772356] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T18:28:26.402418] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T18:28:26.417487] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-08T18:28:26.813064] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T18:28:27.217560] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-08T18:28:28.017561] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-08T18:28:28.175539] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T18:28:28.817544] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-08T18:28:29.072674] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T18:28:29.089922] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T18:28:29.093707] [INFO ] [REMOTE ] DNP: Full fetch complete (49023 records). [2025-10-08T18:28:29.093837] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-08T18:28:29.480862] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-08T18:28:29.480956] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-08T18:28:29.481675] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-08T18:28:29.481749] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-08T18:28:29.482960] [DEBUG] [LOCAL ] DNP: Trimmed 49023 records to 33275 (keeping 200 days of data) [2025-10-08T18:28:29.644592] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-08T18:28:29.696300] [DEBUG] [LOCAL ] DNP: Primary data saved (33275 records). [2025-10-08T18:28:29.696457] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-08T18:28:29.696594] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNP took 35.8s. Estimated remaining: 4h 0m 12s. Rate: 7.2 symbols/min [2025-10-08T18:28:30.404114] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T18:28:30.417487] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-08T18:28:31.150715] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T18:28:31.217554] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-08T18:28:32.249429] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:28:32.261254] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-08T18:28:33.182070] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T18:28:33.195093] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-08T18:28:34.330251] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T18:28:34.342965] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-08T18:28:34.790433] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T18:28:34.794918] [INFO ] [REMOTE ] DNA: Full fetch complete (71027 records). [2025-10-08T18:28:34.795091] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-08T18:28:35.204841] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-08T18:28:35.204970] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-08T18:28:35.206297] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-08T18:28:35.206379] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-08T18:28:35.208474] [DEBUG] [LOCAL ] DNA: Trimmed 71027 records to 48491 (keeping 200 days of data) [2025-10-08T18:28:35.520856] [DEBUG] [LOCAL ] DNA: Primary data saved (48491 records). [2025-10-08T18:28:35.521071] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-08T18:28:35.522502] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNA took 44.3s. Estimated remaining: 3h 59m 57s. Rate: 7.2 symbols/min [2025-10-08T18:28:35.892625] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T18:28:35.896684] [INFO ] [REMOTE ] DOC: Full fetch complete (77387 records). [2025-10-08T18:28:35.896814] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-08T18:28:36.280554] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-08T18:28:36.280635] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-08T18:28:36.281486] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-08T18:28:36.281533] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-08T18:28:36.282949] [DEBUG] [LOCAL ] DOC: Trimmed 77387 records to 53548 (keeping 200 days of data) [2025-10-08T18:28:36.611861] [DEBUG] [LOCAL ] DOC: Primary data saved (53548 records). [2025-10-08T18:28:36.612012] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-08T18:28:36.612114] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 25.5s. Estimated remaining: 3h 59m 29s. Rate: 7.2 symbols/min [2025-10-08T18:28:37.231199] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:37.286234] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:37.303190] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:37.307478] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-08T18:28:37.307609] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-08T18:28:37.307127] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:37.307822] [DEBUG] [LOCAL ] DOUG: No existing data file found in primary storage. [2025-10-08T18:28:37.308115] [WARN ] [MAIN ] DOUG: No existing data found, performing full refresh instead. [2025-10-08T18:28:37.308063] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-08T18:28:37.308734] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-08T18:28:37.308796] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-08T18:28:37.308840] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-10-08T18:28:37.308872] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-08T18:28:37.308267] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-08T18:28:37.340526] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-08T18:28:37.346740] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-08T18:28:37.644259] [DEBUG] [LOCAL ] DOLE: Loaded 38734 existing records from primary storage. [2025-10-08T18:28:37.726125] [INFO ] [MAIN ] DOLE: Loaded 38734 existing records. [2025-10-08T18:28:37.993929] [DEBUG] [LOCAL ] DOCN: Loaded 50780 existing records from primary storage. [2025-10-08T18:28:38.069591] [INFO ] [MAIN ] DOCN: Loaded 50780 existing records. [2025-10-08T18:28:38.231569] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:38.331434] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-08T18:28:38.376777] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:38.396695] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-08T18:28:38.452626] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:28:38.463179] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-08T18:28:38.468357] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-08T18:28:38.492912] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-08T18:28:38.503239] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-08T18:28:38.539216] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:28:38.555725] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-08T18:28:38.555827] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-08T18:28:38.588861] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-08T18:28:38.600388] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-08T18:28:39.187210] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:39.207904] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-08T18:28:39.295986] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:39.296334] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-08T18:28:40.026625] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:28:40.036969] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-08T18:28:40.076417] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T18:28:40.085041] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-08T18:28:40.761538] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T18:28:40.768785] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-08T18:28:41.241776] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T18:28:41.250909] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-08T18:28:41.426637] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T18:28:41.434433] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-08T18:28:41.591035] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T18:28:41.617496] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-08T18:28:41.895934] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T18:28:42.417515] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-08T18:28:42.697627] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:28:42.765493] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:28:43.112397] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T18:28:43.217576] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-08T18:28:43.741030] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:28:44.017612] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-08T18:28:44.559013] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:28:44.817576] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-08T18:28:45.088120] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T18:28:45.617555] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-08T18:28:46.177251] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T18:28:46.417559] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-08T18:28:47.217565] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-08T18:28:47.416259] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:28:47.590977] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T18:28:48.017596] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-08T18:28:48.450403] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T18:28:48.817521] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-08T18:28:49.601100] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T18:28:49.617578] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-08T18:28:49.941914] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:28:50.417610] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-08T18:28:51.217541] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-08T18:28:51.403401] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T18:28:51.910528] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:28:52.017577] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-08T18:28:52.329595] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T18:28:52.817699] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-08T18:28:53.617612] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-08T18:28:53.703898] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T18:28:53.762876] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T18:28:54.417614] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-08T18:28:55.217609] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-08T18:28:55.629302] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T18:28:55.689710] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T18:28:56.017546] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-08T18:28:56.559169] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T18:28:56.817555] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-08T18:28:57.617523] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-08T18:28:57.971091] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-08T18:28:58.143079] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T18:28:58.417546] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-08T18:28:59.069345] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:28:59.217557] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-08T18:28:59.820760] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T18:29:00.017594] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-08T18:29:00.693037] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T18:29:00.817590] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-08T18:29:01.560796] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T18:29:01.564976] [INFO ] [REMOTE ] DOLE: Full fetch complete (54289 records). [2025-10-08T18:29:01.565139] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-08T18:29:01.622724] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-08T18:29:02.008060] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-08T18:29:02.008141] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-08T18:29:02.008916] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-08T18:29:02.008982] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-08T18:29:02.012311] [DEBUG] [LOCAL ] DOLE: Trimmed 54289 records to 38840 (keeping 200 days of data) [2025-10-08T18:29:02.256099] [DEBUG] [LOCAL ] DOLE: Primary data saved (38840 records). [2025-10-08T18:29:02.256249] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-08T18:29:02.256352] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOLE took 25.6s. Estimated remaining: 4h 0m 8s. Rate: 7.2 symbols/min [2025-10-08T18:29:02.422093] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-08T18:29:02.426679] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:02.483767] [DEBUG] [LOCAL ] DOV: Loaded 45506 existing records from primary storage. [2025-10-08T18:29:02.484149] [INFO ] [MAIN ] DOV: Loaded 45506 existing records. [2025-10-08T18:29:02.666534] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:02.666875] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-08T18:29:02.666954] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-08T18:29:02.667351] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-08T18:29:02.667431] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-08T18:29:02.986461] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-08T18:29:03.084192] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:03.217523] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-08T18:29:03.374564] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T18:29:04.017516] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-08T18:29:04.210986] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T18:29:04.817579] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-08T18:29:05.010072] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T18:29:05.012895] [INFO ] [REMOTE ] DOUG: Full fetch complete (50819 records). [2025-10-08T18:29:05.013027] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-08T18:29:05.361013] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-08T18:29:05.446985] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-08T18:29:05.447063] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-08T18:29:05.447721] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-08T18:29:05.447782] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-08T18:29:05.448832] [DEBUG] [LOCAL ] DOUG: Trimmed 50819 records to 34415 (keeping 200 days of data) [2025-10-08T18:29:05.622501] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-08T18:29:05.647667] [DEBUG] [LOCAL ] DOUG: Primary data saved (34415 records). [2025-10-08T18:29:05.647822] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-08T18:29:05.647902] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOUG took 29.0s. Estimated remaining: 3h 59m 46s. Rate: 7.2 symbols/min [2025-10-08T18:29:05.846804] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:05.895571] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-08T18:29:05.895977] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-08T18:29:06.078479] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:06.078854] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-08T18:29:06.078927] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-08T18:29:06.079220] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-08T18:29:06.079301] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-08T18:29:06.427969] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-08T18:29:06.436886] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T18:29:06.475118] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:07.217524] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-08T18:29:07.780929] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T18:29:08.025590] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-08T18:29:08.046107] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T18:29:08.817534] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-08T18:29:08.847815] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T18:29:09.617521] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-08T18:29:09.774603] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T18:29:10.417551] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-08T18:29:10.844249] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-08T18:29:10.848290] [INFO ] [REMOTE ] DOCN: Full fetch complete (72045 records). [2025-10-08T18:29:10.848429] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-08T18:29:11.233930] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-08T18:29:11.284045] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-08T18:29:11.284244] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-08T18:29:11.285130] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-08T18:29:11.285208] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-08T18:29:11.295953] [DEBUG] [LOCAL ] DOCN: Trimmed 72045 records to 50781 (keeping 200 days of data) [2025-10-08T18:29:11.313711] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T18:29:11.629047] [DEBUG] [LOCAL ] DOCN: Primary data saved (50781 records). [2025-10-08T18:29:11.629229] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-08T18:29:11.629370] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCN took 35.0s. Estimated remaining: 3h 59m 32s. Rate: 7.2 symbols/min [2025-10-08T18:29:11.804173] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:11.838737] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T18:29:11.854857] [DEBUG] [LOCAL ] DPG: Loaded 13428 existing records from primary storage. [2025-10-08T18:29:11.855099] [INFO ] [MAIN ] DPG: Loaded 13428 existing records. [2025-10-08T18:29:12.026172] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-08T18:29:12.031352] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:12.032415] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-08T18:29:12.032480] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-08T18:29:12.032759] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-08T18:29:12.032831] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-08T18:29:12.391675] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:12.817581] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-08T18:29:13.465375] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-08T18:29:13.552931] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:29:13.556993] [INFO ] [REMOTE ] DOCS: Full fetch complete (74140 records). [2025-10-08T18:29:13.557119] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-08T18:29:13.625028] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-08T18:29:13.971609] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-08T18:29:13.971721] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-08T18:29:13.972588] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-08T18:29:13.972630] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-08T18:29:13.974053] [DEBUG] [LOCAL ] DOCS: Trimmed 74140 records to 50973 (keeping 200 days of data) [2025-10-08T18:29:14.282258] [DEBUG] [LOCAL ] DOCS: Primary data saved (50973 records). [2025-10-08T18:29:14.282434] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-08T18:29:14.282539] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCS took 37.7s. Estimated remaining: 3h 59m 8s. Rate: 7.2 symbols/min [2025-10-08T18:29:14.421006] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-08T18:29:14.481530] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:14.484424] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:29:14.535042] [DEBUG] [LOCAL ] DQ: Loaded 43484 existing records from primary storage. [2025-10-08T18:29:14.535355] [INFO ] [MAIN ] DQ: Loaded 43484 existing records. [2025-10-08T18:29:14.709872] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:14.710163] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-08T18:29:14.710229] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-08T18:29:14.710847] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-08T18:29:14.710907] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-08T18:29:15.065107] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:15.217555] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-08T18:29:15.260203] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T18:29:15.395096] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T18:29:16.017620] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-08T18:29:16.625045] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:29:16.661493] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:29:16.817577] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-08T18:29:17.617518] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-08T18:29:17.696344] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:29:18.417621] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-08T18:29:19.140789] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T18:29:19.217624] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-08T18:29:20.017589] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-08T18:29:20.248595] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T18:29:20.332416] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T18:29:20.817565] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-08T18:29:21.617590] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-08T18:29:21.676436] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T18:29:22.306258] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T18:29:22.417570] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-08T18:29:22.945323] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T18:29:23.069462] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T18:29:23.217555] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-08T18:29:23.834747] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T18:29:24.017548] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-08T18:29:24.817553] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-08T18:29:25.617533] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-08T18:29:25.872414] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T18:29:26.004692] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T18:29:26.417549] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-08T18:29:27.217561] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-08T18:29:27.361499] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T18:29:27.382838] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T18:29:28.017566] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-08T18:29:28.817633] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-08T18:29:29.418603] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T18:29:29.617537] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-08T18:29:29.727411] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:29:30.153910] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:29:30.417584] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-08T18:29:31.102128] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T18:29:31.217496] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-08T18:29:31.551251] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T18:29:32.017561] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-08T18:29:32.742354] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T18:29:32.817540] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-08T18:29:33.580989] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T18:29:33.617502] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-08T18:29:34.046422] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T18:29:34.417579] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-08T18:29:35.028412] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T18:29:35.217579] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-08T18:29:35.949342] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:29:36.017546] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-08T18:29:36.817562] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-08T18:29:36.879937] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-08T18:29:37.110904] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T18:29:37.508829] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T18:29:37.510268] [INFO ] [REMOTE ] DPG: Full fetch complete (18930 records). [2025-10-08T18:29:37.510341] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-08T18:29:37.622738] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-08T18:29:37.883609] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-08T18:29:37.883718] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-08T18:29:37.884143] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-08T18:29:37.884182] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-08T18:29:37.884730] [DEBUG] [LOCAL ] DPG: Trimmed 18930 records to 13460 (keeping 200 days of data) [2025-10-08T18:29:37.965806] [DEBUG] [LOCAL ] DPG: Primary data saved (13460 records). [2025-10-08T18:29:37.965943] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-08T18:29:37.966034] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DPG took 26.3s. Estimated remaining: 3h 59m 41s. Rate: 7.2 symbols/min [2025-10-08T18:29:38.133063] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:38.169812] [DEBUG] [LOCAL ] DRD: Loaded 37150 existing records from primary storage. [2025-10-08T18:29:38.170099] [INFO ] [MAIN ] DRD: Loaded 37150 existing records. [2025-10-08T18:29:38.343952] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:38.344172] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-08T18:29:38.344218] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-08T18:29:38.344441] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-08T18:29:38.344493] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-08T18:29:38.422677] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-08T18:29:38.710876] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:39.217558] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-08T18:29:39.314140] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T18:29:39.317928] [INFO ] [REMOTE ] DOV: Full fetch complete (65265 records). [2025-10-08T18:29:39.318039] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-08T18:29:39.705168] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-08T18:29:39.705252] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-08T18:29:39.706047] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-08T18:29:39.706120] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-08T18:29:39.707505] [DEBUG] [LOCAL ] DOV: Trimmed 65265 records to 45490 (keeping 200 days of data) [2025-10-08T18:29:40.008761] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T18:29:40.017987] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-08T18:29:40.025900] [DEBUG] [LOCAL ] DOV: Primary data saved (45490 records). [2025-10-08T18:29:40.025978] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-08T18:29:40.026989] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DOV took 37.8s. Estimated remaining: 3h 59m 16s. Rate: 7.2 symbols/min [2025-10-08T18:29:40.222506] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:40.240192] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T18:29:40.291734] [DEBUG] [LOCAL ] DRH: Loaded 50480 existing records from primary storage. [2025-10-08T18:29:40.292125] [INFO ] [MAIN ] DRH: Loaded 50480 existing records. [2025-10-08T18:29:40.481745] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:40.482029] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-08T18:29:40.482098] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-08T18:29:40.482392] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-08T18:29:40.482467] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-08T18:29:40.827367] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-08T18:29:40.860251] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:41.617506] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-08T18:29:41.931556] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T18:29:41.966928] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T18:29:42.417594] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-08T18:29:43.217566] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-08T18:29:43.867297] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-08T18:29:43.955760] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:29:44.017505] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-08T18:29:44.683191] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:29:44.817516] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-08T18:29:45.436233] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T18:29:45.617556] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-08T18:29:46.417574] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-08T18:29:46.687747] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T18:29:46.924975] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T18:29:47.217569] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-08T18:29:47.755267] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T18:29:47.759318] [INFO ] [REMOTE ] DQ: Full fetch complete (63214 records). [2025-10-08T18:29:47.759460] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-08T18:29:48.027687] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-08T18:29:48.161318] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-08T18:29:48.161409] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-08T18:29:48.162197] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-08T18:29:48.162260] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-08T18:29:48.163690] [DEBUG] [LOCAL ] DQ: Trimmed 63214 records to 43500 (keeping 200 days of data) [2025-10-08T18:29:48.419214] [DEBUG] [LOCAL ] DQ: Primary data saved (43500 records). [2025-10-08T18:29:48.419345] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-08T18:29:48.419452] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DQ took 34.1s. Estimated remaining: 3h 59m 8s. Rate: 7.2 symbols/min [2025-10-08T18:29:48.590936] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:48.609145] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T18:29:48.656537] [DEBUG] [LOCAL ] DRI: Loaded 47703 existing records from primary storage. [2025-10-08T18:29:48.656898] [INFO ] [MAIN ] DRI: Loaded 47703 existing records. [2025-10-08T18:29:48.826529] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-08T18:29:48.863771] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:48.864051] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-08T18:29:48.864108] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-08T18:29:48.865217] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-08T18:29:48.865287] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-08T18:29:49.246865] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:49.617574] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-08T18:29:49.917197] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-08T18:29:49.921461] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-08T18:29:49.921609] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-08T18:29:50.325542] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-08T18:29:50.325785] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-08T18:29:50.326937] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-08T18:29:50.327013] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-08T18:29:50.328605] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-10-08T18:29:50.418481] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-08T18:29:50.576711] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T18:29:50.695040] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-08T18:29:50.695187] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-08T18:29:50.695282] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOW took 45.0s. Estimated remaining: 3h 58m 43s. Rate: 7.2 symbols/min [2025-10-08T18:29:50.877260] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:50.899819] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T18:29:50.918454] [DEBUG] [LOCAL ] DRLL: Loaded 9285 existing records from primary storage. [2025-10-08T18:29:50.918862] [INFO ] [MAIN ] DRLL: Loaded 9285 existing records. [2025-10-08T18:29:51.100542] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:51.100812] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-08T18:29:51.100860] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-08T18:29:51.101305] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-08T18:29:51.101364] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-08T18:29:51.222717] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-08T18:29:51.457687] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:52.017552] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-08T18:29:52.338006] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T18:29:52.796808] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T18:29:52.817527] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-08T18:29:52.848334] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T18:29:53.617599] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-08T18:29:54.417517] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-08T18:29:54.536441] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T18:29:55.011236] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T18:29:55.059397] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T18:29:55.217567] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-08T18:29:56.017584] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-08T18:29:56.771162] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T18:29:56.817579] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-08T18:29:57.512864] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T18:29:57.617555] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-08T18:29:57.956736] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T18:29:58.417589] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-08T18:29:58.990350] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:29:59.217524] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-08T18:29:59.526052] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:29:59.803884] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T18:30:00.017559] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-08T18:30:00.817532] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-08T18:30:01.602102] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T18:30:01.617506] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-08T18:30:01.916917] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-08T18:30:02.417571] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-08T18:30:03.217522] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-08T18:30:03.558179] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T18:30:03.604071] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T18:30:04.017609] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-08T18:30:04.706879] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:30:04.817571] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-08T18:30:05.471901] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T18:30:05.617538] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-08T18:30:05.886254] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T18:30:06.417613] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-08T18:30:07.003370] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T18:30:07.021581] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T18:30:07.217551] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-08T18:30:08.017583] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-08T18:30:08.817605] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-08T18:30:09.581527] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T18:30:09.617523] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-08T18:30:10.417525] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-08T18:30:10.632732] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:30:11.019913] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T18:30:11.182493] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (3.96 seconds). [2025-10-08T18:30:11.219525] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-08T18:30:11.226106] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T18:30:11.221985] [INFO ] [REMOTE ] DRD: Full fetch complete (50427 records). [2025-10-08T18:30:11.238448] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-08T18:30:11.831892] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-08T18:30:11.831996] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-08T18:30:11.832878] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-08T18:30:11.832954] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-08T18:30:11.834479] [DEBUG] [LOCAL ] DRD: Trimmed 50427 records to 37231 (keeping 200 days of data) [2025-10-08T18:30:12.022586] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-08T18:30:12.074568] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:30:12.108949] [DEBUG] [LOCAL ] DRD: Primary data saved (37231 records). [2025-10-08T18:30:12.109135] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-08T18:30:12.109230] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 34.1s. Estimated remaining: 3h 59m 10s. Rate: 7.2 symbols/min [2025-10-08T18:30:12.279664] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:12.310398] [DEBUG] [LOCAL ] DSL: Loaded 28564 existing records from primary storage. [2025-10-08T18:30:12.310775] [INFO ] [MAIN ] DSL: Loaded 28564 existing records. [2025-10-08T18:30:12.494428] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:12.494736] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-08T18:30:12.494791] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-08T18:30:12.495691] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-08T18:30:12.495751] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-08T18:30:12.824266] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-08T18:30:12.854979] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:13.617504] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-08T18:30:13.795587] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:30:14.417515] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-08T18:30:14.499324] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T18:30:14.503701] [INFO ] [REMOTE ] DRH: Full fetch complete (71908 records). [2025-10-08T18:30:14.503847] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-08T18:30:14.895495] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-08T18:30:14.895794] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-08T18:30:14.896873] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-08T18:30:14.897008] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-08T18:30:14.898710] [DEBUG] [LOCAL ] DRH: Trimmed 71908 records to 50450 (keeping 200 days of data) [2025-10-08T18:30:15.008865] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T18:30:15.217605] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-08T18:30:15.233392] [DEBUG] [LOCAL ] DRH: Primary data saved (50450 records). [2025-10-08T18:30:15.233543] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-08T18:30:15.233632] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 35.2s. Estimated remaining: 3h 58m 48s. Rate: 7.2 symbols/min [2025-10-08T18:30:15.399146] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:15.413675] [DEBUG] [LOCAL ] DSM: Loaded 14610 existing records from primary storage. [2025-10-08T18:30:15.413923] [INFO ] [MAIN ] DSM: Loaded 14610 existing records. [2025-10-08T18:30:15.625067] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:15.625622] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-08T18:30:15.625711] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-08T18:30:15.626342] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-08T18:30:15.626402] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-08T18:30:15.990861] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:16.021297] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-08T18:30:16.028378] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T18:30:16.050533] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T18:30:16.817509] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-08T18:30:17.163713] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T18:30:17.501728] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T18:30:17.503150] [INFO ] [REMOTE ] DRLL: Full fetch complete (15051 records). [2025-10-08T18:30:17.503225] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-08T18:30:17.625073] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-08T18:30:17.893095] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-08T18:30:17.893191] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-08T18:30:17.893572] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-08T18:30:17.893612] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-08T18:30:17.894135] [DEBUG] [LOCAL ] DRLL: Trimmed 15051 records to 9289 (keeping 200 days of data) [2025-10-08T18:30:17.951462] [DEBUG] [LOCAL ] DRLL: Primary data saved (9289 records). [2025-10-08T18:30:17.951606] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-08T18:30:17.951715] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRLL took 27.3s. Estimated remaining: 3h 58m 25s. Rate: 7.2 symbols/min [2025-10-08T18:30:18.142042] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:18.145660] [DEBUG] [LOCAL ] DSMC: Loaded 1845 existing records from primary storage. [2025-10-08T18:30:18.145837] [INFO ] [MAIN ] DSMC: Loaded 1845 existing records. [2025-10-08T18:30:18.321416] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:18.321844] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-08T18:30:18.321948] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-08T18:30:18.322353] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-08T18:30:18.322428] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-08T18:30:18.424666] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-08T18:30:18.453693] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T18:30:18.694582] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:19.217555] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-08T18:30:19.723356] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-08T18:30:20.017550] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-08T18:30:20.243717] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T18:30:20.800340] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:30:20.817519] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-08T18:30:21.617533] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-08T18:30:21.978314] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T18:30:22.417571] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-08T18:30:22.847274] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T18:30:23.217562] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-08T18:30:23.645889] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T18:30:23.995908] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T18:30:24.017507] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-08T18:30:24.817572] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-08T18:30:25.617573] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-08T18:30:25.690135] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T18:30:25.750970] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T18:30:26.126399] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T18:30:26.417552] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-08T18:30:27.217561] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-08T18:30:27.620952] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-08T18:30:27.777234] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T18:30:28.017564] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-08T18:30:28.817502] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-08T18:30:28.998045] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T18:30:29.617546] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-08T18:30:30.249954] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:30:30.374846] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T18:30:30.417550] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-08T18:30:31.217536] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-08T18:30:31.251194] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T18:30:32.017592] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-08T18:30:32.652444] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T18:30:32.658325] [INFO ] [REMOTE ] DRI: Full fetch complete (69491 records). [2025-10-08T18:30:32.658601] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-08T18:30:32.825199] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-08T18:30:33.093394] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-08T18:30:33.093525] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-08T18:30:33.094445] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-08T18:30:33.094513] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-08T18:30:33.096105] [DEBUG] [LOCAL ] DRI: Trimmed 69491 records to 47675 (keeping 200 days of data) [2025-10-08T18:30:33.203296] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T18:30:33.339010] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T18:30:33.427474] [DEBUG] [LOCAL ] DRI: Primary data saved (47675 records). [2025-10-08T18:30:33.427625] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-08T18:30:33.427749] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 45.0s. Estimated remaining: 3h 58m 35s. Rate: 7.2 symbols/min [2025-10-08T18:30:33.594397] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:33.616461] [DEBUG] [LOCAL ] DSU: Loaded 22802 existing records from primary storage. [2025-10-08T18:30:33.616879] [INFO ] [MAIN ] DSU: Loaded 22802 existing records. [2025-10-08T18:30:33.627756] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-08T18:30:33.807089] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:33.807369] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-08T18:30:33.807426] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-08T18:30:33.808315] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-08T18:30:33.808378] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-08T18:30:34.155997] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:34.163946] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T18:30:34.417611] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-08T18:30:35.217564] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-08T18:30:35.587946] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T18:30:36.017593] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-08T18:30:36.274258] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T18:30:36.817549] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-08T18:30:36.865052] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T18:30:37.086067] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T18:30:37.617601] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-08T18:30:38.417521] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-08T18:30:38.787439] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-08T18:30:38.794400] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T18:30:39.217589] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-08T18:30:39.725011] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T18:30:40.017585] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-08T18:30:40.817563] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-08T18:30:41.081445] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T18:30:41.617580] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-08T18:30:41.823440] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T18:30:41.959927] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-08T18:30:42.417613] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-08T18:30:43.217574] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-08T18:30:43.315588] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T18:30:43.735463] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T18:30:44.017533] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-08T18:30:44.817683] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-08T18:30:45.158803] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T18:30:45.162282] [INFO ] [REMOTE ] DSL: Full fetch complete (41565 records). [2025-10-08T18:30:45.162370] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-08T18:30:45.533222] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-08T18:30:45.533298] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-08T18:30:45.533897] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-08T18:30:45.533959] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-08T18:30:45.534815] [DEBUG] [LOCAL ] DSL: Trimmed 41565 records to 28586 (keeping 200 days of data) [2025-10-08T18:30:45.623166] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-08T18:30:45.641103] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T18:30:45.727291] [DEBUG] [LOCAL ] DSL: Primary data saved (28586 records). [2025-10-08T18:30:45.727429] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-08T18:30:45.727511] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSL took 33.6s. Estimated remaining: 3h 58m 37s. Rate: 7.2 symbols/min [2025-10-08T18:30:45.896151] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:45.896313] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-10-08T18:30:45.896349] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-10-08T18:30:45.896464] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-08T18:30:45.896506] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-08T18:30:45.896591] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-08T18:30:45.896670] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-08T18:30:46.199715] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T18:30:46.216449] [INFO ] [REMOTE ] DSMC: Full fetch complete (2848 records). [2025-10-08T18:30:46.230382] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-08T18:30:46.281976] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:46.424487] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-08T18:30:46.610790] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-08T18:30:46.610868] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-08T18:30:46.610979] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-08T18:30:46.611021] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-08T18:30:46.611415] [DEBUG] [LOCAL ] DSMC: Trimmed 2848 records to 1842 (keeping 200 days of data) [2025-10-08T18:30:46.622901] [DEBUG] [LOCAL ] DSMC: Primary data saved (1842 records). [2025-10-08T18:30:46.622960] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-08T18:30:46.623026] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSMC took 28.7s. Estimated remaining: 3h 58m 9s. Rate: 7.2 symbols/min [2025-10-08T18:30:46.787782] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:46.787963] [DEBUG] [LOCAL ] DT: No existing data file found in primary storage. [2025-10-08T18:30:46.788000] [WARN ] [MAIN ] DT: No existing data found, performing full refresh instead. [2025-10-08T18:30:46.788111] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-08T18:30:46.788151] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-08T18:30:46.788190] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-08T18:30:46.788222] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-08T18:30:47.140759] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:47.217519] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-08T18:30:48.022681] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-08T18:30:48.032616] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:30:48.817573] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-08T18:30:48.939075] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T18:30:48.983803] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T18:30:49.617570] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-08T18:30:49.920733] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T18:30:50.417614] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-08T18:30:50.750573] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T18:30:51.217552] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-08T18:30:52.017522] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-08T18:30:52.124850] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T18:30:52.190782] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T18:30:52.687899] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:30:52.817605] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-08T18:30:53.617560] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-08T18:30:53.810275] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T18:30:54.340243] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T18:30:54.341548] [INFO ] [REMOTE ] DSM: Full fetch complete (24097 records). [2025-10-08T18:30:54.341635] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-08T18:30:54.342218] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:30:54.342321] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:30:54.342364] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:30:54.342427] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-08T18:30:54.342491] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-08T18:30:54.342526] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-10-08T18:30:54.343041] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-10-08T18:30:54.343148] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSM took 39.1s. Estimated remaining: 3h 57m 60s. Rate: 7.2 symbols/min [2025-10-08T18:30:54.422622] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-08T18:30:54.516844] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:54.525056] [DEBUG] [LOCAL ] DTB: Loaded 4948 existing records from primary storage. [2025-10-08T18:30:54.525291] [INFO ] [MAIN ] DTB: Loaded 4948 existing records. [2025-10-08T18:30:54.703577] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:54.703839] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-08T18:30:54.703886] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-08T18:30:54.704478] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-08T18:30:54.704539] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-08T18:30:55.073098] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:55.217573] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-08T18:30:56.017538] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-08T18:30:56.074621] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:30:56.133266] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T18:30:56.586488] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T18:30:56.817600] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-08T18:30:57.617704] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-08T18:30:58.081002] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T18:30:58.417512] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-08T18:30:58.783349] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:30:59.204699] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T18:30:59.217612] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-08T18:30:59.782247] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:31:00.017554] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-08T18:31:00.817582] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-08T18:31:01.330266] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:31:01.617569] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-08T18:31:02.417522] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-08T18:31:02.662052] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T18:31:02.692350] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T18:31:03.217556] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-08T18:31:03.259192] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T18:31:04.017621] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-08T18:31:04.086382] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T18:31:04.818163] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-08T18:31:04.885020] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T18:31:05.373336] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T18:31:05.617554] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-08T18:31:06.417626] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-08T18:31:06.854691] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T18:31:07.217535] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-08T18:31:07.395059] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T18:31:08.017548] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-08T18:31:08.197130] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:31:08.817579] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-08T18:31:09.617632] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-08T18:31:10.159409] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T18:31:10.303186] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T18:31:10.327614] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T18:31:10.417548] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-08T18:31:11.000394] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T18:31:11.217582] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-08T18:31:11.967225] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T18:31:12.017568] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-08T18:31:12.817557] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-08T18:31:13.617586] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-08T18:31:13.827420] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T18:31:13.922482] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T18:31:14.224713] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T18:31:14.417545] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-08T18:31:15.050106] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T18:31:15.217585] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-08T18:31:16.017554] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-08T18:31:16.333920] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T18:31:16.335957] [INFO ] [REMOTE ] DSX: Full fetch complete (36027 records). [2025-10-08T18:31:16.336057] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-08T18:31:16.336814] [FATAL] [VALIDATOR ] DSX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:31:16.336949] [FATAL] [MAIN ] DSX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:31:16.337009] [WARN ] [MAIN ] DSX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:31:16.337096] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-08T18:31:16.337185] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-08T18:31:16.337235] [INFO ] [LOCAL ] DSX: Starting deletion of derivative data. [2025-10-08T18:31:16.337288] [DEBUG] [LOCAL ] DSX: No derivative data file found to delete. [2025-10-08T18:31:16.337363] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSX took 30.6s. Estimated remaining: 3h 58m 27s. Rate: 7.2 symbols/min [2025-10-08T18:31:16.541526] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:16.547525] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-10-08T18:31:16.547609] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-10-08T18:31:16.547824] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-08T18:31:16.547924] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-08T18:31:16.548051] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-08T18:31:16.548170] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-08T18:31:16.554729] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T18:31:16.822802] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-08T18:31:16.920390] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:17.415003] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T18:31:17.416415] [INFO ] [REMOTE ] DTB: Full fetch complete (6900 records). [2025-10-08T18:31:17.416515] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-08T18:31:17.624636] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-08T18:31:17.780033] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-08T18:31:17.780125] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-08T18:31:17.780368] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-08T18:31:17.780469] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-08T18:31:17.780954] [DEBUG] [LOCAL ] DTB: Trimmed 6900 records to 5032 (keeping 200 days of data) [2025-10-08T18:31:17.815048] [DEBUG] [LOCAL ] DTB: Primary data saved (5032 records). [2025-10-08T18:31:17.815176] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-08T18:31:17.815285] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DTB took 23.5s. Estimated remaining: 3h 58m 1s. Rate: 7.2 symbols/min [2025-10-08T18:31:17.987496] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:17.987730] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-08T18:31:17.987783] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-08T18:31:17.987900] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-08T18:31:17.987941] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-08T18:31:17.987981] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-08T18:31:17.988013] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-08T18:31:18.336140] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:18.417522] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-08T18:31:19.089834] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T18:31:19.217548] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-08T18:31:19.472819] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T18:31:20.017560] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-08T18:31:20.806093] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T18:31:20.817484] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-08T18:31:21.625962] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-08T18:31:21.657409] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:31:22.182146] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:31:22.417562] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-08T18:31:22.890164] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:31:22.892314] [INFO ] [REMOTE ] DSU: Full fetch complete (32916 records). [2025-10-08T18:31:22.892395] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-08T18:31:23.226808] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-08T18:31:23.276690] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-08T18:31:23.276781] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-08T18:31:23.277300] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-08T18:31:23.277341] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-08T18:31:23.278261] [DEBUG] [LOCAL ] DSU: Trimmed 32916 records to 22858 (keeping 200 days of data) [2025-10-08T18:31:23.424755] [DEBUG] [LOCAL ] DSU: Primary data saved (22858 records). [2025-10-08T18:31:23.424897] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-08T18:31:23.424983] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DSU took 50.0s. Estimated remaining: 3h 57m 45s. Rate: 7.2 symbols/min [2025-10-08T18:31:23.602433] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:23.602635] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-08T18:31:23.602717] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-08T18:31:23.602836] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-08T18:31:23.602883] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-08T18:31:23.602927] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-08T18:31:23.602960] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-08T18:31:24.023488] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:24.023619] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-08T18:31:24.067620] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T18:31:24.471111] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T18:31:24.495162] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T18:31:24.817569] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-08T18:31:25.617553] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-08T18:31:25.707433] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T18:31:26.417670] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-08T18:31:27.220100] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-08T18:31:27.222965] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T18:31:27.228533] [INFO ] [REMOTE ] DT: Full fetch complete (76671 records). [2025-10-08T18:31:27.228731] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-08T18:31:27.644250] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-08T18:31:27.644345] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-08T18:31:27.645338] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-08T18:31:27.645408] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-08T18:31:27.647005] [DEBUG] [LOCAL ] DT: Trimmed 76671 records to 52944 (keeping 200 days of data) [2025-10-08T18:31:27.712531] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T18:31:27.909264] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T18:31:28.017836] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-08T18:31:28.028374] [DEBUG] [LOCAL ] DT: Primary data saved (52944 records). [2025-10-08T18:31:28.028556] [INFO ] [MAIN ] DT: Full history saved. [2025-10-08T18:31:28.028721] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 41.4s. Estimated remaining: 3h 57m 27s. Rate: 7.2 symbols/min [2025-10-08T18:31:28.197564] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:28.197789] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-08T18:31:28.197844] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-08T18:31:28.197955] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-08T18:31:28.198000] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-08T18:31:28.198043] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-08T18:31:28.198074] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-08T18:31:28.510791] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T18:31:28.550049] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:28.817621] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-08T18:31:29.374218] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:31:29.617567] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-08T18:31:30.056134] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:31:30.417568] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-08T18:31:31.012203] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T18:31:31.217577] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-08T18:31:31.787103] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T18:31:32.017544] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-08T18:31:32.619540] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:31:32.817560] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-08T18:31:33.318125] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T18:31:33.617605] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-08T18:31:33.985930] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:31:33.986268] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-08T18:31:33.986359] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:31:33.986409] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-08T18:31:33.986470] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:31:33.986544] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-08T18:31:33.986629] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-08T18:31:33.986707] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-08T18:31:33.986811] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-08T18:31:33.986885] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTK took 6.0s. Estimated remaining: 3h 57m 13s. Rate: 7.2 symbols/min [2025-10-08T18:31:34.170916] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:34.218327] [DEBUG] [LOCAL ] DTM: Loaded 44092 existing records from primary storage. [2025-10-08T18:31:34.218789] [INFO ] [MAIN ] DTM: Loaded 44092 existing records. [2025-10-08T18:31:34.401572] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:31:34.401875] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-08T18:31:34.401937] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-08T18:31:34.402275] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-08T18:31:34.402333] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-08T18:31:34.423624] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-08T18:31:34.769109] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:35.217549] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-08T18:31:35.545329] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T18:31:36.017542] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-08T18:31:36.404340] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-08T18:31:36.454865] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-08T18:31:36.817594] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-08T18:31:37.617576] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-08T18:31:37.993175] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T18:31:38.419936] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-08T18:31:38.422843] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:31:39.074457] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T18:31:39.217546] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-08T18:31:39.857706] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T18:31:40.017583] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-08T18:31:40.817570] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-08T18:31:41.617548] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-08T18:31:41.666394] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T18:31:41.696205] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T18:31:42.161820] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T18:31:42.417557] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-08T18:31:43.217561] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-08T18:31:43.941153] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:31:44.017569] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-08T18:31:44.084628] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T18:31:44.817596] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-08T18:31:45.218727] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T18:31:45.219514] [INFO ] [REMOTE ] DTF: Full fetch complete (1969 records). [2025-10-08T18:31:45.219587] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-08T18:31:45.424364] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-08T18:31:45.424635] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:31:45.424849] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:31:45.424937] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-08T18:31:45.425079] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-08T18:31:45.425200] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-08T18:31:45.425309] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-08T18:31:45.425423] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTF took 27.6s. Estimated remaining: 3h 57m 13s. Rate: 7.2 symbols/min [2025-10-08T18:31:45.621714] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-08T18:31:45.603264] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:45.643094] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T18:31:45.659024] [DEBUG] [LOCAL ] DTW: Loaded 4907 existing records from primary storage. [2025-10-08T18:31:45.659269] [INFO ] [MAIN ] DTW: Loaded 4907 existing records. [2025-10-08T18:31:45.838716] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:31:45.838967] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-08T18:31:45.839013] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-08T18:31:45.839318] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-08T18:31:45.839378] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-08T18:31:46.173066] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T18:31:46.218222] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:46.417585] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-08T18:31:47.217582] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-08T18:31:47.816808] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T18:31:47.877967] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T18:31:48.017592] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-08T18:31:48.483494] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T18:31:48.817575] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-08T18:31:49.545881] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:31:49.547472] [INFO ] [REMOTE ] DTG: Full fetch complete (8970 records). [2025-10-08T18:31:49.547560] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-08T18:31:49.622738] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-08T18:31:50.035134] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-08T18:31:50.035262] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-08T18:31:50.035573] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-08T18:31:50.035663] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-08T18:31:50.036193] [DEBUG] [LOCAL ] DTG: Trimmed 8970 records to 5856 (keeping 200 days of data) [2025-10-08T18:31:50.075885] [DEBUG] [LOCAL ] DTG: Primary data saved (5856 records). [2025-10-08T18:31:50.076032] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-08T18:31:50.076159] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTG took 26.7s. Estimated remaining: 3h 56m 55s. Rate: 7.2 symbols/min [2025-10-08T18:31:50.213766] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T18:31:50.296143] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:50.296357] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-08T18:31:50.296419] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-08T18:31:50.296551] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-08T18:31:50.296609] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-08T18:31:50.296683] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-08T18:31:50.296737] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-08T18:31:50.422721] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-08T18:31:50.703589] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:51.217600] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-08T18:31:52.017516] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-08T18:31:52.056713] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:31:52.817534] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-08T18:31:52.943024] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:31:53.617570] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-08T18:31:53.703839] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T18:31:54.417570] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-08T18:31:54.527729] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T18:31:55.217536] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-08T18:31:55.332231] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T18:31:55.820686] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:31:55.886527] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:31:56.017613] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-08T18:31:56.510301] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T18:31:56.817586] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-08T18:31:57.617614] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-08T18:31:58.417597] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-08T18:31:58.464602] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T18:31:59.080592] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T18:31:59.117997] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T18:31:59.217570] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-08T18:32:00.017590] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-08T18:32:00.484394] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:32:00.817569] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-08T18:32:01.050294] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T18:32:01.617594] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-08T18:32:02.409438] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T18:32:02.418751] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-08T18:32:03.217538] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-08T18:32:03.587181] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T18:32:04.017541] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-08T18:32:04.052068] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:32:04.517154] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-08T18:32:04.544851] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T18:32:04.549872] [INFO ] [REMOTE ] DTE: Full fetch complete (68794 records). [2025-10-08T18:32:04.550021] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-08T18:32:04.822705] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-08T18:32:04.981682] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-08T18:32:04.981807] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-08T18:32:04.982710] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-08T18:32:04.982775] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-08T18:32:04.984349] [DEBUG] [LOCAL ] DTE: Trimmed 68794 records to 47531 (keeping 200 days of data) [2025-10-08T18:32:05.308713] [DEBUG] [LOCAL ] DTE: Primary data saved (47531 records). [2025-10-08T18:32:05.308880] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-08T18:32:05.308968] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTE took 49.0s. Estimated remaining: 3h 57m 4s. Rate: 7.2 symbols/min [2025-10-08T18:32:05.512407] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:05.523992] [DEBUG] [LOCAL ] DUKB: Loaded 6365 existing records from primary storage. [2025-10-08T18:32:05.524271] [INFO ] [MAIN ] DUKB: Loaded 6365 existing records. [2025-10-08T18:32:05.625808] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-08T18:32:05.709914] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:05.710122] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-08T18:32:05.710206] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-08T18:32:05.710426] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-08T18:32:05.710483] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-08T18:32:06.098902] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:06.417622] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-08T18:32:06.573325] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T18:32:06.874044] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T18:32:07.217582] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-08T18:32:07.247934] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:32:08.017566] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-08T18:32:08.817531] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-08T18:32:08.977717] [DEBUG] [REMOTE ] DTW: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T18:32:08.978042] [WARN ] [REMOTE ] DTW: No data returned for month 2025-09 [2025-10-08T18:32:08.978134] [FATAL] [REMOTE ] DTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:32:08.978220] [FATAL] [MAIN ] DTW: Failed to fetch primary data. [2025-10-08T18:32:08.978282] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:32:08.978412] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-08T18:32:08.978622] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-08T18:32:08.978761] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-08T18:32:08.979032] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-10-08T18:32:08.979136] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTW took 23.6s. Estimated remaining: 3h 56m 44s. Rate: 7.2 symbols/min [2025-10-08T18:32:09.157771] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:09.189135] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-08T18:32:09.254168] [DEBUG] [LOCAL ] DV: Loaded 51295 existing records from primary storage. [2025-10-08T18:32:09.254531] [INFO ] [MAIN ] DV: Loaded 51295 existing records. [2025-10-08T18:32:09.438846] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:09.439344] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-08T18:32:09.439556] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-08T18:32:09.440302] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-08T18:32:09.440364] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-08T18:32:09.625149] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-08T18:32:09.646606] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T18:32:09.883050] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:10.417611] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-08T18:32:11.086619] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T18:32:11.217568] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-08T18:32:11.673257] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T18:32:12.017591] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-08T18:32:12.782396] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T18:32:12.798106] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:32:12.817504] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-08T18:32:13.617554] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-08T18:32:14.325244] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T18:32:14.328792] [INFO ] [REMOTE ] DTM: Full fetch complete (64829 records). [2025-10-08T18:32:14.328920] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-08T18:32:14.426223] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-08T18:32:14.714697] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-08T18:32:14.714804] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-08T18:32:14.715662] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-08T18:32:14.715728] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-08T18:32:14.717134] [DEBUG] [LOCAL ] DTM: Trimmed 64829 records to 44082 (keeping 200 days of data) [2025-10-08T18:32:15.004137] [DEBUG] [LOCAL ] DTM: Primary data saved (44082 records). [2025-10-08T18:32:15.004303] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-08T18:32:15.004408] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTM took 41.0s. Estimated remaining: 3h 56m 30s. Rate: 7.2 symbols/min [2025-10-08T18:32:15.175859] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:15.216614] [DEBUG] [LOCAL ] DVA: Loaded 41009 existing records from primary storage. [2025-10-08T18:32:15.216990] [INFO ] [MAIN ] DVA: Loaded 41009 existing records. [2025-10-08T18:32:15.249256] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-08T18:32:15.418276] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:32:15.438451] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:15.438802] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-08T18:32:15.448782] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-08T18:32:15.449852] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-08T18:32:15.449914] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-08T18:32:15.828173] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:15.961970] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T18:32:16.017564] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-08T18:32:16.239014] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T18:32:16.438010] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T18:32:16.817564] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-08T18:32:17.617550] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-08T18:32:18.417520] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-08T18:32:18.702540] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:32:18.918805] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T18:32:19.158196] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:32:19.217533] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-08T18:32:20.017567] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-08T18:32:20.676131] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T18:32:20.817609] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-08T18:32:21.422060] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:32:21.617605] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-08T18:32:21.858489] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T18:32:21.862718] [INFO ] [REMOTE ] DUK: Full fetch complete (77394 records). [2025-10-08T18:32:21.862853] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-08T18:32:22.252585] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-08T18:32:22.252704] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-08T18:32:22.253587] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-08T18:32:22.253632] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-08T18:32:22.255203] [DEBUG] [LOCAL ] DUK: Trimmed 77394 records to 53445 (keeping 200 days of data) [2025-10-08T18:32:22.440364] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-08T18:32:22.599725] [DEBUG] [LOCAL ] DUK: Primary data saved (53445 records). [2025-10-08T18:32:22.599880] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-08T18:32:22.599962] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUK took 32.5s. Estimated remaining: 3h 56m 20s. Rate: 7.2 symbols/min [2025-10-08T18:32:22.772400] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:22.772630] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-08T18:32:22.772837] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-08T18:32:22.772957] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-08T18:32:22.772999] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-08T18:32:22.773040] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-08T18:32:22.773072] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-08T18:32:23.067527] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T18:32:23.181335] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:23.183396] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:32:23.217504] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-08T18:32:24.017567] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-08T18:32:24.817585] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-08T18:32:25.411311] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T18:32:25.622696] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-08T18:32:25.643009] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-08T18:32:25.734311] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:32:26.417596] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-08T18:32:27.217621] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-08T18:32:27.286249] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T18:32:28.017538] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-08T18:32:28.817625] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-08T18:32:28.953016] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-08T18:32:29.050747] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:32:29.176377] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:32:29.617547] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-08T18:32:29.801288] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T18:32:30.417586] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-08T18:32:30.780273] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T18:32:31.013477] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T18:32:31.217603] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-08T18:32:31.945874] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:32:31.946882] [INFO ] [REMOTE ] DUKB: Full fetch complete (9369 records). [2025-10-08T18:32:31.946962] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-08T18:32:31.947382] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:32:31.947473] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:32:31.947524] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:32:31.947616] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-08T18:32:31.947836] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-08T18:32:31.947926] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-08T18:32:31.948164] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-08T18:32:31.948276] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUKB took 26.6s. Estimated remaining: 3h 56m 14s. Rate: 7.2 symbols/min [2025-10-08T18:32:32.025779] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-08T18:32:32.140598] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:32.199483] [DEBUG] [LOCAL ] DX: Loaded 52486 existing records from primary storage. [2025-10-08T18:32:32.199895] [INFO ] [MAIN ] DX: Loaded 52486 existing records. [2025-10-08T18:32:32.380150] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:32.380361] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-08T18:32:32.380433] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-08T18:32:32.381906] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-08T18:32:32.381968] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-08T18:32:32.737976] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:32.817514] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-08T18:32:33.509367] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:32:33.617500] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-08T18:32:34.384846] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T18:32:34.417502] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-08T18:32:35.015914] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T18:32:35.217582] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-08T18:32:36.017539] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-08T18:32:36.141913] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T18:32:36.817618] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-08T18:32:37.231076] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-08T18:32:37.599129] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:32:37.617496] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-08T18:32:38.227247] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T18:32:38.417532] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-08T18:32:39.167867] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T18:32:39.217499] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-08T18:32:39.661612] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:32:40.017574] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-08T18:32:40.817624] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-08T18:32:41.617988] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-08T18:32:41.619405] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-08T18:32:42.417726] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-08T18:32:42.899678] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-08T18:32:43.019424] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-08T18:32:43.227334] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-08T18:32:43.232990] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T18:32:44.017555] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-08T18:32:44.263760] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T18:32:44.817590] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-08T18:32:45.081264] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T18:32:45.085519] [INFO ] [REMOTE ] DV: Full fetch complete (73587 records). [2025-10-08T18:32:45.085715] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-08T18:32:45.486909] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-08T18:32:45.487003] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-08T18:32:45.487923] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-08T18:32:45.487992] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-08T18:32:45.489797] [DEBUG] [LOCAL ] DV: Trimmed 73587 records to 51300 (keeping 200 days of data) [2025-10-08T18:32:45.617817] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-08T18:32:45.840936] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:32:45.857210] [DEBUG] [LOCAL ] DV: Primary data saved (51300 records). [2025-10-08T18:32:45.857326] [INFO ] [MAIN ] DV: Full history saved. [2025-10-08T18:32:45.857402] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DV took 36.9s. Estimated remaining: 3h 56m 20s. Rate: 7.2 symbols/min [2025-10-08T18:32:46.045931] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:46.046410] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-10-08T18:32:46.046466] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-10-08T18:32:46.046624] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-08T18:32:46.046699] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-08T18:32:46.046757] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-08T18:32:46.046791] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-08T18:32:46.433131] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-08T18:32:46.439054] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:47.217531] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-08T18:32:47.273798] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T18:32:47.296852] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-08T18:32:48.017578] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-08T18:32:48.298284] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T18:32:48.794396] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T18:32:48.817497] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-08T18:32:49.617498] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-08T18:32:49.798684] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:32:49.891407] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T18:32:50.417554] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-08T18:32:51.217574] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-08T18:32:51.387923] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T18:32:52.017615] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-08T18:32:52.560491] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-08T18:32:52.817603] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-08T18:32:52.865451] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:32:53.617588] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-08T18:32:53.769557] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T18:32:54.417617] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-08T18:32:54.725299] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T18:32:55.217530] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-08T18:32:55.272579] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T18:32:55.847151] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:32:56.017554] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-08T18:32:56.817513] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-08T18:32:56.948544] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:32:57.384319] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T18:32:57.387665] [INFO ] [REMOTE ] DVA: Full fetch complete (59771 records). [2025-10-08T18:32:57.387804] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-08T18:32:57.623108] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-08T18:32:57.800369] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-08T18:32:57.800470] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-08T18:32:57.801258] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-08T18:32:57.801325] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-08T18:32:57.802630] [DEBUG] [LOCAL ] DVA: Trimmed 59771 records to 41008 (keeping 200 days of data) [2025-10-08T18:32:58.052150] [DEBUG] [LOCAL ] DVA: Primary data saved (41008 records). [2025-10-08T18:32:58.052288] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-08T18:32:58.052372] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVA took 43.0s. Estimated remaining: 3h 56m 21s. Rate: 7.2 symbols/min [2025-10-08T18:32:58.225212] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:58.261032] [DEBUG] [LOCAL ] DXYZ: Loaded 37024 existing records from primary storage. [2025-10-08T18:32:58.261330] [INFO ] [MAIN ] DXYZ: Loaded 37024 existing records. [2025-10-08T18:32:58.418759] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-08T18:32:58.445122] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:58.447823] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-08T18:32:58.447987] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-08T18:32:58.449635] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-08T18:32:58.449861] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-08T18:32:58.760821] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T18:32:58.848576] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:59.217574] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-08T18:32:59.792031] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-08T18:33:00.017515] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-08T18:33:00.320961] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T18:33:00.817563] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-08T18:33:00.940870] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:33:01.617580] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-08T18:33:02.149379] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-08T18:33:02.417576] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-08T18:33:02.786884] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T18:33:03.217517] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-08T18:33:04.017611] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-08T18:33:04.225103] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-08T18:33:04.257884] [INFO ] [REMOTE ] DVN: Full fetch complete (77376 records). [2025-10-08T18:33:04.260450] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-08T18:33:04.260634] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-08T18:33:04.272748] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:33:04.272898] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:33:04.272970] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:33:04.273044] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-08T18:33:04.273112] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-08T18:33:04.273148] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-08T18:33:04.273187] [DEBUG] [LOCAL ] DVN: No derivative data file found to delete. [2025-10-08T18:33:04.273264] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVN took 41.7s. Estimated remaining: 3h 56m 8s. Rate: 7.2 symbols/min [2025-10-08T18:33:04.471468] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:04.506628] [DEBUG] [LOCAL ] DY: Loaded 28615 existing records from primary storage. [2025-10-08T18:33:04.507043] [INFO ] [MAIN ] DY: Loaded 28615 existing records. [2025-10-08T18:33:04.724771] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:04.724985] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-08T18:33:04.725033] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-08T18:33:04.725927] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-08T18:33:04.725987] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-08T18:33:04.822878] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-08T18:33:05.125406] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:33:05.130508] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:05.557633] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T18:33:05.561231] [INFO ] [REMOTE ] DX: Full fetch complete (75177 records). [2025-10-08T18:33:05.561378] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-08T18:33:05.565044] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:33:05.565148] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:33:05.565190] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:33:05.565228] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-08T18:33:05.565298] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-08T18:33:05.565352] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-08T18:33:05.565604] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-08T18:33:05.565728] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DX took 33.6s. Estimated remaining: 3h 55m 42s. Rate: 7.2 symbols/min [2025-10-08T18:33:05.628569] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-08T18:33:05.739058] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:05.776812] [DEBUG] [LOCAL ] E: Loaded 33210 existing records from primary storage. [2025-10-08T18:33:05.777173] [INFO ] [MAIN ] E: Loaded 33210 existing records. [2025-10-08T18:33:05.978543] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:05.978793] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-08T18:33:05.978842] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-08T18:33:05.979686] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-08T18:33:05.979747] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-08T18:33:06.422781] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-08T18:33:06.469325] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:07.063217] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T18:33:07.154289] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-08T18:33:07.217617] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-08T18:33:08.017521] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-08T18:33:08.130135] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:33:08.212948] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T18:33:08.817558] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-08T18:33:09.617592] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-08T18:33:09.967952] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T18:33:10.417583] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-08T18:33:10.761473] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T18:33:10.827221] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T18:33:11.217617] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-08T18:33:12.020685] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-08T18:33:12.023728] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T18:33:12.814505] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T18:33:12.822136] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-08T18:33:13.362631] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T18:33:13.617570] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-08T18:33:14.224319] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T18:33:14.417588] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-08T18:33:15.054629] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T18:33:15.217556] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-08T18:33:16.017549] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-08T18:33:16.201713] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T18:33:16.265865] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T18:33:16.817580] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-08T18:33:16.960106] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T18:33:17.617622] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-08T18:33:18.417604] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-08T18:33:18.592730] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T18:33:19.049794] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:33:19.217528] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-08T18:33:19.672371] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T18:33:20.017559] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-08T18:33:20.817586] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-08T18:33:21.015032] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:33:21.617553] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-08T18:33:21.664990] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:33:21.991313] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T18:33:22.417579] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-08T18:33:23.155266] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T18:33:23.159306] [INFO ] [REMOTE ] DXC: Full fetch complete (69655 records). [2025-10-08T18:33:23.159469] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-08T18:33:23.229348] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-08T18:33:23.582847] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-08T18:33:23.582936] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-08T18:33:23.583840] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-08T18:33:23.583907] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-08T18:33:23.585337] [DEBUG] [LOCAL ] DXC: Trimmed 69655 records to 49857 (keeping 200 days of data) [2025-10-08T18:33:23.906212] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T18:33:23.933543] [DEBUG] [LOCAL ] DXC: Primary data saved (49857 records). [2025-10-08T18:33:23.933722] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-08T18:33:23.933839] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXC took 38.1s. Estimated remaining: 3h 55m 59s. Rate: 7.2 symbols/min [2025-10-08T18:33:24.026112] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-08T18:33:24.109931] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:24.152347] [DEBUG] [LOCAL ] EAF: Loaded 42243 existing records from primary storage. [2025-10-08T18:33:24.152695] [INFO ] [MAIN ] EAF: Loaded 42243 existing records. [2025-10-08T18:33:24.336218] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:24.336457] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-08T18:33:24.336505] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-08T18:33:24.337748] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-08T18:33:24.337808] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-08T18:33:24.700898] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:24.817569] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-08T18:33:25.133154] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T18:33:25.617568] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-08T18:33:25.656629] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:33:25.752689] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T18:33:26.417589] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-08T18:33:26.988585] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:33:27.217574] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-08T18:33:27.826727] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T18:33:28.017551] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-08T18:33:28.531636] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:33:28.817561] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-08T18:33:29.415373] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T18:33:29.617597] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-08T18:33:30.417567] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-08T18:33:30.826514] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T18:33:30.965068] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T18:33:31.217523] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-08T18:33:31.512572] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:33:31.514919] [INFO ] [REMOTE ] DY: Full fetch complete (43898 records). [2025-10-08T18:33:31.515006] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-08T18:33:31.900184] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-08T18:33:31.900264] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-08T18:33:31.900886] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-08T18:33:31.900961] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-08T18:33:31.903576] [DEBUG] [LOCAL ] DY: Trimmed 43898 records to 28554 (keeping 200 days of data) [2025-10-08T18:33:32.018225] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-08T18:33:32.085938] [DEBUG] [LOCAL ] DY: Primary data saved (28554 records). [2025-10-08T18:33:32.086080] [INFO ] [MAIN ] DY: Full history saved. [2025-10-08T18:33:32.086164] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DY took 27.8s. Estimated remaining: 3h 55m 50s. Rate: 7.2 symbols/min [2025-10-08T18:33:32.259468] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:32.265399] [DEBUG] [LOCAL ] EAI: Loaded 3998 existing records from primary storage. [2025-10-08T18:33:32.265597] [INFO ] [MAIN ] EAI: Loaded 3998 existing records. [2025-10-08T18:33:32.453396] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:32.453632] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-08T18:33:32.453716] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-08T18:33:32.454058] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-08T18:33:32.454117] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-08T18:33:32.830478] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-08T18:33:32.836469] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:32.890742] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T18:33:33.598824] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T18:33:33.617529] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-08T18:33:34.121275] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T18:33:34.417603] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-08T18:33:34.939265] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:33:35.217570] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-08T18:33:36.016304] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T18:33:36.024179] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-08T18:33:36.817829] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-08T18:33:36.818084] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T18:33:36.969705] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T18:33:37.617582] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-08T18:33:37.847929] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T18:33:38.417706] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-08T18:33:39.217718] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-08T18:33:39.428877] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T18:33:39.805851] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T18:33:40.017555] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-08T18:33:40.479459] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-08T18:33:40.483019] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57575 records). [2025-10-08T18:33:40.483163] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-08T18:33:40.596544] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T18:33:40.827751] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-08T18:33:40.882793] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-08T18:33:40.882877] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-08T18:33:40.883562] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-08T18:33:40.883601] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-08T18:33:40.884788] [DEBUG] [LOCAL ] DXYZ: Trimmed 57575 records to 37113 (keeping 200 days of data) [2025-10-08T18:33:41.103811] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37113 records). [2025-10-08T18:33:41.103958] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-08T18:33:41.104053] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DXYZ took 43.1s. Estimated remaining: 3h 55m 43s. Rate: 7.2 symbols/min [2025-10-08T18:33:41.270194] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:41.298935] [DEBUG] [LOCAL ] EARN: Loaded 29238 existing records from primary storage. [2025-10-08T18:33:41.299212] [INFO ] [MAIN ] EARN: Loaded 29238 existing records. [2025-10-08T18:33:41.481060] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:41.481307] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-08T18:33:41.481368] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-08T18:33:41.482223] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-08T18:33:41.482283] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-08T18:33:41.625088] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-08T18:33:41.858463] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:42.309616] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T18:33:42.417575] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-08T18:33:42.640607] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T18:33:43.217618] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-08T18:33:43.660181] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T18:33:43.662761] [INFO ] [REMOTE ] E: Full fetch complete (48025 records). [2025-10-08T18:33:43.662872] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-08T18:33:44.021684] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-08T18:33:44.037479] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-08T18:33:44.037583] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-08T18:33:44.039236] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-08T18:33:44.039396] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-08T18:33:44.040626] [DEBUG] [LOCAL ] E: Trimmed 48025 records to 33186 (keeping 200 days of data) [2025-10-08T18:33:44.248092] [DEBUG] [LOCAL ] E: Primary data saved (33186 records). [2025-10-08T18:33:44.248271] [INFO ] [MAIN ] E: Full history saved. [2025-10-08T18:33:44.248372] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. E took 38.7s. Estimated remaining: 3h 55m 22s. Rate: 7.2 symbols/min [2025-10-08T18:33:44.424380] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:44.449018] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T18:33:44.500601] [DEBUG] [LOCAL ] EAT: Loaded 49804 existing records from primary storage. [2025-10-08T18:33:44.500939] [INFO ] [MAIN ] EAT: Loaded 49804 existing records. [2025-10-08T18:33:44.678153] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:44.678399] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-08T18:33:44.678476] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-08T18:33:44.680047] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-08T18:33:44.680111] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-08T18:33:44.822717] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-08T18:33:45.048391] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:45.620584] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-08T18:33:45.625527] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:33:45.747134] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T18:33:46.417597] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-08T18:33:46.862427] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T18:33:47.217606] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-08T18:33:47.664173] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T18:33:48.017534] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-08T18:33:48.503398] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T18:33:48.817503] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-08T18:33:49.075388] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T18:33:49.259435] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T18:33:49.617559] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-08T18:33:50.417615] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-08T18:33:51.124300] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:33:51.124662] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T18:33:51.217587] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-08T18:33:52.017562] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-08T18:33:52.552567] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T18:33:52.590524] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T18:33:52.817576] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-08T18:33:53.617618] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-08T18:33:54.121254] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T18:33:54.417609] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-08T18:33:54.848825] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T18:33:54.851627] [INFO ] [REMOTE ] EAF: Full fetch complete (63179 records). [2025-10-08T18:33:54.851854] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-08T18:33:55.226269] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-08T18:33:55.243152] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-08T18:33:55.243215] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-08T18:33:55.244168] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-08T18:33:55.244331] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-08T18:33:55.245761] [DEBUG] [LOCAL ] EAF: Trimmed 63179 records to 42154 (keeping 200 days of data) [2025-10-08T18:33:55.486446] [DEBUG] [LOCAL ] EAF: Primary data saved (42154 records). [2025-10-08T18:33:55.486580] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-08T18:33:55.486695] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAF took 31.6s. Estimated remaining: 3h 55m 21s. Rate: 7.2 symbols/min [2025-10-08T18:33:55.652906] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:55.653099] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-08T18:33:55.653155] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-08T18:33:55.653269] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-08T18:33:55.653310] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-08T18:33:55.653351] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-08T18:33:55.653383] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-08T18:33:56.012207] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:56.017490] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-08T18:33:56.086052] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T18:33:56.725578] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T18:33:56.817509] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-08T18:33:57.489954] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:33:57.617530] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-08T18:33:58.004382] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T18:33:58.417556] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-08T18:33:58.823985] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T18:33:59.086384] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:33:59.217617] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-08T18:34:00.017557] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-08T18:34:00.817562] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-08T18:34:01.333717] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-08T18:34:01.392199] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T18:34:01.617574] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-08T18:34:02.399742] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T18:34:02.417525] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-08T18:34:03.115966] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T18:34:03.217528] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-08T18:34:03.930746] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T18:34:04.017519] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-08T18:34:04.756243] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T18:34:04.820346] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-08T18:34:04.822691] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T18:34:05.617553] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-08T18:34:06.417580] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-08T18:34:06.933850] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:34:06.934792] [INFO ] [REMOTE ] EAI: Full fetch complete (6124 records). [2025-10-08T18:34:06.934867] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-08T18:34:07.069854] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T18:34:07.102698] [INFO ] [REMOTE ] EARN: Full fetch complete (45718 records). [2025-10-08T18:34:07.108699] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-08T18:34:07.225740] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-08T18:34:07.527351] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-08T18:34:07.573626] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-08T18:34:07.617857] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-08T18:34:07.632127] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-08T18:34:07.687670] [DEBUG] [LOCAL ] EAI: Trimmed 6124 records to 4002 (keeping 200 days of data) [2025-10-08T18:34:07.698719] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-08T18:34:07.815411] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-08T18:34:07.816042] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-08T18:34:07.817235] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-08T18:34:07.817927] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-08T18:34:07.818544] [DEBUG] [LOCAL ] EAI: Primary data saved (4002 records). [2025-10-08T18:34:07.818859] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-08T18:34:07.818965] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAI took 35.7s. Estimated remaining: 3h 55m 22s. Rate: 7.2 symbols/min [2025-10-08T18:34:07.819953] [DEBUG] [LOCAL ] EARN: Trimmed 45718 records to 29114 (keeping 200 days of data) [2025-10-08T18:34:07.987415] [DEBUG] [LOCAL ] EARN: Primary data saved (29114 records). [2025-10-08T18:34:07.987561] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-08T18:34:07.987670] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 26.9s. Estimated remaining: 3h 54m 54s. Rate: 7.2 symbols/min [2025-10-08T18:34:08.017580] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-08T18:34:08.899830] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:34:08.910371] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-08T18:34:09.182997] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:34:09.617603] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-08T18:34:10.386623] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:34:10.417538] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-08T18:34:11.127566] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T18:34:11.217560] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-08T18:34:12.673988] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T18:34:12.682598] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-08T18:34:12.915906] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-08T18:34:12.926871] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-08T18:34:14.001394] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T18:34:14.008526] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-08T18:34:14.696476] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T18:34:14.706520] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-08T18:34:15.228198] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T18:34:15.230862] [INFO ] [REMOTE ] EB: Full fetch complete (55631 records). [2025-10-08T18:34:15.230980] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-08T18:34:15.231756] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:34:15.231839] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:34:15.231898] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:34:15.231969] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-08T18:34:15.232032] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-08T18:34:15.232067] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-08T18:34:15.232130] [DEBUG] [LOCAL ] EB: No derivative data file found to delete. [2025-10-08T18:34:15.232214] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EB took 19.7s. Estimated remaining: 3h 54m 43s. Rate: 7.2 symbols/min [2025-10-08T18:34:16.322906] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:34:16.333723] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-08T18:34:18.153859] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:34:18.164483] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-08T18:34:19.925699] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T18:34:19.938087] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-08T18:34:21.638054] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:34:21.642789] [INFO ] [REMOTE ] EAT: Full fetch complete (72088 records). [2025-10-08T18:34:21.643023] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-08T18:34:22.089244] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-08T18:34:22.089366] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-08T18:34:22.090611] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-08T18:34:22.090715] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-08T18:34:22.092776] [DEBUG] [LOCAL ] EAT: Trimmed 72088 records to 49839 (keeping 200 days of data) [2025-10-08T18:34:22.445374] [DEBUG] [LOCAL ] EAT: Primary data saved (49839 records). [2025-10-08T18:34:22.445696] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-08T18:34:22.445830] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EAT took 38.2s. Estimated remaining: 3h 54m 32s. Rate: 7.2 symbols/min [2025-10-08T18:34:23.263071] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:23.285178] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:23.284251] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:23.286399] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:23.335250] [DEBUG] [LOCAL ] EBF: Loaded 19079 existing records from primary storage. [2025-10-08T18:34:23.335812] [INFO ] [MAIN ] EBF: Loaded 19079 existing records. [2025-10-08T18:34:23.464967] [DEBUG] [LOCAL ] EBR: Loaded 43045 existing records from primary storage. [2025-10-08T18:34:23.464243] [DEBUG] [LOCAL ] EBS: Loaded 46746 existing records from primary storage. [2025-10-08T18:34:23.497102] [INFO ] [MAIN ] EBR: Loaded 43045 existing records. [2025-10-08T18:34:23.509779] [INFO ] [MAIN ] EBS: Loaded 46746 existing records. [2025-10-08T18:34:23.521551] [DEBUG] [LOCAL ] EC: Loaded 49091 existing records from primary storage. [2025-10-08T18:34:23.634337] [INFO ] [MAIN ] EC: Loaded 49091 existing records. [2025-10-08T18:34:24.056250] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:24.063676] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:24.064083] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-08T18:34:24.067222] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-08T18:34:24.067100] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:24.067598] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-08T18:34:24.067856] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-08T18:34:24.073868] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-08T18:34:24.073717] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-08T18:34:24.079374] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-08T18:34:24.079291] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-08T18:34:24.089676] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-08T18:34:24.125601] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-08T18:34:24.125636] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-08T18:34:24.145602] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-08T18:34:24.456230] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:24.500254] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-08T18:34:24.561194] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-08T18:34:24.786788] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-08T18:34:24.827266] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-08T18:34:25.454003] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:25.457367] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-08T18:34:25.449660] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:25.471038] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-08T18:34:25.457111] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:25.491632] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-08T18:34:25.664919] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:25.665286] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-08T18:34:26.937330] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T18:34:26.941058] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-08T18:34:27.236083] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T18:34:27.247548] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-08T18:34:27.658229] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-08T18:34:27.675149] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-08T18:34:27.795100] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-08T18:34:27.805521] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-08T18:34:27.836764] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T18:34:27.841083] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-08T18:34:28.702385] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T18:34:28.706977] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-08T18:34:28.813401] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:34:28.823283] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-08T18:34:29.004549] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T18:34:29.015281] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-08T18:34:29.456602] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T18:34:29.467964] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-08T18:34:29.499214] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T18:34:29.505457] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-08T18:34:30.020482] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T18:34:30.029479] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-08T18:34:30.332478] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:34:30.342892] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-08T18:34:30.362833] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T18:34:30.417570] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-08T18:34:31.277010] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T18:34:31.286728] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-08T18:34:31.526625] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-08T18:34:31.549450] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T18:34:31.717262] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:34:32.017538] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-08T18:34:32.715885] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T18:34:32.817559] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-08T18:34:33.605607] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:34:33.617492] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-08T18:34:34.065124] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T18:34:34.417577] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-08T18:34:35.217545] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-08T18:34:35.320823] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T18:34:35.876453] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:34:36.017530] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-08T18:34:36.790104] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T18:34:36.817523] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-08T18:34:37.617584] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-08T18:34:37.739827] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:34:38.417505] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-08T18:34:38.525546] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T18:34:38.625701] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T18:34:39.217611] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-08T18:34:39.968175] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T18:34:40.017575] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-08T18:34:40.817526] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-08T18:34:40.998610] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:34:41.085487] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T18:34:41.617590] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-08T18:34:42.226038] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:34:42.417518] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-08T18:34:43.122631] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:34:43.217530] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-08T18:34:43.736714] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T18:34:44.017561] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-08T18:34:44.187116] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T18:34:44.817575] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-08T18:34:45.564780] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T18:34:45.617532] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-08T18:34:46.020946] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T18:34:46.417606] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-08T18:34:47.217593] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-08T18:34:47.342038] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:34:47.770105] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:34:48.013319] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T18:34:48.015728] [INFO ] [REMOTE ] EBF: Full fetch complete (27568 records). [2025-10-08T18:34:48.015811] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-08T18:34:48.022686] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-08T18:34:48.394567] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-08T18:34:48.394818] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-08T18:34:48.395322] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-08T18:34:48.395365] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-08T18:34:48.396091] [DEBUG] [LOCAL ] EBF: Trimmed 27568 records to 19015 (keeping 200 days of data) [2025-10-08T18:34:48.511769] [DEBUG] [LOCAL ] EBF: Primary data saved (19015 records). [2025-10-08T18:34:48.511933] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-08T18:34:48.512023] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 26.1s. Estimated remaining: 3h 55m 7s. Rate: 7.2 symbols/min [2025-10-08T18:34:48.678161] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:48.709003] [DEBUG] [LOCAL ] ECAT: Loaded 29448 existing records from primary storage. [2025-10-08T18:34:48.709287] [INFO ] [MAIN ] ECAT: Loaded 29448 existing records. [2025-10-08T18:34:48.822719] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-08T18:34:48.886768] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:48.887209] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-08T18:34:48.887258] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-08T18:34:48.888349] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-08T18:34:48.888424] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-08T18:34:49.251329] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:49.507425] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T18:34:49.511062] [INFO ] [REMOTE ] EBR: Full fetch complete (62489 records). [2025-10-08T18:34:49.511220] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-08T18:34:49.622703] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-08T18:34:49.929243] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-08T18:34:49.929367] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-08T18:34:49.930571] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-08T18:34:49.930676] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-08T18:34:49.932517] [DEBUG] [LOCAL ] EBR: Trimmed 62489 records to 43127 (keeping 200 days of data) [2025-10-08T18:34:50.200431] [DEBUG] [LOCAL ] EBR: Primary data saved (43127 records). [2025-10-08T18:34:50.200563] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-08T18:34:50.200671] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBR took 27.8s. Estimated remaining: 3h 54m 43s. Rate: 7.2 symbols/min [2025-10-08T18:34:50.372901] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:50.412722] [DEBUG] [LOCAL ] ECC: Loaded 43086 existing records from primary storage. [2025-10-08T18:34:50.413050] [INFO ] [MAIN ] ECC: Loaded 43086 existing records. [2025-10-08T18:34:50.424290] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-08T18:34:50.599045] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:50.599348] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-08T18:34:50.599581] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-08T18:34:50.601180] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-08T18:34:50.601257] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-08T18:34:50.907096] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-08T18:34:51.065970] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:51.217708] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-08T18:34:51.342733] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T18:34:52.017541] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-08T18:34:52.626010] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T18:34:52.629546] [INFO ] [REMOTE ] EC: Full fetch complete (71820 records). [2025-10-08T18:34:52.629682] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-08T18:34:52.822714] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-08T18:34:53.014714] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-08T18:34:53.014817] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-08T18:34:53.015707] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-08T18:34:53.015774] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-08T18:34:53.017305] [DEBUG] [LOCAL ] EC: Trimmed 71820 records to 49065 (keeping 200 days of data) [2025-10-08T18:34:53.315295] [DEBUG] [LOCAL ] EC: Primary data saved (49065 records). [2025-10-08T18:34:53.315477] [INFO ] [MAIN ] EC: Full history saved. [2025-10-08T18:34:53.316879] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EC took 30.9s. Estimated remaining: 3h 54m 21s. Rate: 7.2 symbols/min [2025-10-08T18:34:53.489535] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:53.489737] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-08T18:34:53.489851] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-08T18:34:53.489938] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-08T18:34:53.489975] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-08T18:34:53.490015] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-08T18:34:53.490046] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-08T18:34:53.903462] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:53.903838] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-08T18:34:53.928718] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T18:34:54.417554] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-08T18:34:54.483139] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T18:34:54.553407] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T18:34:55.193504] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (4.77 seconds). [2025-10-08T18:34:55.217514] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-08T18:34:55.644347] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T18:34:56.017558] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-08T18:34:56.520423] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T18:34:56.537681] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T18:34:56.817578] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-08T18:34:57.112739] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-08T18:34:57.617550] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-08T18:34:58.417566] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-08T18:34:58.744772] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-08T18:34:59.129592] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:34:59.217566] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-08T18:35:00.017564] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-08T18:35:00.363341] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T18:35:00.817566] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-08T18:35:01.617606] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-08T18:35:01.966475] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T18:35:01.978040] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-08T18:35:02.036330] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T18:35:02.042270] [INFO ] [REMOTE ] EBS: Full fetch complete (67384 records). [2025-10-08T18:35:02.042508] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-08T18:35:02.433017] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-08T18:35:02.456135] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-08T18:35:02.456223] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-08T18:35:02.457088] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-08T18:35:02.457236] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-08T18:35:02.458993] [DEBUG] [LOCAL ] EBS: Trimmed 67384 records to 46781 (keeping 200 days of data) [2025-10-08T18:35:02.734240] [DEBUG] [LOCAL ] EBS: Primary data saved (46781 records). [2025-10-08T18:35:02.734401] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-08T18:35:02.735559] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBS took 40.3s. Estimated remaining: 3h 54m 16s. Rate: 7.2 symbols/min [2025-10-08T18:35:02.913921] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:02.915151] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-08T18:35:02.915220] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-08T18:35:02.915478] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-08T18:35:02.915544] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-08T18:35:02.915602] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-08T18:35:02.915679] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-08T18:35:03.221462] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-08T18:35:03.308484] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:03.826093] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:35:04.017544] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-08T18:35:04.167513] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T18:35:04.508981] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T18:35:04.817551] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-08T18:35:05.487727] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T18:35:05.617550] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-08T18:35:06.417628] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-08T18:35:06.867595] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T18:35:07.089196] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T18:35:07.217526] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-08T18:35:07.679754] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T18:35:08.017557] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-08T18:35:08.817555] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-08T18:35:09.335414] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T18:35:09.354585] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T18:35:09.617527] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-08T18:35:10.062687] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T18:35:10.417602] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-08T18:35:11.217551] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-08T18:35:11.543179] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-08T18:35:11.883981] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T18:35:12.017533] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-08T18:35:12.356147] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T18:35:12.817625] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-08T18:35:13.168211] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T18:35:13.617566] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-08T18:35:14.078077] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T18:35:14.079087] [INFO ] [REMOTE ] ECCC: Full fetch complete (1303 records). [2025-10-08T18:35:14.079171] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-08T18:35:14.277595] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-08T18:35:14.277828] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:35:14.277901] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:35:14.277974] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-08T18:35:14.278038] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-08T18:35:14.278075] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-08T18:35:14.278132] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-08T18:35:14.278214] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECCC took 21.0s. Estimated remaining: 3h 54m 15s. Rate: 7.2 symbols/min [2025-10-08T18:35:14.431107] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-08T18:35:14.465064] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:14.465263] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-08T18:35:14.465308] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-08T18:35:14.465423] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-08T18:35:14.465487] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-08T18:35:14.465553] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-08T18:35:14.465602] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-08T18:35:14.822801] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:15.217554] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-08T18:35:16.017577] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-08T18:35:16.410362] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T18:35:16.458729] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T18:35:16.685870] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T18:35:16.817582] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-08T18:35:17.617554] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-08T18:35:18.205671] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:35:18.417555] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-08T18:35:19.087823] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T18:35:19.217534] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-08T18:35:19.980484] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:35:20.014168] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T18:35:20.022210] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-08T18:35:20.383860] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-08T18:35:20.817608] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-08T18:35:21.617571] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-08T18:35:22.417595] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-08T18:35:22.468987] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T18:35:22.552452] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T18:35:22.932014] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-08T18:35:23.217600] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-08T18:35:23.676751] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T18:35:24.017579] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-08T18:35:24.817564] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-08T18:35:25.155779] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T18:35:25.178808] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T18:35:25.181716] [INFO ] [REMOTE ] ECAT: Full fetch complete (42950 records). [2025-10-08T18:35:25.181829] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-08T18:35:25.581469] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-08T18:35:25.581579] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-08T18:35:25.582363] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-08T18:35:25.582429] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-08T18:35:25.585305] [DEBUG] [LOCAL ] ECAT: Trimmed 42950 records to 29416 (keeping 200 days of data) [2025-10-08T18:35:25.642637] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-08T18:35:25.790499] [DEBUG] [LOCAL ] ECAT: Primary data saved (29416 records). [2025-10-08T18:35:25.790691] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-08T18:35:25.790829] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECAT took 37.3s. Estimated remaining: 3h 54m 15s. Rate: 7.2 symbols/min [2025-10-08T18:35:25.965944] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:25.966145] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-08T18:35:25.966183] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-08T18:35:25.966303] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-08T18:35:25.966344] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-08T18:35:25.966385] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-08T18:35:25.966459] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-08T18:35:26.341167] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:26.417500] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-08T18:35:27.048765] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T18:35:27.217520] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-08T18:35:27.475431] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:35:27.698428] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-08T18:35:28.017567] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-08T18:35:28.280274] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-08T18:35:28.817576] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-08T18:35:29.617636] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-08T18:35:30.022329] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T18:35:30.023125] [INFO ] [REMOTE ] ECCU: Full fetch complete (4510 records). [2025-10-08T18:35:30.023231] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-08T18:35:30.417670] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-08T18:35:30.417518] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-08T18:35:30.418755] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-08T18:35:30.419040] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-08T18:35:30.419155] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-08T18:35:30.419969] [DEBUG] [LOCAL ] ECCU: Trimmed 4510 records to 2260 (keeping 200 days of data) [2025-10-08T18:35:30.435750] [DEBUG] [LOCAL ] ECCU: Primary data saved (2260 records). [2025-10-08T18:35:30.435847] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-08T18:35:30.435919] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCU took 27.7s. Estimated remaining: 3h 53m 57s. Rate: 7.2 symbols/min [2025-10-08T18:35:30.648566] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T18:35:30.667333] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:30.724627] [DEBUG] [LOCAL ] ECG: Loaded 33518 existing records from primary storage. [2025-10-08T18:35:30.724976] [INFO ] [MAIN ] ECG: Loaded 33518 existing records. [2025-10-08T18:35:30.829396] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T18:35:30.907797] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:35:30.908067] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-08T18:35:30.908129] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-08T18:35:30.909244] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-08T18:35:30.909309] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-08T18:35:31.227735] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-08T18:35:31.271301] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:31.676703] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T18:35:32.017550] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-08T18:35:32.817583] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-08T18:35:33.318146] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T18:35:33.321593] [INFO ] [REMOTE ] ECC: Full fetch complete (60964 records). [2025-10-08T18:35:33.321799] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-08T18:35:33.622774] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-08T18:35:33.735457] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-08T18:35:33.735578] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-08T18:35:33.736536] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-08T18:35:33.736604] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-08T18:35:33.738305] [DEBUG] [LOCAL ] ECC: Trimmed 60964 records to 43089 (keeping 200 days of data) [2025-10-08T18:35:33.998377] [DEBUG] [LOCAL ] ECC: Primary data saved (43089 records). [2025-10-08T18:35:33.998555] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-08T18:35:33.998683] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECC took 43.8s. Estimated remaining: 3h 53m 37s. Rate: 7.2 symbols/min [2025-10-08T18:35:34.032707] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T18:35:34.188881] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:35:34.216582] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:34.260628] [DEBUG] [LOCAL ] ECL: Loaded 46705 existing records from primary storage. [2025-10-08T18:35:34.260966] [INFO ] [MAIN ] ECL: Loaded 46705 existing records. [2025-10-08T18:35:34.425257] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-08T18:35:34.439131] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:35:34.439420] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-08T18:35:34.439467] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-08T18:35:34.440806] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-08T18:35:34.440867] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-08T18:35:34.793128] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:34.839943] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T18:35:35.217573] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-08T18:35:36.017609] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-08T18:35:36.817600] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-08T18:35:37.107136] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T18:35:37.188699] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T18:35:37.262601] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T18:35:37.617557] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-08T18:35:38.417588] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-08T18:35:39.213634] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T18:35:39.222815] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-08T18:35:39.566423] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T18:35:39.848238] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T18:35:40.017593] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-08T18:35:40.817555] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-08T18:35:41.158659] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-08T18:35:41.532620] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T18:35:41.617508] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-08T18:35:42.417577] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-08T18:35:42.867666] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T18:35:43.115254] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T18:35:43.217631] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-08T18:35:44.017608] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-08T18:35:44.817590] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-08T18:35:44.940500] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:35:45.178993] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-08T18:35:45.323196] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T18:35:45.617568] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-08T18:35:45.965748] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T18:35:46.417700] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-08T18:35:46.834985] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T18:35:47.217585] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-08T18:35:48.017605] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-08T18:35:48.519698] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T18:35:48.817553] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-08T18:35:49.233946] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T18:35:49.617555] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-08T18:35:49.906148] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T18:35:49.947317] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-08T18:35:50.417565] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-08T18:35:50.773266] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T18:35:51.217593] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-08T18:35:52.017554] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-08T18:35:52.377768] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T18:35:52.378567] [INFO ] [REMOTE ] ECCW: Full fetch complete (1421 records). [2025-10-08T18:35:52.378690] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-08T18:35:52.590809] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-08T18:35:52.591016] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:35:52.591064] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:35:52.591131] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-08T18:35:52.591197] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-08T18:35:52.591232] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-08T18:35:52.591272] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-08T18:35:52.591346] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCW took 38.3s. Estimated remaining: 3h 53m 54s. Rate: 7.2 symbols/min [2025-10-08T18:35:52.789682] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:52.810614] [DEBUG] [LOCAL ] ECO: Loaded 18390 existing records from primary storage. [2025-10-08T18:35:52.810966] [INFO ] [MAIN ] ECO: Loaded 18390 existing records. [2025-10-08T18:35:52.822721] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-08T18:35:53.017520] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:35:53.017940] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-08T18:35:53.018038] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-08T18:35:53.018895] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-08T18:35:53.018959] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-08T18:35:53.223258] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-08T18:35:53.429092] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-08T18:35:53.434233] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:53.617674] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-08T18:35:54.417557] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-08T18:35:55.036381] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T18:35:55.217545] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-08T18:35:56.017517] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-08T18:35:56.223341] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T18:35:56.319468] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-08T18:35:56.322276] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T18:35:56.817580] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-08T18:35:57.617574] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-08T18:35:58.417521] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-08T18:35:58.522703] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:35:59.018380] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T18:35:59.217580] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-08T18:35:59.721603] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T18:35:59.722346] [INFO ] [REMOTE ] ECCX: Full fetch complete (1457 records). [2025-10-08T18:35:59.722433] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-08T18:35:59.935681] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-08T18:35:59.929596] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T18:35:59.935940] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:35:59.942805] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:35:59.943221] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-08T18:35:59.943296] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-08T18:35:59.943338] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-08T18:35:59.943380] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-08T18:35:59.943457] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCX took 34.2s. Estimated remaining: 3h 53m 43s. Rate: 7.2 symbols/min [2025-10-08T18:36:00.022630] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-08T18:36:00.124974] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:00.168735] [DEBUG] [LOCAL ] ECVT: Loaded 43236 existing records from primary storage. [2025-10-08T18:36:00.169226] [INFO ] [MAIN ] ECVT: Loaded 43236 existing records. [2025-10-08T18:36:00.349935] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:00.350255] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-08T18:36:00.350319] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-08T18:36:00.351344] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-08T18:36:00.351407] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-08T18:36:00.719232] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:00.817548] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-08T18:36:01.617557] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-08T18:36:02.417614] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-08T18:36:02.611593] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-08T18:36:02.847601] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T18:36:03.109369] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-08T18:36:03.217561] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-08T18:36:04.017524] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-08T18:36:04.138202] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:36:04.607291] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T18:36:04.817674] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-08T18:36:04.819734] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T18:36:05.617555] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-08T18:36:06.417521] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-08T18:36:06.455109] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:36:06.964522] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:36:07.217585] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-08T18:36:07.765306] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T18:36:07.768138] [INFO ] [REMOTE ] ECG: Full fetch complete (50940 records). [2025-10-08T18:36:07.768268] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-08T18:36:08.024334] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-08T18:36:08.177345] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-08T18:36:08.177448] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-08T18:36:08.178197] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-08T18:36:08.178263] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-08T18:36:08.179469] [DEBUG] [LOCAL ] ECG: Trimmed 50940 records to 33381 (keeping 200 days of data) [2025-10-08T18:36:08.387443] [DEBUG] [LOCAL ] ECG: Primary data saved (33381 records). [2025-10-08T18:36:08.387617] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-08T18:36:08.387746] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 38.0s. Estimated remaining: 3h 53m 35s. Rate: 7.2 symbols/min [2025-10-08T18:36:08.595510] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:08.655500] [DEBUG] [LOCAL ] ED: Loaded 52726 existing records from primary storage. [2025-10-08T18:36:08.655918] [INFO ] [MAIN ] ED: Loaded 52726 existing records. [2025-10-08T18:36:08.825205] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-08T18:36:08.876463] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:08.902986] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-08T18:36:08.903792] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-08T18:36:08.905865] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T18:36:08.915328] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-08T18:36:08.916979] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-08T18:36:09.309615] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:09.571106] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T18:36:09.617529] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-08T18:36:09.815247] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T18:36:10.417554] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-08T18:36:11.088667] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:36:11.092712] [INFO ] [REMOTE ] ECL: Full fetch complete (68023 records). [2025-10-08T18:36:11.092833] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-08T18:36:11.222631] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-08T18:36:11.497383] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T18:36:11.589178] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-08T18:36:11.589297] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-08T18:36:11.590618] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-08T18:36:11.590730] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-08T18:36:11.592628] [DEBUG] [LOCAL ] ECL: Trimmed 68023 records to 46683 (keeping 200 days of data) [2025-10-08T18:36:11.899025] [DEBUG] [LOCAL ] ECL: Primary data saved (46683 records). [2025-10-08T18:36:11.899169] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-08T18:36:11.899277] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECL took 37.9s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-08T18:36:12.022767] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-08T18:36:12.077060] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:12.102741] [DEBUG] [LOCAL ] EDD: Loaded 27101 existing records from primary storage. [2025-10-08T18:36:12.103003] [INFO ] [MAIN ] EDD: Loaded 27101 existing records. [2025-10-08T18:36:12.287588] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:12.287842] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-08T18:36:12.287900] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-08T18:36:12.288797] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-08T18:36:12.288857] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-08T18:36:12.645232] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:12.817566] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-08T18:36:12.908123] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T18:36:13.617612] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-08T18:36:13.857032] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T18:36:14.422250] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-08T18:36:14.428703] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:36:14.602112] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T18:36:15.217595] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-08T18:36:15.938888] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T18:36:16.017531] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-08T18:36:16.702586] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T18:36:16.745604] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T18:36:16.817554] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-08T18:36:17.617597] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-08T18:36:17.798850] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:36:18.417605] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-08T18:36:18.650375] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:36:19.218635] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-08T18:36:19.220772] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T18:36:20.017562] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-08T18:36:20.817527] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-08T18:36:21.026895] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T18:36:21.159864] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T18:36:21.617562] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-08T18:36:21.844559] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T18:36:22.417574] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-08T18:36:23.100579] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T18:36:23.217569] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-08T18:36:23.496569] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T18:36:23.498355] [INFO ] [REMOTE ] ECO: Full fetch complete (28675 records). [2025-10-08T18:36:23.498440] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-08T18:36:23.879181] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-08T18:36:23.879266] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-08T18:36:23.879783] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-08T18:36:23.879845] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-08T18:36:23.880610] [DEBUG] [LOCAL ] ECO: Trimmed 28675 records to 18349 (keeping 200 days of data) [2025-10-08T18:36:23.992604] [DEBUG] [LOCAL ] ECO: Primary data saved (18349 records). [2025-10-08T18:36:23.992797] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-08T18:36:23.992894] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECO took 31.4s. Estimated remaining: 3h 53m 16s. Rate: 7.2 symbols/min [2025-10-08T18:36:24.022884] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-08T18:36:24.168013] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:24.182191] [DEBUG] [LOCAL ] EDF: Loaded 13197 existing records from primary storage. [2025-10-08T18:36:24.182463] [INFO ] [MAIN ] EDF: Loaded 13197 existing records. [2025-10-08T18:36:24.361358] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:24.361875] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-08T18:36:24.361939] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-08T18:36:24.362337] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-08T18:36:24.362394] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-08T18:36:24.745918] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:24.758669] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T18:36:24.817519] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-08T18:36:25.617532] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-08T18:36:25.659355] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T18:36:26.417514] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-08T18:36:26.588554] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T18:36:26.910760] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T18:36:27.217557] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-08T18:36:27.362684] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T18:36:28.017613] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-08T18:36:28.393445] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T18:36:28.817545] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-08T18:36:29.617582] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-08T18:36:29.834613] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T18:36:29.950212] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T18:36:30.348806] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T18:36:30.417542] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-08T18:36:31.217520] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-08T18:36:31.371270] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T18:36:32.017627] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-08T18:36:32.740143] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T18:36:32.808212] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T18:36:32.817499] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-08T18:36:33.617567] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-08T18:36:33.984395] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:36:34.417592] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-08T18:36:34.749267] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T18:36:34.752760] [INFO ] [REMOTE ] ECVT: Full fetch complete (60187 records). [2025-10-08T18:36:34.752857] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-08T18:36:35.134042] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-08T18:36:35.134178] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-08T18:36:35.135055] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-08T18:36:35.135119] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-08T18:36:35.136589] [DEBUG] [LOCAL ] ECVT: Trimmed 60187 records to 43281 (keeping 200 days of data) [2025-10-08T18:36:35.226049] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-08T18:36:35.393372] [DEBUG] [LOCAL ] ECVT: Primary data saved (43281 records). [2025-10-08T18:36:35.393500] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-08T18:36:35.393598] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 35.4s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-08T18:36:35.482767] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T18:36:35.573893] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:35.591815] [DEBUG] [LOCAL ] EDN: Loaded 18236 existing records from primary storage. [2025-10-08T18:36:35.592051] [INFO ] [MAIN ] EDN: Loaded 18236 existing records. [2025-10-08T18:36:35.766486] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:35.766732] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-08T18:36:35.766785] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-08T18:36:35.767364] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-08T18:36:35.767423] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-08T18:36:36.022782] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-08T18:36:36.118710] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:36.817508] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-08T18:36:37.363666] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-08T18:36:37.395231] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T18:36:37.617516] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-08T18:36:37.928440] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T18:36:38.417599] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-08T18:36:39.099955] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T18:36:39.131946] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T18:36:39.217519] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-08T18:36:40.017571] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-08T18:36:40.702394] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T18:36:40.717916] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T18:36:40.817551] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-08T18:36:41.617525] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-08T18:36:41.961928] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T18:36:42.417562] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-08T18:36:42.714159] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:36:43.137563] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T18:36:43.217538] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-08T18:36:44.017544] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-08T18:36:44.817583] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-08T18:36:45.081412] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T18:36:45.264397] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T18:36:45.297109] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T18:36:45.617558] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-08T18:36:46.417523] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-08T18:36:46.475115] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T18:36:47.217544] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-08T18:36:48.017522] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-08T18:36:48.041894] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T18:36:48.043458] [INFO ] [REMOTE ] EDF: Full fetch complete (20621 records). [2025-10-08T18:36:48.043543] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-08T18:36:48.365674] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T18:36:48.459751] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-08T18:36:48.459835] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-08T18:36:48.460279] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-08T18:36:48.460320] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-08T18:36:48.460910] [DEBUG] [LOCAL ] EDF: Trimmed 20621 records to 13210 (keeping 200 days of data) [2025-10-08T18:36:48.536091] [DEBUG] [LOCAL ] EDF: Primary data saved (13210 records). [2025-10-08T18:36:48.536236] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-08T18:36:48.536323] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDF took 24.5s. Estimated remaining: 3h 53m 18s. Rate: 7.2 symbols/min [2025-10-08T18:36:48.703051] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:48.746678] [DEBUG] [LOCAL ] EDU: Loaded 44805 existing records from primary storage. [2025-10-08T18:36:48.747005] [INFO ] [MAIN ] EDU: Loaded 44805 existing records. [2025-10-08T18:36:48.821105] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-08T18:36:48.933553] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:48.933926] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-08T18:36:48.934005] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-08T18:36:48.940335] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-08T18:36:48.945254] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-08T18:36:48.978031] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T18:36:49.311203] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:49.617571] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-08T18:36:50.340529] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T18:36:50.344971] [INFO ] [REMOTE ] ED: Full fetch complete (76301 records). [2025-10-08T18:36:50.345118] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-08T18:36:50.425005] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-08T18:36:50.751812] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-08T18:36:50.751991] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-08T18:36:50.752959] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-08T18:36:50.753022] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-08T18:36:50.754586] [DEBUG] [LOCAL ] ED: Trimmed 76301 records to 52710 (keeping 200 days of data) [2025-10-08T18:36:50.862048] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T18:36:51.107028] [DEBUG] [LOCAL ] ED: Primary data saved (52710 records). [2025-10-08T18:36:51.107173] [INFO ] [MAIN ] ED: Full history saved. [2025-10-08T18:36:51.108171] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. ED took 42.7s. Estimated remaining: 3h 52m 56s. Rate: 7.2 symbols/min [2025-10-08T18:36:51.222777] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-08T18:36:51.280000] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:51.317742] [DEBUG] [LOCAL ] EE: Loaded 32733 existing records from primary storage. [2025-10-08T18:36:51.318067] [INFO ] [MAIN ] EE: Loaded 32733 existing records. [2025-10-08T18:36:51.494041] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:51.494310] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-08T18:36:51.494360] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-08T18:36:51.495373] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-08T18:36:51.495438] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-08T18:36:51.864385] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:52.017620] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-08T18:36:52.437395] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T18:36:52.555868] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T18:36:52.559920] [INFO ] [REMOTE ] EDD: Full fetch complete (38597 records). [2025-10-08T18:36:52.560152] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-08T18:36:52.822851] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-08T18:36:53.085358] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-08T18:36:53.085560] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-08T18:36:53.086520] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-08T18:36:53.086689] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-08T18:36:53.101966] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T18:36:53.107272] [DEBUG] [LOCAL ] EDD: Trimmed 38597 records to 26944 (keeping 200 days of data) [2025-10-08T18:36:53.279057] [DEBUG] [LOCAL ] EDD: Primary data saved (26944 records). [2025-10-08T18:36:53.279219] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-08T18:36:53.279310] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDD took 41.4s. Estimated remaining: 3h 52m 33s. Rate: 7.2 symbols/min [2025-10-08T18:36:53.450469] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:53.450715] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-08T18:36:53.450777] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-08T18:36:53.450890] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-08T18:36:53.450933] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-08T18:36:53.450973] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-08T18:36:53.451003] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-08T18:36:53.622779] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-08T18:36:53.878172] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:54.405419] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T18:36:54.417495] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-08T18:36:55.217521] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-08T18:36:55.306139] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T18:36:55.791475] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T18:36:56.017524] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-08T18:36:56.339450] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-08T18:36:56.757974] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T18:36:56.817571] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-08T18:36:57.617513] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-08T18:36:57.695502] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T18:36:58.417551] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-08T18:36:59.217552] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-08T18:36:59.433842] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:36:59.499630] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:36:59.863696] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T18:37:00.017548] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-08T18:37:00.817547] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-08T18:37:01.209976] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T18:37:01.617559] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-08T18:37:01.956070] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T18:37:02.417559] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-08T18:37:02.942891] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T18:37:03.217551] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-08T18:37:03.608886] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T18:37:04.017576] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-08T18:37:04.764813] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T18:37:04.817638] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-08T18:37:05.617552] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-08T18:37:05.810974] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T18:37:05.813159] [INFO ] [REMOTE ] EDN: Full fetch complete (29592 records). [2025-10-08T18:37:05.813302] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-08T18:37:05.936507] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T18:37:06.248816] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-08T18:37:06.248902] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-08T18:37:06.249443] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-08T18:37:06.249486] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-08T18:37:06.250205] [DEBUG] [LOCAL ] EDN: Trimmed 29592 records to 18262 (keeping 200 days of data) [2025-10-08T18:37:06.359875] [DEBUG] [LOCAL ] EDN: Primary data saved (18262 records). [2025-10-08T18:37:06.360051] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-08T18:37:06.360146] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 31.0s. Estimated remaining: 3h 52m 36s. Rate: 7.2 symbols/min [2025-10-08T18:37:06.426702] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-08T18:37:06.541977] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:06.559040] [DEBUG] [LOCAL ] EEX: Loaded 10938 existing records from primary storage. [2025-10-08T18:37:06.559544] [INFO ] [MAIN ] EEX: Loaded 10938 existing records. [2025-10-08T18:37:06.744856] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:06.745139] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-08T18:37:06.745187] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-08T18:37:06.745944] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-08T18:37:06.746019] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-08T18:37:07.173438] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:07.196626] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:37:07.217494] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-08T18:37:07.801025] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T18:37:08.017565] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-08T18:37:08.587241] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T18:37:08.817561] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-08T18:37:09.451101] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T18:37:09.617580] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-08T18:37:09.801197] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T18:37:10.417534] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-08T18:37:10.882192] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T18:37:10.934596] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T18:37:11.217551] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-08T18:37:11.866492] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T18:37:12.017563] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-08T18:37:12.443802] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T18:37:12.817563] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-08T18:37:13.295941] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T18:37:13.617612] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-08T18:37:14.417613] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-08T18:37:15.042104] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T18:37:15.217518] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-08T18:37:15.299066] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T18:37:16.017557] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-08T18:37:16.685580] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T18:37:16.817552] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-08T18:37:17.084853] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T18:37:17.617574] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-08T18:37:17.998299] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T18:37:18.360473] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:37:18.417506] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-08T18:37:18.805440] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-08T18:37:19.217566] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-08T18:37:20.017566] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-08T18:37:20.509533] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T18:37:20.817618] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-08T18:37:21.356144] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T18:37:21.357063] [INFO ] [REMOTE ] EEA: Full fetch complete (3862 records). [2025-10-08T18:37:21.357139] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-08T18:37:21.565386] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T18:37:21.565887] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:37:21.566100] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:37:21.566210] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-08T18:37:21.566461] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-08T18:37:21.566609] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-08T18:37:21.566898] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-08T18:37:21.567042] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EEA took 28.3s. Estimated remaining: 3h 52m 44s. Rate: 7.2 symbols/min [2025-10-08T18:37:21.627553] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-08T18:37:21.793694] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T18:37:21.797455] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:21.857235] [DEBUG] [LOCAL ] EFC: Loaded 46373 existing records from primary storage. [2025-10-08T18:37:21.857633] [INFO ] [MAIN ] EFC: Loaded 46373 existing records. [2025-10-08T18:37:22.048918] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:22.049224] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-08T18:37:22.049283] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-08T18:37:22.050779] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-08T18:37:22.050841] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-08T18:37:22.410208] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:22.417497] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-08T18:37:22.825292] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T18:37:22.828071] [INFO ] [REMOTE ] EE: Full fetch complete (43693 records). [2025-10-08T18:37:22.828199] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-08T18:37:23.200113] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-08T18:37:23.200231] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-08T18:37:23.201040] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-08T18:37:23.201134] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-08T18:37:23.202829] [DEBUG] [LOCAL ] EE: Trimmed 43693 records to 32798 (keeping 200 days of data) [2025-10-08T18:37:23.262153] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-08T18:37:23.410131] [DEBUG] [LOCAL ] EE: Primary data saved (32798 records). [2025-10-08T18:37:23.410286] [INFO ] [MAIN ] EE: Full history saved. [2025-10-08T18:37:23.410373] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EE took 32.3s. Estimated remaining: 3h 52m 20s. Rate: 7.2 symbols/min [2025-10-08T18:37:23.590577] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:23.607797] [DEBUG] [LOCAL ] EFR: Loaded 14868 existing records from primary storage. [2025-10-08T18:37:23.608054] [INFO ] [MAIN ] EFR: Loaded 14868 existing records. [2025-10-08T18:37:23.794147] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:23.794376] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-08T18:37:23.794448] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-08T18:37:23.795037] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-08T18:37:23.795097] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-08T18:37:24.024728] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-08T18:37:24.183886] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:24.188458] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:37:24.448540] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-08T18:37:24.817584] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-08T18:37:25.587181] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T18:37:25.590769] [INFO ] [REMOTE ] EDU: Full fetch complete (66515 records). [2025-10-08T18:37:25.590916] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-08T18:37:25.626526] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-08T18:37:25.998801] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T18:37:26.017171] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-08T18:37:26.017306] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-08T18:37:26.023137] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-08T18:37:26.023302] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-08T18:37:26.024662] [DEBUG] [LOCAL ] EDU: Trimmed 66515 records to 44849 (keeping 200 days of data) [2025-10-08T18:37:26.297762] [DEBUG] [LOCAL ] EDU: Primary data saved (44849 records). [2025-10-08T18:37:26.297916] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-08T18:37:26.298005] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EDU took 37.8s. Estimated remaining: 3h 51m 59s. Rate: 7.2 symbols/min [2025-10-08T18:37:26.422783] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-08T18:37:26.482527] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:26.498920] [DEBUG] [LOCAL ] EFT: Loaded 13169 existing records from primary storage. [2025-10-08T18:37:26.499228] [INFO ] [MAIN ] EFT: Loaded 13169 existing records. [2025-10-08T18:37:26.681991] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:26.682264] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-08T18:37:26.682315] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-08T18:37:26.682897] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-08T18:37:26.682961] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-08T18:37:27.029867] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:27.217527] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-08T18:37:27.320463] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T18:37:27.534500] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:37:28.017524] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-08T18:37:28.025635] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T18:37:28.817607] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-08T18:37:28.990492] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T18:37:29.617562] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-08T18:37:29.866173] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T18:37:30.253239] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T18:37:30.417557] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-08T18:37:31.174439] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T18:37:31.217560] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-08T18:37:32.017559] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-08T18:37:32.762555] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T18:37:32.817525] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-08T18:37:32.947187] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T18:37:33.389780] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T18:37:33.617551] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-08T18:37:34.291889] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T18:37:34.417588] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-08T18:37:35.217575] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-08T18:37:35.342279] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T18:37:35.946568] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T18:37:36.017511] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-08T18:37:36.816299] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:37:36.819312] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-08T18:37:37.617539] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-08T18:37:38.417574] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-08T18:37:38.506908] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:37:38.834876] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T18:37:39.064562] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T18:37:39.217553] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-08T18:37:40.017568] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-08T18:37:40.817538] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-08T18:37:40.887480] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T18:37:40.977894] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T18:37:41.617587] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-08T18:37:41.778600] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T18:37:42.042884] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-08T18:37:42.417568] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-08T18:37:43.217521] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-08T18:37:43.411262] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:37:44.017555] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-08T18:37:44.819879] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-08T18:37:44.819519] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:37:44.846179] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T18:37:45.617596] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-08T18:37:45.648553] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T18:37:46.184504] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T18:37:46.417561] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-08T18:37:47.217554] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-08T18:37:48.022736] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-08T18:37:48.038292] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T18:37:48.168798] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T18:37:48.817520] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-08T18:37:48.904449] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T18:37:49.617554] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-08T18:37:50.417528] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-08T18:37:50.449177] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T18:37:50.450864] [INFO ] [REMOTE ] EFT: Full fetch complete (17969 records). [2025-10-08T18:37:50.450933] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-08T18:37:50.838459] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-08T18:37:50.853490] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-08T18:37:50.869580] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-08T18:37:50.869756] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-08T18:37:50.874254] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T18:37:50.884682] [DEBUG] [LOCAL ] EFT: Trimmed 17969 records to 13144 (keeping 200 days of data) [2025-10-08T18:37:50.973525] [DEBUG] [LOCAL ] EFT: Primary data saved (13144 records). [2025-10-08T18:37:50.973725] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-08T18:37:50.973863] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFT took 24.7s. Estimated remaining: 3h 52m 29s. Rate: 7.2 symbols/min [2025-10-08T18:37:51.148012] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:51.191074] [DEBUG] [LOCAL ] EFX: Loaded 44568 existing records from primary storage. [2025-10-08T18:37:51.191460] [INFO ] [MAIN ] EFX: Loaded 44568 existing records. [2025-10-08T18:37:51.222717] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-08T18:37:51.304684] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T18:37:51.387475] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:51.387755] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-08T18:37:51.387807] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-08T18:37:51.389183] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-08T18:37:51.389244] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-08T18:37:51.752239] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:52.017584] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-08T18:37:52.330531] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T18:37:52.539601] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:37:52.540883] [INFO ] [REMOTE ] EEX: Full fetch complete (19052 records). [2025-10-08T18:37:52.540972] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-08T18:37:52.822791] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-08T18:37:52.985261] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-08T18:37:52.985353] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-08T18:37:52.985850] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-08T18:37:52.985913] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-08T18:37:52.986629] [DEBUG] [LOCAL ] EEX: Trimmed 19052 records to 10841 (keeping 200 days of data) [2025-10-08T18:37:53.055419] [DEBUG] [LOCAL ] EEX: Primary data saved (10841 records). [2025-10-08T18:37:53.055565] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-08T18:37:53.055679] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EEX took 46.7s. Estimated remaining: 3h 52m 6s. Rate: 7.2 symbols/min [2025-10-08T18:37:53.225072] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:53.253174] [DEBUG] [LOCAL ] EFXT: Loaded 29278 existing records from primary storage. [2025-10-08T18:37:53.253494] [INFO ] [MAIN ] EFXT: Loaded 29278 existing records. [2025-10-08T18:37:53.468583] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:53.468894] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-08T18:37:53.468966] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-08T18:37:53.469848] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-08T18:37:53.469923] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-08T18:37:53.622626] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-08T18:37:53.923753] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:54.417527] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-08T18:37:54.640826] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T18:37:54.732796] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:37:55.217553] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-08T18:37:55.894486] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T18:37:55.921567] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T18:37:56.017554] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-08T18:37:56.817564] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-08T18:37:57.628294] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-08T18:37:57.629948] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:37:58.184493] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:37:58.417543] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-08T18:37:59.217576] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-08T18:37:59.279435] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T18:37:59.799053] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T18:38:00.017505] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-08T18:38:00.123054] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T18:38:00.124868] [INFO ] [REMOTE ] EFR: Full fetch complete (19144 records). [2025-10-08T18:38:00.124954] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-08T18:38:00.517306] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-08T18:38:00.517410] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-08T18:38:00.518027] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-08T18:38:00.518096] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-08T18:38:00.518994] [DEBUG] [LOCAL ] EFR: Trimmed 19144 records to 14966 (keeping 200 days of data) [2025-10-08T18:38:00.613480] [DEBUG] [LOCAL ] EFR: Primary data saved (14966 records). [2025-10-08T18:38:00.613622] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-08T18:38:00.613748] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFR took 37.2s. Estimated remaining: 3h 51m 56s. Rate: 7.2 symbols/min [2025-10-08T18:38:00.777696] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:00.805346] [DEBUG] [LOCAL ] EG: Loaded 27855 existing records from primary storage. [2025-10-08T18:38:00.805621] [INFO ] [MAIN ] EG: Loaded 27855 existing records. [2025-10-08T18:38:00.826432] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-08T18:38:00.982439] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:00.982710] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-08T18:38:00.982793] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-08T18:38:00.983618] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-08T18:38:00.983733] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-08T18:38:01.335159] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:01.617539] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-08T18:38:01.881063] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-08T18:38:01.885020] [INFO ] [REMOTE ] EFC: Full fetch complete (66268 records). [2025-10-08T18:38:01.885205] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-08T18:38:01.886092] [FATAL] [VALIDATOR ] EFC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:38:01.886207] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:38:01.886417] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:38:01.886500] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-08T18:38:01.886592] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-08T18:38:01.886680] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-10-08T18:38:01.887059] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-10-08T18:38:01.887187] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFC took 40.3s. Estimated remaining: 3h 51m 31s. Rate: 7.2 symbols/min [2025-10-08T18:38:02.070227] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:02.124989] [DEBUG] [LOCAL ] EGO: Loaded 51673 existing records from primary storage. [2025-10-08T18:38:02.125339] [INFO ] [MAIN ] EGO: Loaded 51673 existing records. [2025-10-08T18:38:02.313946] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:02.314286] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-08T18:38:02.314388] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-08T18:38:02.314827] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-08T18:38:02.314888] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-08T18:38:02.422848] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-08T18:38:02.707107] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:02.725362] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T18:38:02.971099] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:38:03.217538] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-08T18:38:04.022684] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-08T18:38:04.033239] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:38:04.183858] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T18:38:04.817561] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-08T18:38:05.555319] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:38:05.617612] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-08T18:38:06.260826] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T18:38:06.417597] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-08T18:38:07.217513] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-08T18:38:07.408168] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T18:38:07.899371] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T18:38:08.017536] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-08T18:38:08.817568] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-08T18:38:09.170887] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T18:38:09.439403] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:38:09.617574] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-08T18:38:10.017687] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T18:38:10.417546] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-08T18:38:11.115888] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T18:38:11.217544] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-08T18:38:11.433858] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T18:38:12.017557] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-08T18:38:12.121345] [DEBUG] [REMOTE ] EGO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-08T18:38:12.121682] [WARN ] [REMOTE ] EGO: No data returned for month 2025-01 [2025-10-08T18:38:12.121793] [FATAL] [REMOTE ] EGO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:38:12.121876] [FATAL] [MAIN ] EGO: Failed to fetch primary data. [2025-10-08T18:38:12.121940] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:38:12.122023] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-08T18:38:12.122133] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-08T18:38:12.122191] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-10-08T18:38:12.122380] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-10-08T18:38:12.122482] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EGO took 10.2s. Estimated remaining: 3h 51m 27s. Rate: 7.2 symbols/min [2025-10-08T18:38:12.303739] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:12.338173] [DEBUG] [LOCAL ] EGP: Loaded 30699 existing records from primary storage. [2025-10-08T18:38:12.338490] [INFO ] [MAIN ] EGP: Loaded 30699 existing records. [2025-10-08T18:38:12.520157] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:12.520414] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-08T18:38:12.520464] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-08T18:38:12.520716] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-08T18:38:12.520773] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-08T18:38:12.823373] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-08T18:38:12.886634] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:12.911947] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T18:38:13.617560] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-08T18:38:14.417508] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-08T18:38:14.591157] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T18:38:14.774407] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T18:38:15.217569] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-08T18:38:16.017604] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-08T18:38:16.056017] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T18:38:16.172834] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:38:16.817556] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-08T18:38:17.303441] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T18:38:17.617521] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-08T18:38:17.895232] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T18:38:18.417566] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-08T18:38:18.616575] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T18:38:19.217565] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-08T18:38:19.530812] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:38:20.017561] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-08T18:38:20.388812] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T18:38:20.817627] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-08T18:38:21.441469] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:38:21.617586] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-08T18:38:21.779329] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:38:21.782144] [INFO ] [REMOTE ] EFXT: Full fetch complete (44039 records). [2025-10-08T18:38:21.782237] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-08T18:38:22.156746] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-08T18:38:22.156862] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-08T18:38:22.157960] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-08T18:38:22.158021] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-08T18:38:22.159024] [DEBUG] [LOCAL ] EFXT: Trimmed 44039 records to 29343 (keeping 200 days of data) [2025-10-08T18:38:22.339963] [DEBUG] [LOCAL ] EFXT: Primary data saved (29343 records). [2025-10-08T18:38:22.340134] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-08T18:38:22.340253] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFXT took 29.3s. Estimated remaining: 3h 51m 23s. Rate: 7.2 symbols/min [2025-10-08T18:38:22.422904] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-08T18:38:22.517223] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:22.555580] [DEBUG] [LOCAL ] EGY: Loaded 41850 existing records from primary storage. [2025-10-08T18:38:22.555911] [INFO ] [MAIN ] EGY: Loaded 41850 existing records. [2025-10-08T18:38:22.730870] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:22.731151] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-08T18:38:22.731205] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-08T18:38:22.731437] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-08T18:38:22.731494] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-08T18:38:23.101395] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:23.180619] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:38:23.217535] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-08T18:38:24.017537] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-08T18:38:24.130349] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:38:24.360834] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T18:38:24.817559] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-08T18:38:25.482905] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T18:38:25.617575] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-08T18:38:26.042186] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T18:38:26.417519] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-08T18:38:26.820347] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T18:38:27.217592] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-08T18:38:27.874073] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T18:38:28.017557] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-08T18:38:28.081265] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T18:38:28.817578] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-08T18:38:29.470203] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:38:29.617580] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-08T18:38:30.220466] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T18:38:30.417561] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-08T18:38:31.125042] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:38:31.217519] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-08T18:38:32.005589] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T18:38:32.017494] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-08T18:38:32.633505] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:38:32.817572] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-08T18:38:33.379932] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T18:38:33.617577] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-08T18:38:34.417521] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-08T18:38:34.596894] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:38:34.673694] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T18:38:35.217565] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-08T18:38:36.017954] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:38:36.018151] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-08T18:38:36.548052] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T18:38:36.817579] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-08T18:38:37.375598] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:38:37.379429] [INFO ] [REMOTE ] EG: Full fetch complete (43290 records). [2025-10-08T18:38:37.379623] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-08T18:38:37.627889] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-08T18:38:37.966486] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-08T18:38:37.966665] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-08T18:38:37.968082] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-08T18:38:37.968182] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-08T18:38:37.969874] [DEBUG] [LOCAL ] EG: Trimmed 43290 records to 27804 (keeping 200 days of data) [2025-10-08T18:38:38.249971] [DEBUG] [LOCAL ] EG: Primary data saved (27804 records). [2025-10-08T18:38:38.250186] [INFO ] [MAIN ] EG: Full history saved. [2025-10-08T18:38:38.250367] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EG took 37.6s. Estimated remaining: 3h 51m 32s. Rate: 7.2 symbols/min [2025-10-08T18:38:38.418699] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-08T18:38:38.446297] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:38.446961] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-10-08T18:38:38.447033] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-10-08T18:38:38.449460] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-08T18:38:38.449583] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-08T18:38:38.449903] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-08T18:38:38.450079] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-08T18:38:38.817343] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:38:38.903938] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:38.911586] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:38:38.914883] [INFO ] [REMOTE ] EGP: Full fetch complete (45415 records). [2025-10-08T18:38:38.914975] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-08T18:38:39.227695] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-08T18:38:39.354682] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-08T18:38:39.354783] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-08T18:38:39.355483] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-08T18:38:39.355526] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-08T18:38:39.356605] [DEBUG] [LOCAL ] EGP: Trimmed 45415 records to 30646 (keeping 200 days of data) [2025-10-08T18:38:39.555680] [DEBUG] [LOCAL ] EGP: Primary data saved (30646 records). [2025-10-08T18:38:39.555842] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-08T18:38:39.555935] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGP took 27.4s. Estimated remaining: 3h 51m 7s. Rate: 7.2 symbols/min [2025-10-08T18:38:39.723459] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:39.767162] [DEBUG] [LOCAL ] EHC: Loaded 41268 existing records from primary storage. [2025-10-08T18:38:39.767586] [INFO ] [MAIN ] EHC: Loaded 41268 existing records. [2025-10-08T18:38:39.955333] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:39.955599] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-08T18:38:39.955695] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-08T18:38:39.956077] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-08T18:38:39.956135] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-08T18:38:40.019184] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-08T18:38:40.182031] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T18:38:40.227198] [INFO ] [REMOTE ] EFX: Full fetch complete (64474 records). [2025-10-08T18:38:40.253689] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-08T18:38:40.489870] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:40.811515] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-08T18:38:40.811677] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-08T18:38:40.812689] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-08T18:38:40.812788] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-08T18:38:40.814622] [DEBUG] [LOCAL ] EFX: Trimmed 64474 records to 44556 (keeping 200 days of data) [2025-10-08T18:38:40.817609] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-08T18:38:40.959864] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:38:41.160805] [DEBUG] [LOCAL ] EFX: Primary data saved (44556 records). [2025-10-08T18:38:41.161034] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-08T18:38:41.161140] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EFX took 50.2s. Estimated remaining: 3h 50m 43s. Rate: 7.2 symbols/min [2025-10-08T18:38:41.340338] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:41.340689] [DEBUG] [LOCAL ] EHI: No existing data file found in primary storage. [2025-10-08T18:38:41.340762] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-10-08T18:38:41.350588] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-08T18:38:41.357333] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-08T18:38:41.358173] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-10-08T18:38:41.358272] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-08T18:38:41.359267] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T18:38:41.626904] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-08T18:38:41.717100] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:42.417555] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-08T18:38:42.577537] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T18:38:42.636806] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T18:38:43.196778] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T18:38:43.217493] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-08T18:38:44.017525] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-08T18:38:44.039137] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T18:38:44.817528] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-08T18:38:45.142205] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T18:38:45.613719] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T18:38:45.617485] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-08T18:38:46.417577] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-08T18:38:46.453016] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T18:38:47.217573] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-08T18:38:47.607233] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T18:38:48.017598] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-08T18:38:48.757087] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T18:38:48.784970] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T18:38:48.817496] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-08T18:38:49.617551] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-08T18:38:50.258103] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T18:38:50.331889] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T18:38:50.417547] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-08T18:38:51.217581] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-08T18:38:52.017555] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-08T18:38:52.095288] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T18:38:52.368790] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T18:38:52.817531] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-08T18:38:52.977873] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T18:38:53.617549] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-08T18:38:53.882154] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T18:38:54.417581] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-08T18:38:55.189934] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T18:38:55.217515] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-08T18:38:55.498906] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T18:38:56.017576] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-08T18:38:56.635666] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T18:38:56.639386] [INFO ] [REMOTE ] EGY: Full fetch complete (61145 records). [2025-10-08T18:38:56.639509] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-08T18:38:56.821999] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-08T18:38:57.095499] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-08T18:38:57.095615] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-08T18:38:57.096433] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-08T18:38:57.096488] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-08T18:38:57.097847] [DEBUG] [LOCAL ] EGY: Trimmed 61145 records to 41770 (keeping 200 days of data) [2025-10-08T18:38:57.320048] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T18:38:57.370719] [DEBUG] [LOCAL ] EGY: Primary data saved (41770 records). [2025-10-08T18:38:57.370862] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-08T18:38:57.370950] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGY took 35.0s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-08T18:38:57.549203] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:57.573370] [DEBUG] [LOCAL ] EIC: Loaded 23128 existing records from primary storage. [2025-10-08T18:38:57.573671] [INFO ] [MAIN ] EIC: Loaded 23128 existing records. [2025-10-08T18:38:57.627244] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-08T18:38:57.754958] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:57.755250] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-08T18:38:57.755306] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-08T18:38:57.755594] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-08T18:38:57.755682] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-08T18:38:58.120766] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:58.306352] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T18:38:58.417508] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-08T18:38:58.465513] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T18:38:59.038680] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T18:38:59.217578] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-08T18:39:00.017558] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-08T18:39:00.817516] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-08T18:39:00.927484] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T18:39:00.993208] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T18:39:01.617595] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-08T18:39:02.358830] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:39:02.417487] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-08T18:39:03.134171] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:39:03.217508] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-08T18:39:03.561076] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T18:39:04.017505] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-08T18:39:04.201577] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T18:39:04.817571] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-08T18:39:05.101499] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:39:05.617579] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-08T18:39:06.152272] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:39:06.415395] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T18:39:06.421081] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-08T18:39:07.217572] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-08T18:39:07.798344] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:39:07.928213] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T18:39:08.017534] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-08T18:39:08.734333] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T18:39:08.736186] [INFO ] [REMOTE ] EHI: Full fetch complete (16306 records). [2025-10-08T18:39:08.736268] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-08T18:39:08.822766] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-08T18:39:09.201288] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-08T18:39:09.201384] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-08T18:39:09.201860] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-08T18:39:09.201944] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-08T18:39:09.202583] [DEBUG] [LOCAL ] EHI: Trimmed 16306 records to 10705 (keeping 200 days of data) [2025-10-08T18:39:09.273338] [DEBUG] [LOCAL ] EHI: Primary data saved (10705 records). [2025-10-08T18:39:09.273488] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-08T18:39:09.273563] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHI took 28.1s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-08T18:39:09.474307] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:09.474486] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-08T18:39:09.474522] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-08T18:39:09.474638] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-08T18:39:09.474726] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-08T18:39:09.474809] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-08T18:39:09.474870] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-08T18:39:09.631528] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-08T18:39:09.832821] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:10.417570] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-08T18:39:10.565688] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:39:10.768278] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T18:39:10.770518] [INFO ] [REMOTE ] EHAB: Full fetch complete (40958 records). [2025-10-08T18:39:10.770607] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-08T18:39:11.142099] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-08T18:39:11.142216] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-08T18:39:11.142848] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-08T18:39:11.142915] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-08T18:39:11.143877] [DEBUG] [LOCAL ] EHAB: Trimmed 40958 records to 29327 (keeping 200 days of data) [2025-10-08T18:39:11.231490] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-08T18:39:11.332333] [DEBUG] [LOCAL ] EHAB: Primary data saved (29327 records). [2025-10-08T18:39:11.332499] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-08T18:39:11.332589] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHAB took 33.1s. Estimated remaining: 3h 50m 30s. Rate: 7.2 symbols/min [2025-10-08T18:39:11.550004] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:11.550173] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-08T18:39:11.550223] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-08T18:39:11.550357] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-08T18:39:11.550399] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-08T18:39:11.550441] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-08T18:39:11.550478] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-08T18:39:11.672280] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-08T18:39:11.746491] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T18:39:11.948559] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:12.017549] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-08T18:39:12.817568] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-08T18:39:13.581011] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:39:13.617511] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-08T18:39:13.658619] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:39:14.056167] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T18:39:14.417591] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-08T18:39:14.845903] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T18:39:15.217542] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-08T18:39:15.656637] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T18:39:16.017550] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-08T18:39:16.454160] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T18:39:16.817554] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-08T18:39:17.617559] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-08T18:39:18.040863] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T18:39:18.042583] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T18:39:18.417554] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-08T18:39:19.217513] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-08T18:39:19.508190] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T18:39:19.696492] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T18:39:20.017570] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-08T18:39:20.264803] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-08T18:39:20.817546] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-08T18:39:21.617552] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-08T18:39:22.028282] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T18:39:22.054581] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:39:22.417572] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-08T18:39:23.217542] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-08T18:39:23.472976] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T18:39:23.578617] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-08T18:39:24.017569] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-08T18:39:24.356732] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T18:39:24.817555] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-08T18:39:25.149161] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T18:39:25.617601] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-08T18:39:25.967772] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T18:39:26.417544] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-08T18:39:26.856018] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T18:39:27.217559] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-08T18:39:27.692679] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T18:39:28.017580] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-08T18:39:28.817533] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-08T18:39:29.067481] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T18:39:29.148627] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-08T18:39:29.617591] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-08T18:39:30.080732] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T18:39:30.417628] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-08T18:39:30.893051] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-08T18:39:31.217561] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-08T18:39:32.017572] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-08T18:39:32.313505] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T18:39:32.429778] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T18:39:32.817597] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-08T18:39:33.175767] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T18:39:33.176432] [INFO ] [REMOTE ] EICA: Full fetch complete (1305 records). [2025-10-08T18:39:33.176500] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-08T18:39:33.353380] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-08T18:39:33.353623] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:39:33.353704] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:39:33.353752] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-08T18:39:33.353808] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-08T18:39:33.353841] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-08T18:39:33.353879] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-08T18:39:33.353935] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EICA took 24.1s. Estimated remaining: 3h 50m 54s. Rate: 7.2 symbols/min [2025-10-08T18:39:33.520138] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:33.520335] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-08T18:39:33.520393] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-08T18:39:33.520504] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-08T18:39:33.520545] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-08T18:39:33.520588] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-08T18:39:33.520619] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-08T18:39:33.618475] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-08T18:39:33.869408] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:34.417528] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-08T18:39:34.568070] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T18:39:34.570164] [INFO ] [REMOTE ] EIC: Full fetch complete (34556 records). [2025-10-08T18:39:34.570248] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-08T18:39:35.024538] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-08T18:39:35.024625] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-08T18:39:35.025244] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-08T18:39:35.025297] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-08T18:39:35.026136] [DEBUG] [LOCAL ] EIC: Trimmed 34556 records to 23043 (keeping 200 days of data) [2025-10-08T18:39:35.171560] [DEBUG] [LOCAL ] EIC: Primary data saved (23043 records). [2025-10-08T18:39:35.171822] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-08T18:39:35.171933] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EIC took 37.8s. Estimated remaining: 3h 50m 30s. Rate: 7.2 symbols/min [2025-10-08T18:39:35.224228] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-08T18:39:35.383982] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:35.406184] [DEBUG] [LOCAL ] EIG: Loaded 20324 existing records from primary storage. [2025-10-08T18:39:35.406447] [INFO ] [MAIN ] EIG: Loaded 20324 existing records. [2025-10-08T18:39:35.586424] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:39:35.586714] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-08T18:39:35.586770] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-08T18:39:35.587112] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-08T18:39:35.587170] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-08T18:39:35.717912] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T18:39:35.751450] [INFO ] [REMOTE ] EICB: Full fetch complete (2708 records). [2025-10-08T18:39:35.752530] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-08T18:39:35.949941] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:39:36.030284] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-08T18:39:36.009331] [INFO ] [REMOTE ] EHC: Full fetch complete (58799 records). [2025-10-08T18:39:36.054150] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-08T18:39:36.146173] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T18:39:36.187437] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:39:36.214598] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:36.214828] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:39:36.224166] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-08T18:39:36.256542] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-08T18:39:36.261903] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-08T18:39:36.280814] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-08T18:39:36.283273] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICB took 25.0s. Estimated remaining: 3h 50m 5s. Rate: 7.2 symbols/min [2025-10-08T18:39:36.648980] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:36.752441] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-08T18:39:36.754188] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-08T18:39:36.758285] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T18:39:36.758116] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-08T18:39:36.760359] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-08T18:39:36.761789] [DEBUG] [LOCAL ] EHC: Trimmed 58799 records to 41177 (keeping 200 days of data) [2025-10-08T18:39:36.836806] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-08T18:39:36.903822] [DEBUG] [LOCAL ] EIX: Loaded 53343 existing records from primary storage. [2025-10-08T18:39:36.905067] [INFO ] [MAIN ] EIX: Loaded 53343 existing records. [2025-10-08T18:39:37.111416] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:39:37.113396] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-08T18:39:37.113966] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-08T18:39:37.114571] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-08T18:39:37.114691] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-08T18:39:37.595850] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:37.618053] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-08T18:39:37.642902] [DEBUG] [LOCAL ] EHC: Primary data saved (41177 records). [2025-10-08T18:39:37.643030] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-08T18:39:37.643121] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EHC took 58.1s. Estimated remaining: 3h 49m 41s. Rate: 7.2 symbols/min [2025-10-08T18:39:37.884582] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:39:38.417534] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-08T18:39:38.875079] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T18:39:39.217516] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-08T18:39:39.252495] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:39:39.986492] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T18:39:40.017557] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-08T18:39:40.819829] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-08T18:39:40.823593] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T18:39:41.617535] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-08T18:39:42.188255] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T18:39:42.417546] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-08T18:39:42.521703] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T18:39:43.018671] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:39:43.217549] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-08T18:39:43.743992] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T18:39:44.017554] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-08T18:39:44.693800] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T18:39:44.817554] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-08T18:39:45.617522] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-08T18:39:45.681487] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T18:39:46.273931] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T18:39:46.417566] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-08T18:39:47.217578] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-08T18:39:47.255850] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T18:39:48.017638] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-08T18:39:48.817546] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-08T18:39:49.196994] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T18:39:49.197839] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T18:39:49.404510] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T18:39:49.617561] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-08T18:39:50.417581] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-08T18:39:50.584034] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T18:39:51.141705] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:39:51.217513] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-08T18:39:52.005170] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T18:39:52.017482] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-08T18:39:52.567445] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T18:39:52.568545] [INFO ] [REMOTE ] EICC: Full fetch complete (8369 records). [2025-10-08T18:39:52.568622] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-08T18:39:52.569123] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:39:52.569206] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:39:52.569248] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:39:52.569285] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-08T18:39:52.569343] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-08T18:39:52.569381] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-08T18:39:52.569435] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-08T18:39:52.569523] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 19.2s. Estimated remaining: 3h 49m 47s. Rate: 7.2 symbols/min [2025-10-08T18:39:52.817609] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-08T18:39:53.617578] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-08T18:39:54.504925] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:39:54.509842] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-08T18:39:54.765694] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T18:39:55.217582] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-08T18:39:55.399097] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T18:39:56.017552] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-08T18:39:57.060707] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T18:39:57.072359] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-08T18:39:57.197282] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T18:39:57.617559] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-08T18:39:58.520728] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:39:58.522410] [INFO ] [REMOTE ] EIG: Full fetch complete (27100 records). [2025-10-08T18:39:58.522489] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-08T18:39:58.912287] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-08T18:39:58.912416] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-08T18:39:58.913168] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-08T18:39:58.913282] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-08T18:39:58.914497] [DEBUG] [LOCAL ] EIG: Trimmed 27100 records to 20264 (keeping 200 days of data) [2025-10-08T18:39:59.034162] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T18:39:59.048442] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-08T18:39:59.082902] [DEBUG] [LOCAL ] EIG: Primary data saved (20264 records). [2025-10-08T18:39:59.083031] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-08T18:39:59.083114] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 23.9s. Estimated remaining: 3h 49m 35s. Rate: 7.2 symbols/min [2025-10-08T18:40:01.466757] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-08T18:40:01.477788] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-08T18:40:03.535932] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T18:40:03.548446] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-08T18:40:05.557226] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T18:40:05.568931] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-08T18:40:07.235821] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T18:40:07.248768] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-08T18:40:09.098379] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T18:40:09.102690] [INFO ] [REMOTE ] EIX: Full fetch complete (77106 records). [2025-10-08T18:40:09.102874] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-08T18:40:09.497130] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-08T18:40:09.497235] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-08T18:40:09.498207] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-08T18:40:09.498290] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-08T18:40:09.499996] [DEBUG] [LOCAL ] EIX: Trimmed 77106 records to 53347 (keeping 200 days of data) [2025-10-08T18:40:09.855383] [DEBUG] [LOCAL ] EIX: Primary data saved (53347 records). [2025-10-08T18:40:09.855555] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-08T18:40:09.855684] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 33.6s. Estimated remaining: 3h 49m 32s. Rate: 7.2 symbols/min [2025-10-08T18:40:10.507535] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:10.668876] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:10.667438] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:10.673042] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-10-08T18:40:10.672687] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:10.673755] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-10-08T18:40:10.674093] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-08T18:40:10.674206] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-08T18:40:10.674305] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-08T18:40:10.674367] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-08T18:40:11.071228] [DEBUG] [LOCAL ] ELAN: Loaded 53273 existing records from primary storage. [2025-10-08T18:40:11.130410] [DEBUG] [LOCAL ] ELF: Loaded 52072 existing records from primary storage. [2025-10-08T18:40:11.129681] [INFO ] [MAIN ] ELAN: Loaded 53273 existing records. [2025-10-08T18:40:11.129420] [DEBUG] [LOCAL ] EL: Loaded 53369 existing records from primary storage. [2025-10-08T18:40:11.164526] [INFO ] [MAIN ] ELF: Loaded 52072 existing records. [2025-10-08T18:40:11.164421] [INFO ] [MAIN ] EL: Loaded 53369 existing records. [2025-10-08T18:40:11.332218] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:11.376179] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-08T18:40:11.786098] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:11.790485] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:11.760834] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:11.790869] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-08T18:40:11.791094] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-08T18:40:11.791346] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-08T18:40:11.791259] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-08T18:40:11.791476] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-08T18:40:11.791622] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-08T18:40:11.791957] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-08T18:40:11.792027] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-08T18:40:11.792054] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-08T18:40:11.792239] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-08T18:40:11.792157] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-08T18:40:11.888443] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-08T18:40:12.806415] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:12.826554] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:12.843166] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-08T18:40:12.842756] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-08T18:40:12.864544] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T18:40:12.867282] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-08T18:40:12.949432] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:12.949799] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-08T18:40:13.554589] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T18:40:13.556144] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-08T18:40:14.084606] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T18:40:14.086044] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-08T18:40:14.463535] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T18:40:14.474914] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-08T18:40:14.648136] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T18:40:14.649981] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-08T18:40:14.713053] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T18:40:14.723431] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-08T18:40:14.986845] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T18:40:14.997828] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-08T18:40:15.093101] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:40:15.095041] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-08T18:40:16.125008] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T18:40:16.127751] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-08T18:40:16.161575] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T18:40:16.174277] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-08T18:40:16.579791] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T18:40:16.595448] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-08T18:40:16.595688] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:40:16.598477] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-08T18:40:16.871631] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T18:40:16.882203] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-08T18:40:17.246602] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T18:40:17.248360] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-08T18:40:17.452674] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T18:40:17.464017] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-08T18:40:17.747470] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T18:40:17.749113] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-08T18:40:18.321225] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T18:40:18.417532] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-08T18:40:18.592707] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T18:40:18.689761] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T18:40:18.923400] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T18:40:18.924227] [INFO ] [REMOTE ] ELC: Full fetch complete (5066 records). [2025-10-08T18:40:18.924316] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-08T18:40:19.234197] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-08T18:40:19.332415] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-08T18:40:19.332784] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-08T18:40:19.334870] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:40:19.335605] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-08T18:40:19.346153] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-08T18:40:19.347339] [DEBUG] [LOCAL ] ELC: Trimmed 5066 records to 3504 (keeping 200 days of data) [2025-10-08T18:40:19.368975] [DEBUG] [LOCAL ] ELC: Primary data saved (3504 records). [2025-10-08T18:40:19.369070] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-08T18:40:19.369147] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 9.5s. Estimated remaining: 3h 49m 26s. Rate: 7.2 symbols/min [2025-10-08T18:40:19.583023] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:19.623687] [DEBUG] [LOCAL ] ELME: Loaded 39289 existing records from primary storage. [2025-10-08T18:40:19.624008] [INFO ] [MAIN ] ELME: Loaded 39289 existing records. [2025-10-08T18:40:19.810287] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:19.810520] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-08T18:40:19.810565] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-08T18:40:19.810842] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-08T18:40:19.810900] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-08T18:40:20.027482] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-08T18:40:20.183095] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:20.817548] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-08T18:40:21.357389] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-08T18:40:21.617594] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-08T18:40:22.381341] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-08T18:40:22.417535] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-08T18:40:22.747470] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T18:40:23.217527] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-08T18:40:23.445796] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T18:40:24.017564] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-08T18:40:24.612157] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T18:40:24.736151] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-08T18:40:24.817568] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-08T18:40:25.617813] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-08T18:40:25.620122] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:40:25.897399] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:40:26.417566] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-08T18:40:27.217539] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-08T18:40:27.846977] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-08T18:40:27.904926] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T18:40:28.017559] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-08T18:40:28.817570] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-08T18:40:29.266079] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T18:40:29.499386] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:40:29.617542] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-08T18:40:30.175964] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T18:40:30.417559] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-08T18:40:31.066360] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:40:31.217555] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-08T18:40:32.017536] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-08T18:40:32.336108] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T18:40:32.522854] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:40:32.817549] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-08T18:40:33.617507] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-08T18:40:33.771543] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T18:40:34.417574] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-08T18:40:34.866516] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T18:40:35.196691] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T18:40:35.217507] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-08T18:40:35.508896] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T18:40:36.017622] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-08T18:40:36.817547] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-08T18:40:36.860600] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:40:37.617533] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-08T18:40:38.112160] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T18:40:38.417611] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-08T18:40:38.683743] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T18:40:38.747690] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:40:39.217632] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-08T18:40:40.017562] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-08T18:40:40.170265] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T18:40:40.817520] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-08T18:40:40.867676] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:40:41.617600] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-08T18:40:41.988254] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T18:40:42.381759] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T18:40:42.417531] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-08T18:40:43.184434] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T18:40:43.217517] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-08T18:40:44.017570] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-08T18:40:44.192035] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T18:40:44.456540] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T18:40:44.461054] [INFO ] [REMOTE ] ELAN: Full fetch complete (76874 records). [2025-10-08T18:40:44.461246] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-08T18:40:44.823225] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-08T18:40:44.867722] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-08T18:40:44.867873] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-08T18:40:44.868871] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-08T18:40:44.868937] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-08T18:40:44.870568] [DEBUG] [LOCAL ] ELAN: Trimmed 76874 records to 53293 (keeping 200 days of data) [2025-10-08T18:40:45.200950] [DEBUG] [LOCAL ] ELAN: Primary data saved (53293 records). [2025-10-08T18:40:45.201103] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-08T18:40:45.201205] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELAN took 35.3s. Estimated remaining: 3h 49m 58s. Rate: 7.2 symbols/min [2025-10-08T18:40:45.383844] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:45.410225] [DEBUG] [LOCAL ] ELP: Loaded 25608 existing records from primary storage. [2025-10-08T18:40:45.410537] [INFO ] [MAIN ] ELP: Loaded 25608 existing records. [2025-10-08T18:40:45.608167] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:45.608775] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-08T18:40:45.608842] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-08T18:40:45.609220] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-08T18:40:45.609279] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-08T18:40:45.641464] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-08T18:40:45.941378] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T18:40:45.990921] [INFO ] [REMOTE ] ELF: Full fetch complete (75278 records). [2025-10-08T18:40:46.001925] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-08T18:40:46.023502] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:46.421535] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-08T18:40:46.426053] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-08T18:40:46.428080] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-08T18:40:46.429192] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-08T18:40:46.429394] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-08T18:40:46.431030] [DEBUG] [LOCAL ] ELF: Trimmed 75278 records to 52053 (keeping 200 days of data) [2025-10-08T18:40:46.757280] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T18:40:46.766055] [INFO ] [REMOTE ] EL: Full fetch complete (77275 records). [2025-10-08T18:40:46.766922] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-08T18:40:47.061623] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T18:40:47.117880] [INFO ] [REMOTE ] ELME: Full fetch complete (56104 records). [2025-10-08T18:40:47.152740] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-08T18:40:47.175155] [DEBUG] [LOCAL ] ELF: Primary data saved (52053 records). [2025-10-08T18:40:47.181361] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-08T18:40:47.181747] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELF took 37.3s. Estimated remaining: 3h 49m 35s. Rate: 7.2 symbols/min [2025-10-08T18:40:47.510684] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-08T18:40:47.528631] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-08T18:40:47.540900] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-08T18:40:47.588906] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-08T18:40:47.667170] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:47.701004] [DEBUG] [LOCAL ] EL: Trimmed 77275 records to 53372 (keeping 200 days of data) [2025-10-08T18:40:47.700575] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-08T18:40:47.755227] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-08T18:40:47.854058] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-08T18:40:47.864554] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-08T18:40:47.895673] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-08T18:40:47.925830] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-08T18:40:48.128319] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-08T18:40:48.134326] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-08T18:40:48.155240] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-08T18:40:48.155728] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-08T18:40:48.232283] [DEBUG] [LOCAL ] ELME: Trimmed 56104 records to 39293 (keeping 200 days of data) [2025-10-08T18:40:48.392975] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T18:40:48.489399] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-08T18:40:48.622989] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:48.628425] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-08T18:40:48.909962] [DEBUG] [LOCAL ] ELME: Primary data saved (39293 records). [2025-10-08T18:40:48.911372] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-08T18:40:48.912456] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELME took 29.5s. Estimated remaining: 3h 49m 12s. Rate: 7.2 symbols/min [2025-10-08T18:40:49.167441] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:49.172625] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T18:40:49.176246] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-08T18:40:49.204053] [DEBUG] [LOCAL ] EL: Primary data saved (53372 records). [2025-10-08T18:40:49.217692] [INFO ] [MAIN ] EL: Full history saved. [2025-10-08T18:40:49.217871] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. EL took 39.3s. Estimated remaining: 3h 48m 45s. Rate: 7.2 symbols/min [2025-10-08T18:40:49.389932] [DEBUG] [LOCAL ] ELS: Loaded 49737 existing records from primary storage. [2025-10-08T18:40:49.423148] [INFO ] [MAIN ] ELS: Loaded 49737 existing records. [2025-10-08T18:40:49.441032] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:49.621534] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:49.622727] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-08T18:40:49.622975] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-08T18:40:49.626452] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T18:40:49.627908] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-08T18:40:49.628020] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-08T18:40:49.628470] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-08T18:40:49.749564] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T18:40:49.871420] [DEBUG] [LOCAL ] ELV: Loaded 50629 existing records from primary storage. [2025-10-08T18:40:49.914130] [INFO ] [MAIN ] ELV: Loaded 50629 existing records. [2025-10-08T18:40:50.071538] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T18:40:50.219252] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:50.306111] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:50.306518] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-08T18:40:50.306586] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-08T18:40:50.306960] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-08T18:40:50.307021] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-08T18:40:50.422785] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-08T18:40:50.689958] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:50.810691] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T18:40:51.217538] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-08T18:40:52.017565] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-08T18:40:52.384720] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-08T18:40:52.817515] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-08T18:40:53.135170] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T18:40:53.169835] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T18:40:53.617557] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-08T18:40:53.946250] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T18:40:54.417547] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-08T18:40:55.199343] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T18:40:55.217498] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-08T18:40:55.556592] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T18:40:56.017552] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-08T18:40:56.817561] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-08T18:40:56.818844] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T18:40:57.174911] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:40:57.617553] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-08T18:40:58.417596] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-08T18:40:59.217513] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-08T18:40:59.305322] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T18:40:59.754801] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T18:41:00.017535] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-08T18:41:00.817545] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-08T18:41:01.296342] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T18:41:01.321379] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T18:41:01.617565] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-08T18:41:02.326184] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T18:41:02.417544] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-08T18:41:02.791629] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:41:03.217563] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-08T18:41:03.827981] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T18:41:04.017523] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-08T18:41:04.489748] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T18:41:04.817610] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-08T18:41:05.381815] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T18:41:05.617576] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-08T18:41:06.287603] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:41:06.417556] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-08T18:41:06.690866] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T18:41:06.803156] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T18:41:06.803868] [INFO ] [REMOTE ] ELPC: Full fetch complete (1424 records). [2025-10-08T18:41:06.803938] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-08T18:41:07.033669] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-08T18:41:07.033891] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:41:07.033960] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:41:07.034022] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-08T18:41:07.034120] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-08T18:41:07.034175] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-08T18:41:07.034274] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-08T18:41:07.034370] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELPC took 19.9s. Estimated remaining: 3h 48m 58s. Rate: 7.2 symbols/min [2025-10-08T18:41:07.222738] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-08T18:41:07.251322] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:07.252231] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-08T18:41:07.252291] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-08T18:41:07.252401] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-08T18:41:07.252444] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-08T18:41:07.252486] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-08T18:41:07.252519] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-08T18:41:07.707601] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:08.017564] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-08T18:41:08.473325] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T18:41:08.817562] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-08T18:41:09.617528] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-08T18:41:09.691669] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:41:09.932175] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:41:09.932471] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-08T18:41:09.932561] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:41:09.932667] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-08T18:41:09.932746] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:41:09.932832] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-08T18:41:09.932913] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-08T18:41:09.932963] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-08T18:41:09.933019] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-08T18:41:09.933089] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. EMA took 2.9s. Estimated remaining: 3h 48m 38s. Rate: 7.2 symbols/min [2025-10-08T18:41:10.103089] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:10.116998] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T18:41:10.139244] [DEBUG] [LOCAL ] EMD: Loaded 21092 existing records from primary storage. [2025-10-08T18:41:10.139530] [INFO ] [MAIN ] EMD: Loaded 21092 existing records. [2025-10-08T18:41:10.318558] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:10.318830] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-08T18:41:10.318900] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-08T18:41:10.319295] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-08T18:41:10.319355] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-08T18:41:10.419956] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-08T18:41:10.678864] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:11.217618] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-08T18:41:11.505026] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T18:41:11.507381] [INFO ] [REMOTE ] ELP: Full fetch complete (36922 records). [2025-10-08T18:41:11.507488] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-08T18:41:11.943819] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-08T18:41:11.943918] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-08T18:41:11.944585] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-08T18:41:11.944677] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-08T18:41:11.945886] [DEBUG] [LOCAL ] ELP: Trimmed 36922 records to 25619 (keeping 200 days of data) [2025-10-08T18:41:12.039299] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-08T18:41:12.117508] [DEBUG] [LOCAL ] ELP: Primary data saved (25619 records). [2025-10-08T18:41:12.117693] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-08T18:41:12.117805] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELP took 26.9s. Estimated remaining: 3h 48m 15s. Rate: 7.2 symbols/min [2025-10-08T18:41:12.312502] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:12.343637] [DEBUG] [LOCAL ] EME: Loaded 31195 existing records from primary storage. [2025-10-08T18:41:12.343949] [INFO ] [MAIN ] EME: Loaded 31195 existing records. [2025-10-08T18:41:12.518551] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:12.518810] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-08T18:41:12.518858] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-08T18:41:12.519143] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-08T18:41:12.519204] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-08T18:41:12.829239] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-08T18:41:12.870941] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:13.358175] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-08T18:41:13.622728] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-08T18:41:13.652305] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T18:41:14.159941] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T18:41:14.417608] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-08T18:41:15.217520] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-08T18:41:15.398218] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:41:16.017544] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-08T18:41:16.206427] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T18:41:16.265960] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T18:41:16.817575] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-08T18:41:17.219356] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:41:17.617513] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-08T18:41:17.864426] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T18:41:18.417552] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-08T18:41:19.217602] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-08T18:41:19.343321] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:41:19.394110] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T18:41:20.017581] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-08T18:41:20.691796] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:41:20.817687] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-08T18:41:21.621935] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-08T18:41:21.628002] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T18:41:22.417585] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-08T18:41:22.663774] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T18:41:23.158999] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T18:41:23.217558] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-08T18:41:24.017568] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-08T18:41:24.334321] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T18:41:24.489489] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T18:41:24.817582] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-08T18:41:25.285416] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T18:41:25.617560] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-08T18:41:26.219708] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T18:41:26.417632] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-08T18:41:27.217615] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-08T18:41:27.417790] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T18:41:27.507108] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T18:41:28.017528] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-08T18:41:28.817528] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-08T18:41:28.934065] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:41:29.455924] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:41:29.460843] [INFO ] [REMOTE ] ELS: Full fetch complete (70945 records). [2025-10-08T18:41:29.460981] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-08T18:41:29.598168] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T18:41:29.622611] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-08T18:41:29.995913] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-08T18:41:29.996020] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-08T18:41:29.996961] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-08T18:41:29.997027] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-08T18:41:29.998567] [DEBUG] [LOCAL ] ELS: Trimmed 70945 records to 49760 (keeping 200 days of data) [2025-10-08T18:41:30.327186] [DEBUG] [LOCAL ] ELS: Primary data saved (49760 records). [2025-10-08T18:41:30.327313] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-08T18:41:30.327398] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELS took 41.4s. Estimated remaining: 3h 48m 29s. Rate: 7.2 symbols/min [2025-10-08T18:41:30.419016] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-08T18:41:30.505196] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:30.505454] [DEBUG] [LOCAL ] EMF: No existing data file found in primary storage. [2025-10-08T18:41:30.505509] [WARN ] [MAIN ] EMF: No existing data found, performing full refresh instead. [2025-10-08T18:41:30.505620] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-08T18:41:30.505693] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-08T18:41:30.505751] [DEBUG] [LOCAL ] EMF: No primary data file found to delete. [2025-10-08T18:41:30.505789] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-08T18:41:30.861861] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:41:30.887225] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:31.217687] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-08T18:41:32.017565] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-08T18:41:32.189661] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:41:32.718835] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T18:41:32.817537] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-08T18:41:33.314895] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T18:41:33.617552] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-08T18:41:34.394885] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T18:41:34.417505] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-08T18:41:34.985737] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:41:35.217554] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-08T18:41:35.628604] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T18:41:36.017569] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-08T18:41:36.472985] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T18:41:36.817585] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-08T18:41:37.260727] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:41:37.590044] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T18:41:37.617551] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-08T18:41:38.012581] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T18:41:38.417558] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-08T18:41:39.217556] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-08T18:41:39.915046] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T18:41:40.019164] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-08T18:41:40.022548] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T18:41:40.026687] [INFO ] [REMOTE ] ELV: Full fetch complete (73109 records). [2025-10-08T18:41:40.026804] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-08T18:41:40.446431] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-08T18:41:40.446514] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-08T18:41:40.447486] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-08T18:41:40.447553] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-08T18:41:40.449061] [DEBUG] [LOCAL ] ELV: Trimmed 73109 records to 50611 (keeping 200 days of data) [2025-10-08T18:41:40.676240] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T18:41:40.779830] [DEBUG] [LOCAL ] ELV: Primary data saved (50611 records). [2025-10-08T18:41:40.779995] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-08T18:41:40.780095] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELV took 51.6s. Estimated remaining: 3h 48m 26s. Rate: 7.2 symbols/min [2025-10-08T18:41:40.822732] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-08T18:41:40.952057] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:40.999610] [DEBUG] [LOCAL ] EMN: Loaded 50612 existing records from primary storage. [2025-10-08T18:41:40.999958] [INFO ] [MAIN ] EMN: Loaded 50612 existing records. [2025-10-08T18:41:41.173565] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:41.173803] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-08T18:41:41.173849] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-08T18:41:41.174035] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-08T18:41:41.174073] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-08T18:41:41.526023] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:41.617592] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-08T18:41:42.288695] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T18:41:42.417562] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-08T18:41:42.458209] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T18:41:42.460323] [INFO ] [REMOTE ] EMD: Full fetch complete (32297 records). [2025-10-08T18:41:42.460408] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-08T18:41:42.857105] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-08T18:41:42.857202] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-08T18:41:42.857884] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-08T18:41:42.857951] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-08T18:41:42.858916] [DEBUG] [LOCAL ] EMD: Trimmed 32297 records to 21094 (keeping 200 days of data) [2025-10-08T18:41:43.002772] [DEBUG] [LOCAL ] EMD: Primary data saved (21094 records). [2025-10-08T18:41:43.002933] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-08T18:41:43.003073] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMD took 33.1s. Estimated remaining: 3h 48m 4s. Rate: 7.2 symbols/min [2025-10-08T18:41:43.128150] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T18:41:43.202719] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:43.218458] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-08T18:41:43.219058] [DEBUG] [LOCAL ] EMO: Loaded 12812 existing records from primary storage. [2025-10-08T18:41:43.220522] [INFO ] [MAIN ] EMO: Loaded 12812 existing records. [2025-10-08T18:41:43.403905] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:43.404136] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-08T18:41:43.404186] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-08T18:41:43.404380] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-08T18:41:43.404438] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-08T18:41:43.758429] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:44.017508] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-08T18:41:44.817515] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-08T18:41:44.914986] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T18:41:45.019470] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T18:41:45.617550] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-08T18:41:46.424574] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-08T18:41:46.430797] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:41:46.447998] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T18:41:47.217536] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-08T18:41:47.835934] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T18:41:47.838591] [INFO ] [REMOTE ] EME: Full fetch complete (46853 records). [2025-10-08T18:41:47.838762] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-08T18:41:48.027704] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-08T18:41:48.239604] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-08T18:41:48.239741] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-08T18:41:48.240478] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-08T18:41:48.240537] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-08T18:41:48.241766] [DEBUG] [LOCAL ] EME: Trimmed 46853 records to 31165 (keeping 200 days of data) [2025-10-08T18:41:48.443912] [DEBUG] [LOCAL ] EME: Primary data saved (31165 records). [2025-10-08T18:41:48.444058] [INFO ] [MAIN ] EME: Full history saved. [2025-10-08T18:41:48.444147] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EME took 36.3s. Estimated remaining: 3h 47m 49s. Rate: 7.2 symbols/min [2025-10-08T18:41:48.623255] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:48.629411] [DEBUG] [LOCAL ] EMP: Loaded 3076 existing records from primary storage. [2025-10-08T18:41:48.629598] [INFO ] [MAIN ] EMP: Loaded 3076 existing records. [2025-10-08T18:41:48.826699] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-08T18:41:48.880955] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:48.890824] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T18:41:48.893421] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T18:41:48.893530] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-08T18:41:48.905624] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-08T18:41:48.906290] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-08T18:41:48.906383] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-08T18:41:49.250847] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-08T18:41:49.343213] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:49.617530] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-08T18:41:50.417558] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-08T18:41:51.145514] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T18:41:51.217514] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-08T18:41:51.245775] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T18:41:51.906293] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T18:41:52.017544] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-08T18:41:52.345244] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-08T18:41:52.817552] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-08T18:41:53.599464] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T18:41:53.617507] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-08T18:41:54.417614] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-08T18:41:54.433195] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T18:41:55.217614] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-08T18:41:55.801519] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T18:41:56.017526] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-08T18:41:56.278968] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T18:41:56.483891] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T18:41:56.817543] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-08T18:41:57.617528] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-08T18:41:58.099396] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T18:41:58.100300] [INFO ] [REMOTE ] EMF: Full fetch complete (6898 records). [2025-10-08T18:41:58.100369] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-08T18:41:58.420254] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-08T18:41:58.493940] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-08T18:41:58.494143] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-08T18:41:58.494466] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-08T18:41:58.494548] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-08T18:41:58.495374] [DEBUG] [LOCAL ] EMF: Trimmed 6898 records to 3289 (keeping 200 days of data) [2025-10-08T18:41:58.517546] [DEBUG] [LOCAL ] EMF: Primary data saved (3289 records). [2025-10-08T18:41:58.517788] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-08T18:41:58.517924] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMF took 28.2s. Estimated remaining: 3h 47m 44s. Rate: 7.2 symbols/min [2025-10-08T18:41:58.709057] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T18:41:58.735887] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:58.817533] [DEBUG] [LOCAL ] EMR: Loaded 53240 existing records from primary storage. [2025-10-08T18:41:58.817981] [INFO ] [MAIN ] EMR: Loaded 53240 existing records. [2025-10-08T18:41:58.997816] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:58.998129] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-08T18:41:58.998214] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-08T18:41:58.998553] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-08T18:41:58.998611] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-08T18:41:59.222756] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-08T18:41:59.379277] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:59.396912] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T18:42:00.017604] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-08T18:42:00.817559] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-08T18:42:01.294714] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T18:42:01.339743] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T18:42:01.552036] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T18:42:01.617561] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-08T18:42:02.082542] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T18:42:02.417605] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-08T18:42:03.217578] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-08T18:42:03.876731] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:42:04.017605] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-08T18:42:04.121577] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T18:42:04.817575] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-08T18:42:05.617580] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-08T18:42:05.888272] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T18:42:06.057992] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:42:06.302337] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T18:42:06.417591] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-08T18:42:07.217586] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-08T18:42:08.017533] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-08T18:42:08.108921] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T18:42:08.495335] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T18:42:08.817531] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-08T18:42:08.946748] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T18:42:09.277472] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T18:42:09.617556] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-08T18:42:10.417584] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-08T18:42:10.910715] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T18:42:11.217626] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-08T18:42:11.885345] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T18:42:12.017578] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-08T18:42:12.810997] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:42:12.817485] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-08T18:42:13.168047] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T18:42:13.617533] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-08T18:42:13.801707] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:42:14.417587] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-08T18:42:14.523184] [DEBUG] [REMOTE ] EMP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-08T18:42:14.523564] [WARN ] [REMOTE ] EMP: No data returned for month 2025-07 [2025-10-08T18:42:14.523705] [FATAL] [REMOTE ] EMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:42:14.523818] [FATAL] [MAIN ] EMP: Failed to fetch primary data. [2025-10-08T18:42:14.523897] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:42:14.523987] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-08T18:42:14.524072] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-08T18:42:14.524170] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-10-08T18:42:14.524509] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-10-08T18:42:14.524624] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMP took 26.1s. Estimated remaining: 3h 47m 53s. Rate: 7.2 symbols/min [2025-10-08T18:42:14.716428] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:14.766823] [DEBUG] [LOCAL ] ENB: Loaded 53509 existing records from primary storage. [2025-10-08T18:42:14.767162] [INFO ] [MAIN ] ENB: Loaded 53509 existing records. [2025-10-08T18:42:14.948893] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:14.949691] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-08T18:42:14.949761] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-08T18:42:14.950442] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-08T18:42:14.950500] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-08T18:42:15.222195] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-08T18:42:15.287427] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-08T18:42:15.336269] [INFO ] [REMOTE ] EMN: Full fetch complete (72116 records). [2025-10-08T18:42:15.352671] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-08T18:42:15.361487] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:15.755072] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-08T18:42:15.755156] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-08T18:42:15.756050] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-08T18:42:15.756115] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-08T18:42:15.757523] [DEBUG] [LOCAL ] EMN: Trimmed 72116 records to 50628 (keeping 200 days of data) [2025-10-08T18:42:16.039230] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-08T18:42:16.079699] [DEBUG] [LOCAL ] EMN: Primary data saved (50628 records). [2025-10-08T18:42:16.079825] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-08T18:42:16.079923] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 35.3s. Estimated remaining: 3h 47m 29s. Rate: 7.2 symbols/min [2025-10-08T18:42:16.250933] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:16.257507] [DEBUG] [LOCAL ] ENFY: Loaded 3219 existing records from primary storage. [2025-10-08T18:42:16.257706] [INFO ] [MAIN ] ENFY: Loaded 3219 existing records. [2025-10-08T18:42:16.432576] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:16.432804] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-08T18:42:16.432853] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-08T18:42:16.433016] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-08T18:42:16.433073] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-08T18:42:16.536113] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T18:42:16.544327] [INFO ] [REMOTE ] EMO: Full fetch complete (17467 records). [2025-10-08T18:42:16.559802] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-08T18:42:16.822465] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-08T18:42:17.095841] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:17.206578] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-08T18:42:17.206710] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-08T18:42:17.207102] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-08T18:42:17.207143] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-08T18:42:17.208563] [DEBUG] [LOCAL ] EMO: Trimmed 17467 records to 12883 (keeping 200 days of data) [2025-10-08T18:42:17.289826] [DEBUG] [LOCAL ] EMO: Primary data saved (12883 records). [2025-10-08T18:42:17.289975] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-08T18:42:17.290094] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMO took 34.3s. Estimated remaining: 3h 47m 5s. Rate: 7.2 symbols/min [2025-10-08T18:42:17.460320] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:17.503300] [DEBUG] [LOCAL ] ENIC: Loaded 36328 existing records from primary storage. [2025-10-08T18:42:17.503613] [INFO ] [MAIN ] ENIC: Loaded 36328 existing records. [2025-10-08T18:42:17.621084] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-08T18:42:17.690027] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:17.690988] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-08T18:42:17.691190] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-08T18:42:17.691532] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-08T18:42:17.691595] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-08T18:42:18.068425] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:18.106247] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T18:42:18.417557] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-08T18:42:18.436971] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T18:42:18.769873] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T18:42:19.217609] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-08T18:42:20.007586] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T18:42:20.012682] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:42:20.022922] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-08T18:42:20.817586] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-08T18:42:21.617563] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-08T18:42:21.836387] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T18:42:22.004505] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-08T18:42:22.166434] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:42:22.417619] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-08T18:42:22.794600] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-08T18:42:23.217602] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-08T18:42:23.560945] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-08T18:42:24.017704] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-08T18:42:24.516115] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-08T18:42:24.817565] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-08T18:42:25.617621] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-08T18:42:26.417539] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-08T18:42:26.602618] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T18:42:27.217705] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-08T18:42:27.404437] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T18:42:27.541986] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T18:42:27.569131] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T18:42:28.017582] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-08T18:42:28.817579] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-08T18:42:29.617572] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-08T18:42:29.681191] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-08T18:42:30.417575] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-08T18:42:30.553986] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-08T18:42:30.585486] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T18:42:31.217550] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-08T18:42:32.017519] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-08T18:42:32.149351] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:42:32.493963] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T18:42:32.710517] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:42:32.817499] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-08T18:42:33.617578] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-08T18:42:34.376387] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T18:42:34.417500] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-08T18:42:35.107861] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T18:42:35.217554] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-08T18:42:36.017583] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-08T18:42:36.316093] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T18:42:36.445763] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T18:42:36.817549] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-08T18:42:37.048136] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T18:42:37.378038] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T18:42:37.379087] [INFO ] [REMOTE ] ENFY: Full fetch complete (5543 records). [2025-10-08T18:42:37.379200] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-08T18:42:37.622691] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-08T18:42:37.800218] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-08T18:42:37.800323] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-08T18:42:37.800525] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-08T18:42:37.800579] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-08T18:42:37.801254] [DEBUG] [LOCAL ] ENFY: Trimmed 5543 records to 3235 (keeping 200 days of data) [2025-10-08T18:42:37.824135] [DEBUG] [LOCAL ] ENFY: Primary data saved (3235 records). [2025-10-08T18:42:37.824277] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-08T18:42:37.824406] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. ENFY took 21.7s. Estimated remaining: 3h 47m 24s. Rate: 7.2 symbols/min [2025-10-08T18:42:38.016863] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:38.017134] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-08T18:42:38.017186] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-08T18:42:38.017333] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-08T18:42:38.017405] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-08T18:42:38.017463] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-08T18:42:38.017498] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-08T18:42:38.417928] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-08T18:42:38.417855] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:38.854201] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T18:42:39.217576] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-08T18:42:39.985793] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T18:42:40.017535] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-08T18:42:40.291391] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T18:42:40.817556] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-08T18:42:41.233632] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T18:42:41.617548] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-08T18:42:42.417614] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-08T18:42:42.838933] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-08T18:42:42.840757] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T18:42:43.185008] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T18:42:43.190692] [INFO ] [REMOTE ] EMR: Full fetch complete (77080 records). [2025-10-08T18:42:43.190852] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-08T18:42:43.222677] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-08T18:42:43.619539] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-08T18:42:43.619638] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-08T18:42:43.620670] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-08T18:42:43.620735] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-08T18:42:43.624000] [DEBUG] [LOCAL ] EMR: Trimmed 77080 records to 53224 (keeping 200 days of data) [2025-10-08T18:42:43.964860] [DEBUG] [LOCAL ] EMR: Primary data saved (53224 records). [2025-10-08T18:42:43.965023] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-08T18:42:43.965671] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. EMR took 45.4s. Estimated remaining: 3h 47m 11s. Rate: 7.2 symbols/min [2025-10-08T18:42:44.025402] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-08T18:42:44.151072] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:44.199479] [DEBUG] [LOCAL ] ENOV: Loaded 44787 existing records from primary storage. [2025-10-08T18:42:44.199821] [INFO ] [MAIN ] ENOV: Loaded 44787 existing records. [2025-10-08T18:42:44.396982] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:44.397391] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-08T18:42:44.397505] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-08T18:42:44.397843] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-08T18:42:44.397957] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-08T18:42:44.551291] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:42:44.805893] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:44.817495] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-08T18:42:45.617545] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-08T18:42:45.958469] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T18:42:46.414138] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:42:46.423037] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-08T18:42:46.751294] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:42:46.950060] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T18:42:47.217554] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-08T18:42:47.605296] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T18:42:48.017555] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-08T18:42:48.817549] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-08T18:42:49.469219] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:42:49.617551] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-08T18:42:50.241399] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T18:42:50.417610] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-08T18:42:51.018628] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:42:51.217538] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-08T18:42:51.494995] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T18:42:51.714269] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T18:42:52.017556] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-08T18:42:52.817615] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-08T18:42:53.132432] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T18:42:53.135170] [INFO ] [REMOTE ] ENIC: Full fetch complete (51382 records). [2025-10-08T18:42:53.135343] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-08T18:42:53.562494] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-08T18:42:53.562634] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-08T18:42:53.563440] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-08T18:42:53.563506] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-08T18:42:53.564755] [DEBUG] [LOCAL ] ENIC: Trimmed 51382 records to 36357 (keeping 200 days of data) [2025-10-08T18:42:53.618911] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-08T18:42:53.788027] [DEBUG] [LOCAL ] ENIC: Primary data saved (36357 records). [2025-10-08T18:42:53.788191] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-08T18:42:53.788307] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 36.5s. Estimated remaining: 3h 47m 6s. Rate: 7.2 symbols/min [2025-10-08T18:42:53.956537] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:53.997192] [DEBUG] [LOCAL ] ENR: Loaded 43186 existing records from primary storage. [2025-10-08T18:42:53.997499] [INFO ] [MAIN ] ENR: Loaded 43186 existing records. [2025-10-08T18:42:54.106453] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T18:42:54.189772] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:54.190069] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-08T18:42:54.190124] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-08T18:42:54.190322] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-08T18:42:54.190379] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-08T18:42:54.420549] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-08T18:42:54.601592] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T18:42:54.607033] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:54.819736] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T18:42:55.217576] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-08T18:42:55.647738] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T18:42:56.017561] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-08T18:42:56.817579] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-08T18:42:57.181668] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:42:57.617527] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-08T18:42:57.896116] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:42:58.417594] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-08T18:42:59.217510] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-08T18:42:59.372624] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T18:43:00.017607] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-08T18:43:00.207986] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T18:43:00.212039] [INFO ] [REMOTE ] ENB: Full fetch complete (77488 records). [2025-10-08T18:43:00.212183] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-08T18:43:00.608258] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-08T18:43:00.608373] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-08T18:43:00.609401] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-08T18:43:00.609466] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-08T18:43:00.611037] [DEBUG] [LOCAL ] ENB: Trimmed 77488 records to 53511 (keeping 200 days of data) [2025-10-08T18:43:00.828691] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-08T18:43:00.954122] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-08T18:43:00.954268] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-08T18:43:00.954352] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENB took 46.4s. Estimated remaining: 3h 46m 55s. Rate: 7.2 symbols/min [2025-10-08T18:43:01.144283] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:01.174458] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T18:43:01.210114] [DEBUG] [LOCAL ] ENS: Loaded 29309 existing records from primary storage. [2025-10-08T18:43:01.210415] [INFO ] [MAIN ] ENS: Loaded 29309 existing records. [2025-10-08T18:43:01.394135] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:01.394757] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T18:43:01.395469] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-08T18:43:01.395635] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-08T18:43:01.398479] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-08T18:43:01.398688] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-08T18:43:01.518669] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T18:43:01.624724] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-08T18:43:01.789244] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:02.417591] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-08T18:43:02.950878] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T18:43:02.962904] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T18:43:02.963985] [INFO ] [REMOTE ] ENO: Full fetch complete (3089 records). [2025-10-08T18:43:02.964117] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-08T18:43:03.222813] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-08T18:43:03.325404] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-08T18:43:03.325492] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-08T18:43:03.325668] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-08T18:43:03.325731] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-08T18:43:03.326112] [DEBUG] [LOCAL ] ENO: Trimmed 3089 records to 1889 (keeping 200 days of data) [2025-10-08T18:43:03.338374] [DEBUG] [LOCAL ] ENO: Primary data saved (1889 records). [2025-10-08T18:43:03.338433] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-08T18:43:03.338507] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENO took 25.5s. Estimated remaining: 3h 46m 33s. Rate: 7.2 symbols/min [2025-10-08T18:43:03.519737] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:03.548149] [DEBUG] [LOCAL ] ENVA: Loaded 25309 existing records from primary storage. [2025-10-08T18:43:03.548517] [INFO ] [MAIN ] ENVA: Loaded 25309 existing records. [2025-10-08T18:43:03.741496] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:03.741870] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-08T18:43:03.741954] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-08T18:43:03.742225] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-08T18:43:03.742307] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-08T18:43:04.024085] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-08T18:43:04.148303] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:04.822287] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-08T18:43:04.828099] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T18:43:05.488228] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T18:43:05.617572] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-08T18:43:05.883122] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T18:43:06.417598] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-08T18:43:07.217582] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-08T18:43:07.406555] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T18:43:07.463295] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:43:07.981017] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T18:43:08.017600] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-08T18:43:08.817632] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-08T18:43:09.349476] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:43:09.617618] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-08T18:43:10.417565] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-08T18:43:10.467725] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:43:10.527204] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T18:43:11.217594] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-08T18:43:11.556155] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T18:43:12.017549] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-08T18:43:12.180952] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T18:43:12.817590] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-08T18:43:13.617573] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-08T18:43:13.656354] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:43:13.718917] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T18:43:14.417606] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-08T18:43:14.722852] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:43:15.217624] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-08T18:43:15.767901] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T18:43:15.772919] [INFO ] [REMOTE ] ENOV: Full fetch complete (63413 records). [2025-10-08T18:43:15.773114] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-08T18:43:16.023159] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-08T18:43:16.353990] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-08T18:43:16.354117] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-08T18:43:16.355630] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-08T18:43:16.355756] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-08T18:43:16.357449] [DEBUG] [LOCAL ] ENOV: Trimmed 63413 records to 44833 (keeping 200 days of data) [2025-10-08T18:43:16.673209] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:43:16.766481] [DEBUG] [LOCAL ] ENOV: Primary data saved (44833 records). [2025-10-08T18:43:16.766683] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-08T18:43:16.766829] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENOV took 32.8s. Estimated remaining: 3h 46m 36s. Rate: 7.2 symbols/min [2025-10-08T18:43:16.823127] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-08T18:43:16.965277] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:16.988353] [DEBUG] [LOCAL ] EOD: Loaded 14699 existing records from primary storage. [2025-10-08T18:43:16.988743] [INFO ] [MAIN ] EOD: Loaded 14699 existing records. [2025-10-08T18:43:17.171493] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:17.171862] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-08T18:43:17.171935] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-08T18:43:17.172183] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-08T18:43:17.172263] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-08T18:43:17.555119] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:43:17.554209] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:17.617493] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-08T18:43:18.411725] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:43:18.422354] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-08T18:43:19.126338] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:43:19.217581] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-08T18:43:19.402433] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:43:20.017588] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-08T18:43:20.079018] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T18:43:20.817558] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-08T18:43:21.161596] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T18:43:21.617574] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-08T18:43:21.916910] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T18:43:22.417556] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-08T18:43:22.841321] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T18:43:23.217513] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-08T18:43:23.554873] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T18:43:23.773686] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:43:24.017569] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-08T18:43:24.785316] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T18:43:24.817519] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-08T18:43:25.454180] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T18:43:25.617598] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-08T18:43:26.417583] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-08T18:43:26.815547] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T18:43:26.818097] [INFO ] [REMOTE ] ENVA: Full fetch complete (36751 records). [2025-10-08T18:43:26.818178] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-08T18:43:27.208883] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-08T18:43:27.209279] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-08T18:43:27.209913] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-08T18:43:27.209976] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-08T18:43:27.212454] [DEBUG] [LOCAL ] ENVA: Trimmed 36751 records to 25329 (keeping 200 days of data) [2025-10-08T18:43:27.217602] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-08T18:43:27.372628] [DEBUG] [LOCAL ] ENVA: Primary data saved (25329 records). [2025-10-08T18:43:27.372787] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-08T18:43:27.372907] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENVA took 24.0s. Estimated remaining: 3h 46m 33s. Rate: 7.2 symbols/min [2025-10-08T18:43:27.546848] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:27.578972] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T18:43:27.625440] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-08T18:43:27.625825] [INFO ] [MAIN ] EOG: Loaded 53344 existing records. [2025-10-08T18:43:27.801157] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:27.801567] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-08T18:43:27.801619] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-08T18:43:27.801910] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-08T18:43:27.801968] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-08T18:43:28.022764] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-08T18:43:28.159936] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:28.817576] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-08T18:43:28.961907] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T18:43:29.007054] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T18:43:29.617602] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-08T18:43:29.922943] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T18:43:30.417562] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-08T18:43:31.217572] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-08T18:43:31.513439] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T18:43:31.577500] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:43:32.017550] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-08T18:43:32.817517] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-08T18:43:32.875428] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T18:43:33.445971] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:43:33.617562] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-08T18:43:34.417574] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-08T18:43:34.550746] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T18:43:34.729289] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T18:43:35.217561] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-08T18:43:36.014156] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T18:43:36.023470] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-08T18:43:36.510434] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T18:43:36.513138] [INFO ] [REMOTE ] ENS: Full fetch complete (42103 records). [2025-10-08T18:43:36.513238] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-08T18:43:36.822735] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-08T18:43:36.923664] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-08T18:43:36.923758] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-08T18:43:36.924394] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-08T18:43:36.924434] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-08T18:43:36.925402] [DEBUG] [LOCAL ] ENS: Trimmed 42103 records to 29250 (keeping 200 days of data) [2025-10-08T18:43:37.119195] [DEBUG] [LOCAL ] ENS: Primary data saved (29250 records). [2025-10-08T18:43:37.119355] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-08T18:43:37.119441] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENS took 36.2s. Estimated remaining: 3h 46m 27s. Rate: 7.2 symbols/min [2025-10-08T18:43:37.318794] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:37.331673] [DEBUG] [LOCAL ] EOI: Loaded 10811 existing records from primary storage. [2025-10-08T18:43:37.331953] [INFO ] [MAIN ] EOI: Loaded 10811 existing records. [2025-10-08T18:43:37.531827] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:37.532111] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-08T18:43:37.532175] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-08T18:43:37.532450] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-08T18:43:37.532553] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-08T18:43:37.630797] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-08T18:43:37.923871] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T18:43:37.928940] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:38.268396] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T18:43:38.417558] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-08T18:43:38.509946] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T18:43:39.217528] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-08T18:43:39.604129] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:43:40.017510] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-08T18:43:40.167452] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T18:43:40.817561] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-08T18:43:41.617593] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-08T18:43:41.787569] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T18:43:42.004699] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T18:43:42.417564] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-08T18:43:43.100262] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T18:43:43.217528] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-08T18:43:43.304022] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T18:43:44.017554] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-08T18:43:44.409778] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T18:43:44.413029] [INFO ] [REMOTE ] ENR: Full fetch complete (58982 records). [2025-10-08T18:43:44.413124] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-08T18:43:44.619943] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T18:43:44.815306] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-08T18:43:44.815396] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-08T18:43:44.816177] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-08T18:43:44.816243] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-08T18:43:44.817545] [DEBUG] [LOCAL ] ENR: Trimmed 58982 records to 43238 (keeping 200 days of data) [2025-10-08T18:43:44.817747] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-08T18:43:45.089048] [DEBUG] [LOCAL ] ENR: Primary data saved (43238 records). [2025-10-08T18:43:45.089225] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-08T18:43:45.089341] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENR took 51.3s. Estimated remaining: 3h 46m 18s. Rate: 7.2 symbols/min [2025-10-08T18:43:45.265270] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:45.282499] [DEBUG] [LOCAL ] EOS: Loaded 15413 existing records from primary storage. [2025-10-08T18:43:45.282885] [INFO ] [MAIN ] EOS: Loaded 15413 existing records. [2025-10-08T18:43:45.461668] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:45.461930] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-08T18:43:45.461977] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-08T18:43:45.462182] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-08T18:43:45.462240] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-08T18:43:45.632246] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-08T18:43:45.817324] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:46.418331] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-08T18:43:46.421068] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:43:46.764538] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T18:43:47.217600] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-08T18:43:47.632568] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T18:43:48.017570] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-08T18:43:48.212899] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T18:43:48.214833] [INFO ] [REMOTE ] EOD: Full fetch complete (20663 records). [2025-10-08T18:43:48.214904] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-08T18:43:48.588799] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-08T18:43:48.588902] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-08T18:43:48.589394] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-08T18:43:48.589440] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-08T18:43:48.590050] [DEBUG] [LOCAL ] EOD: Trimmed 20663 records to 14808 (keeping 200 days of data) [2025-10-08T18:43:48.680043] [DEBUG] [LOCAL ] EOD: Primary data saved (14808 records). [2025-10-08T18:43:48.680206] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-08T18:43:48.680297] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOD took 31.9s. Estimated remaining: 3h 45m 59s. Rate: 7.2 symbols/min [2025-10-08T18:43:48.822719] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-08T18:43:48.857543] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:48.868328] [DEBUG] [LOCAL ] EOT: Loaded 6766 existing records from primary storage. [2025-10-08T18:43:48.868627] [INFO ] [MAIN ] EOT: Loaded 6766 existing records. [2025-10-08T18:43:49.061285] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T18:43:49.066864] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:49.071670] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-08T18:43:49.071749] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-08T18:43:49.071929] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-08T18:43:49.071989] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-08T18:43:49.434072] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:49.617516] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-08T18:43:49.771728] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T18:43:50.417544] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-08T18:43:50.473439] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T18:43:51.217516] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-08T18:43:51.514936] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T18:43:51.756911] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T18:43:52.017566] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-08T18:43:52.817544] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-08T18:43:52.843685] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T18:43:53.556243] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T18:43:53.617537] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-08T18:43:54.132138] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-08T18:43:54.417558] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-08T18:43:54.949325] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T18:43:55.217558] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-08T18:43:55.951870] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T18:43:56.017545] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-08T18:43:56.712482] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T18:43:56.817570] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-08T18:43:57.617519] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-08T18:43:57.906376] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T18:43:58.417598] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-08T18:43:59.045382] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T18:43:59.217538] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-08T18:43:59.346376] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T18:43:59.880065] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T18:44:00.017522] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-08T18:44:00.817547] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T18:44:00.817627] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-08T18:44:01.617557] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-08T18:44:02.417609] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-08T18:44:02.629625] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T18:44:02.724602] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:44:03.088676] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:44:03.217527] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-08T18:44:04.017514] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-08T18:44:04.158912] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T18:44:04.817548] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-08T18:44:04.979531] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:44:04.981039] [INFO ] [REMOTE ] EOI: Full fetch complete (16264 records). [2025-10-08T18:44:04.981112] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-08T18:44:05.348582] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-08T18:44:05.348689] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-08T18:44:05.349067] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-08T18:44:05.349128] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-08T18:44:05.349629] [DEBUG] [LOCAL ] EOI: Trimmed 16264 records to 10829 (keeping 200 days of data) [2025-10-08T18:44:05.418220] [DEBUG] [LOCAL ] EOI: Primary data saved (10829 records). [2025-10-08T18:44:05.418363] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-08T18:44:05.418505] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOI took 28.3s. Estimated remaining: 3h 46m 9s. Rate: 7.2 symbols/min [2025-10-08T18:44:05.592040] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:05.617508] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-08T18:44:05.640264] [DEBUG] [LOCAL ] EPAC: Loaded 26790 existing records from primary storage. [2025-10-08T18:44:05.640521] [INFO ] [MAIN ] EPAC: Loaded 26790 existing records. [2025-10-08T18:44:05.750628] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T18:44:05.832092] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:44:05.832256] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-08T18:44:05.832301] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-08T18:44:05.832519] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-08T18:44:05.832576] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-08T18:44:06.189726] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:06.417562] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-08T18:44:07.217522] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-08T18:44:07.582372] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T18:44:07.603736] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:44:07.754838] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T18:44:08.017522] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-08T18:44:08.817608] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-08T18:44:09.148769] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T18:44:09.613838] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T18:44:09.617489] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-08T18:44:10.336483] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-08T18:44:10.417561] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-08T18:44:11.217595] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-08T18:44:11.784092] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T18:44:11.890682] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T18:44:12.017618] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-08T18:44:12.719189] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T18:44:12.817619] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-08T18:44:13.592548] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T18:44:13.617499] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-08T18:44:14.241215] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T18:44:14.242342] [INFO ] [REMOTE ] EOT: Full fetch complete (10648 records). [2025-10-08T18:44:14.242435] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-08T18:44:14.432792] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-08T18:44:14.725714] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-08T18:44:14.725848] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-08T18:44:14.726221] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-08T18:44:14.726302] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-08T18:44:14.727141] [DEBUG] [LOCAL ] EOT: Trimmed 10648 records to 6743 (keeping 200 days of data) [2025-10-08T18:44:14.781698] [DEBUG] [LOCAL ] EOT: Primary data saved (6743 records). [2025-10-08T18:44:14.781860] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-08T18:44:14.781946] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOT took 26.1s. Estimated remaining: 3h 46m 3s. Rate: 7.2 symbols/min [2025-10-08T18:44:14.950100] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:14.991135] [DEBUG] [LOCAL ] EPAM: Loaded 39563 existing records from primary storage. [2025-10-08T18:44:14.991454] [INFO ] [MAIN ] EPAM: Loaded 39563 existing records. [2025-10-08T18:44:15.169294] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:44:15.169535] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-08T18:44:15.169582] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-08T18:44:15.169837] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-08T18:44:15.169895] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-08T18:44:15.225730] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-08T18:44:15.619843] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:15.633828] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T18:44:16.017565] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-08T18:44:16.501542] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:44:16.503362] [INFO ] [REMOTE ] EOS: Full fetch complete (23421 records). [2025-10-08T18:44:16.503436] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-08T18:44:16.827529] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-08T18:44:16.863594] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-08T18:44:16.863696] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-08T18:44:16.864170] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-08T18:44:16.864210] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-08T18:44:16.864855] [DEBUG] [LOCAL ] EOS: Trimmed 23421 records to 15423 (keeping 200 days of data) [2025-10-08T18:44:16.960396] [DEBUG] [LOCAL ] EOS: Primary data saved (15423 records). [2025-10-08T18:44:16.960550] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-08T18:44:16.960634] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOS took 31.9s. Estimated remaining: 3h 45m 41s. Rate: 7.2 symbols/min [2025-10-08T18:44:17.126498] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:17.164505] [DEBUG] [LOCAL ] EPC: Loaded 39861 existing records from primary storage. [2025-10-08T18:44:17.164840] [INFO ] [MAIN ] EPC: Loaded 39861 existing records. [2025-10-08T18:44:17.356389] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:44:17.356928] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-08T18:44:17.357101] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-08T18:44:17.357855] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-08T18:44:17.358154] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-08T18:44:17.618517] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-08T18:44:17.659281] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T18:44:17.745677] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:18.417597] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-08T18:44:19.026157] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-08T18:44:19.080879] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:44:19.217568] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-08T18:44:20.017601] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-08T18:44:20.300086] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T18:44:20.637426] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T18:44:20.817583] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-08T18:44:21.617587] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-08T18:44:21.896751] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:44:22.223366] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T18:44:22.417533] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-08T18:44:23.081244] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T18:44:23.217564] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-08T18:44:24.017620] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-08T18:44:24.295937] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T18:44:24.529088] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-08T18:44:24.533308] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-08T18:44:24.533473] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-08T18:44:24.822618] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-08T18:44:24.949995] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-08T18:44:24.950127] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-08T18:44:24.951206] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-08T18:44:24.951280] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-08T18:44:24.953006] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 53344 (keeping 200 days of data) [2025-10-08T18:44:25.448906] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:44:25.490502] [DEBUG] [LOCAL ] EOG: Primary data saved (53344 records). [2025-10-08T18:44:25.490728] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-08T18:44:25.490854] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOG took 58.1s. Estimated remaining: 3h 45m 34s. Rate: 7.2 symbols/min [2025-10-08T18:44:25.623005] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-08T18:44:25.761843] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:25.762095] [DEBUG] [LOCAL ] EPD: No existing data file found in primary storage. [2025-10-08T18:44:25.762142] [WARN ] [MAIN ] EPD: No existing data found, performing full refresh instead. [2025-10-08T18:44:25.762283] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-08T18:44:25.762334] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-08T18:44:25.762385] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-08T18:44:25.762481] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-08T18:44:26.223519] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:26.370381] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T18:44:26.417510] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-08T18:44:26.739182] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:44:27.217557] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-08T18:44:28.017613] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-08T18:44:28.127198] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:44:28.535190] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:44:28.817535] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-08T18:44:29.130171] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T18:44:29.617571] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-08T18:44:30.393381] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T18:44:30.417505] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-08T18:44:30.857111] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T18:44:31.217591] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-08T18:44:31.867000] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T18:44:32.017838] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-08T18:44:32.742031] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:44:32.817576] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-08T18:44:33.617513] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-08T18:44:33.890148] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T18:44:34.042357] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T18:44:34.417576] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-08T18:44:35.011957] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T18:44:35.217546] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-08T18:44:35.282734] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T18:44:36.017552] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-08T18:44:36.817558] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-08T18:44:36.885475] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T18:44:37.247063] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T18:44:37.617556] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-08T18:44:38.099447] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T18:44:38.417922] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-08T18:44:38.966937] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T18:44:39.217558] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-08T18:44:40.017544] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-08T18:44:40.416345] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T18:44:40.419662] [INFO ] [REMOTE ] EPAM: Full fetch complete (55957 records). [2025-10-08T18:44:40.419779] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-08T18:44:40.749919] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-08T18:44:40.817504] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-08T18:44:40.853803] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-08T18:44:40.853888] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-08T18:44:40.854812] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-08T18:44:40.854994] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-08T18:44:40.856345] [DEBUG] [LOCAL ] EPAM: Trimmed 55957 records to 39420 (keeping 200 days of data) [2025-10-08T18:44:41.102324] [DEBUG] [LOCAL ] EPAM: Primary data saved (39420 records). [2025-10-08T18:44:41.102469] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-08T18:44:41.102552] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAM took 26.3s. Estimated remaining: 3h 45m 41s. Rate: 7.2 symbols/min [2025-10-08T18:44:41.280586] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:41.280937] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-10-08T18:44:41.281006] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-10-08T18:44:41.281321] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-08T18:44:41.281441] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-08T18:44:41.281525] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-08T18:44:41.281569] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-08T18:44:41.563860] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T18:44:41.620381] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-08T18:44:41.697457] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:42.417547] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-08T18:44:42.539187] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:44:42.675506] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T18:44:42.677689] [INFO ] [REMOTE ] EPAC: Full fetch complete (38853 records). [2025-10-08T18:44:42.677763] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-08T18:44:43.051638] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-08T18:44:43.051757] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-08T18:44:43.052342] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-08T18:44:43.052381] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-08T18:44:43.053313] [DEBUG] [LOCAL ] EPAC: Trimmed 38853 records to 26691 (keeping 200 days of data) [2025-10-08T18:44:43.217810] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-08T18:44:43.221462] [DEBUG] [LOCAL ] EPAC: Primary data saved (26691 records). [2025-10-08T18:44:43.221603] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-08T18:44:43.221752] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPAC took 37.8s. Estimated remaining: 3h 45m 19s. Rate: 7.2 symbols/min [2025-10-08T18:44:43.395322] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:43.395509] [DEBUG] [LOCAL ] EPRT: No existing data file found in primary storage. [2025-10-08T18:44:43.395545] [WARN ] [MAIN ] EPRT: No existing data found, performing full refresh instead. [2025-10-08T18:44:43.395690] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-08T18:44:43.395745] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-08T18:44:43.395787] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-08T18:44:43.395818] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-08T18:44:43.773599] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:43.842174] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T18:44:44.017700] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-08T18:44:44.818228] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-08T18:44:44.823965] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T18:44:45.526230] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T18:44:45.617501] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-08T18:44:46.215740] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T18:44:46.417588] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-08T18:44:46.991560] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T18:44:47.217562] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-08T18:44:48.009868] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T18:44:48.018212] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-08T18:44:48.250694] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:44:48.817569] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-08T18:44:49.361364] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T18:44:49.617561] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-08T18:44:50.417536] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-08T18:44:50.521435] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T18:44:51.217555] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-08T18:44:51.568207] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:44:51.677409] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T18:44:52.017608] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-08T18:44:52.511420] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T18:44:52.817602] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-08T18:44:53.160538] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T18:44:53.617575] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-08T18:44:54.430256] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-08T18:44:54.457494] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T18:44:55.217554] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-08T18:44:55.300939] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T18:44:55.856287] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T18:44:56.017559] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-08T18:44:56.263481] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T18:44:56.267554] [INFO ] [REMOTE ] EPC: Full fetch complete (57064 records). [2025-10-08T18:44:56.267687] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-08T18:44:56.665187] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-08T18:44:56.665272] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-08T18:44:56.666043] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-08T18:44:56.666105] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-08T18:44:56.669575] [DEBUG] [LOCAL ] EPC: Trimmed 57064 records to 39795 (keeping 200 days of data) [2025-10-08T18:44:56.849906] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-08T18:44:56.921738] [DEBUG] [LOCAL ] EPC: Primary data saved (39795 records). [2025-10-08T18:44:56.921866] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-08T18:44:56.921945] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPC took 40.0s. Estimated remaining: 3h 45m 22s. Rate: 7.2 symbols/min [2025-10-08T18:44:57.094198] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:57.107545] [DEBUG] [LOCAL ] EQBK: Loaded 10957 existing records from primary storage. [2025-10-08T18:44:57.107797] [INFO ] [MAIN ] EQBK: Loaded 10957 existing records. [2025-10-08T18:44:57.286361] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:44:57.286569] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-08T18:44:57.286615] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-08T18:44:57.286902] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-08T18:44:57.286960] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-08T18:44:57.624355] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-08T18:44:57.679433] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:57.706266] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T18:44:58.425916] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-08T18:44:58.444140] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:44:59.217543] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-08T18:44:59.627045] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T18:45:00.017600] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-08T18:45:00.061264] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T18:45:00.509169] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T18:45:00.817598] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-08T18:45:01.617593] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-08T18:45:02.120497] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T18:45:02.417539] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-08T18:45:02.654423] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T18:45:02.709457] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T18:45:03.217558] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-08T18:45:04.017525] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-08T18:45:04.376042] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T18:45:04.817837] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-08T18:45:04.818263] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T18:45:04.858169] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T18:45:05.617581] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-08T18:45:06.417692] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-08T18:45:06.504335] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T18:45:06.508697] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-08T18:45:06.508877] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-08T18:45:06.925029] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-08T18:45:06.925150] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-08T18:45:06.926101] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-08T18:45:06.926168] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-08T18:45:06.927787] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 53611 (keeping 200 days of data) [2025-10-08T18:45:07.219730] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-08T18:45:07.272985] [DEBUG] [LOCAL ] EPD: Primary data saved (53611 records). [2025-10-08T18:45:07.273160] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-08T18:45:07.273242] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 41.8s. Estimated remaining: 3h 45m 18s. Rate: 7.2 symbols/min [2025-10-08T18:45:07.451316] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:07.451605] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-10-08T18:45:07.451754] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-10-08T18:45:07.451896] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-08T18:45:07.451999] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-08T18:45:07.452168] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-08T18:45:07.452223] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-08T18:45:07.624066] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T18:45:07.887005] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:07.918393] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T18:45:08.008016] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T18:45:08.017550] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-08T18:45:08.643071] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T18:45:08.817700] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-08T18:45:09.617525] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-08T18:45:09.780903] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T18:45:10.417543] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-08T18:45:11.219011] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-08T18:45:11.218917] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T18:45:11.407301] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T18:45:12.017558] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-08T18:45:12.817568] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-08T18:45:13.283719] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-08T18:45:13.617516] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-08T18:45:13.696883] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T18:45:13.855289] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T18:45:13.859105] [INFO ] [REMOTE ] EPRT: Full fetch complete (68950 records). [2025-10-08T18:45:13.859238] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-08T18:45:14.242056] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-08T18:45:14.242177] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-08T18:45:14.243078] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-08T18:45:14.243143] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-08T18:45:14.244594] [DEBUG] [LOCAL ] EPRT: Trimmed 68950 records to 48408 (keeping 200 days of data) [2025-10-08T18:45:14.424695] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-08T18:45:14.553376] [DEBUG] [LOCAL ] EPRT: Primary data saved (48408 records). [2025-10-08T18:45:14.553522] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-08T18:45:14.553600] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPRT took 31.3s. Estimated remaining: 3h 45m 7s. Rate: 7.2 symbols/min [2025-10-08T18:45:14.730113] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:14.786323] [DEBUG] [LOCAL ] EQNR: Loaded 53034 existing records from primary storage. [2025-10-08T18:45:14.786718] [INFO ] [MAIN ] EQNR: Loaded 53034 existing records. [2025-10-08T18:45:14.987165] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:14.987399] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-08T18:45:14.987446] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-08T18:45:14.987922] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-08T18:45:14.987981] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-08T18:45:15.223819] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-08T18:45:15.388317] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:15.400554] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:45:15.463690] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T18:45:16.017605] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-08T18:45:16.817524] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-08T18:45:17.008777] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T18:45:17.617880] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-08T18:45:17.682811] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T18:45:17.713467] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T18:45:18.417598] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-08T18:45:18.902333] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:45:18.906117] [INFO ] [REMOTE ] EPR: Full fetch complete (63055 records). [2025-10-08T18:45:18.906259] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-08T18:45:19.210496] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T18:45:19.218970] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-08T18:45:19.324056] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-08T18:45:19.324166] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-08T18:45:19.324981] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-08T18:45:19.325046] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-08T18:45:19.328379] [DEBUG] [LOCAL ] EPR: Trimmed 63055 records to 43947 (keeping 200 days of data) [2025-10-08T18:45:19.613168] [DEBUG] [LOCAL ] EPR: Primary data saved (43947 records). [2025-10-08T18:45:19.613349] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-08T18:45:19.613471] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPR took 38.5s. Estimated remaining: 3h 44m 52s. Rate: 7.2 symbols/min [2025-10-08T18:45:19.819532] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:19.872463] [DEBUG] [LOCAL ] EQR: Loaded 51602 existing records from primary storage. [2025-10-08T18:45:19.872918] [INFO ] [MAIN ] EQR: Loaded 51602 existing records. [2025-10-08T18:45:20.022733] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-08T18:45:20.068330] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:20.068627] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-08T18:45:20.068722] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-08T18:45:20.068980] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-08T18:45:20.069057] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-08T18:45:20.449634] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:20.790173] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T18:45:20.817529] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-08T18:45:21.617529] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-08T18:45:21.730223] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:45:22.417587] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-08T18:45:22.588053] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:45:23.135421] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T18:45:23.185054] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T18:45:23.186788] [INFO ] [REMOTE ] EQBK: Full fetch complete (15535 records). [2025-10-08T18:45:23.186868] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-08T18:45:23.222730] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-08T18:45:23.573764] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-08T18:45:23.574045] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-08T18:45:23.574489] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-08T18:45:23.574533] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-08T18:45:23.575098] [DEBUG] [LOCAL ] EQBK: Trimmed 15535 records to 10961 (keeping 200 days of data) [2025-10-08T18:45:23.643915] [DEBUG] [LOCAL ] EQBK: Primary data saved (10961 records). [2025-10-08T18:45:23.644070] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-08T18:45:23.644157] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EQBK took 26.7s. Estimated remaining: 3h 44m 34s. Rate: 7.2 symbols/min [2025-10-08T18:45:24.017631] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-08T18:45:24.817588] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-08T18:45:25.227475] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:45:25.617615] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-08T18:45:25.754437] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T18:45:26.427885] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-08T18:45:26.435474] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T18:45:27.217520] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-08T18:45:27.335262] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:45:27.717453] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T18:45:28.017576] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-08T18:45:28.701123] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T18:45:28.817622] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-08T18:45:29.617576] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-08T18:45:29.796239] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T18:45:30.358383] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T18:45:30.417552] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-08T18:45:31.217566] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-08T18:45:31.283473] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:45:32.017556] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-08T18:45:32.413742] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T18:45:32.817626] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-08T18:45:32.992893] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T18:45:33.617616] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-08T18:45:33.676722] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:45:34.417531] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-08T18:45:34.817402] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:45:35.217586] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-08T18:45:35.444739] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T18:45:36.017606] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-08T18:45:36.200440] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:45:36.657353] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T18:45:36.817549] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-08T18:45:37.484415] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:45:37.488481] [INFO ] [REMOTE ] EQH: Full fetch complete (76394 records). [2025-10-08T18:45:37.488634] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-08T18:45:37.622609] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-08T18:45:37.893907] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-08T18:45:37.893989] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-08T18:45:37.894938] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-08T18:45:37.895006] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-08T18:45:37.896483] [DEBUG] [LOCAL ] EQH: Trimmed 76394 records to 52650 (keeping 200 days of data) [2025-10-08T18:45:38.220253] [DEBUG] [LOCAL ] EQH: Primary data saved (52650 records). [2025-10-08T18:45:38.220405] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-08T18:45:38.220490] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 30.9s. Estimated remaining: 3h 44m 39s. Rate: 7.2 symbols/min [2025-10-08T18:45:38.814529] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T18:45:38.826530] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-08T18:45:39.342782] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:45:39.354066] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-08T18:45:40.435259] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T18:45:40.446761] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-08T18:45:40.829974] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:45:40.841071] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-08T18:45:42.316382] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T18:45:42.328724] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-08T18:45:42.363108] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T18:45:42.417543] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-08T18:45:43.950845] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T18:45:43.962361] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-08T18:45:44.255269] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T18:45:44.259343] [INFO ] [REMOTE ] EQNR: Full fetch complete (76823 records). [2025-10-08T18:45:44.259454] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-08T18:45:44.649364] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-08T18:45:44.649457] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-08T18:45:44.650363] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-08T18:45:44.650432] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-08T18:45:44.652030] [DEBUG] [LOCAL ] EQNR: Trimmed 76823 records to 53032 (keeping 200 days of data) [2025-10-08T18:45:44.979316] [DEBUG] [LOCAL ] EQNR: Primary data saved (53032 records). [2025-10-08T18:45:44.979460] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-08T18:45:44.979546] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 30.4s. Estimated remaining: 3h 44m 28s. Rate: 7.2 symbols/min [2025-10-08T18:45:45.416306] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T18:45:45.420296] [INFO ] [REMOTE ] EQR: Full fetch complete (74104 records). [2025-10-08T18:45:45.420433] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-08T18:45:45.806326] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-08T18:45:45.806408] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-08T18:45:45.807293] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-08T18:45:45.807355] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-08T18:45:45.808871] [DEBUG] [LOCAL ] EQR: Trimmed 74104 records to 51608 (keeping 200 days of data) [2025-10-08T18:45:46.134326] [DEBUG] [LOCAL ] EQR: Primary data saved (51608 records). [2025-10-08T18:45:46.134502] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-08T18:45:46.134636] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 26.5s. Estimated remaining: 3h 44m 4s. Rate: 7.2 symbols/min [2025-10-08T18:45:46.784513] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:46.879998] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:46.878743] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:46.885932] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-08T18:45:46.907503] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-08T18:45:46.908056] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-08T18:45:46.907315] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:46.908174] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-08T18:45:46.909114] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-08T18:45:46.909164] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-08T18:45:46.974394] [DEBUG] [LOCAL ] EQV: Loaded 2705 existing records from primary storage. [2025-10-08T18:45:47.001345] [INFO ] [MAIN ] EQV: Loaded 2705 existing records. [2025-10-08T18:45:47.426490] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-08T18:45:47.469392] [DEBUG] [LOCAL ] ERJ: Loaded 50561 existing records from primary storage. [2025-10-08T18:45:47.498025] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-10-08T18:45:47.484469] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:47.514424] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-08T18:45:47.530160] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-08T18:45:47.519769] [INFO ] [MAIN ] ERJ: Loaded 50561 existing records. [2025-10-08T18:45:47.624323] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:47.631726] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-08T18:45:47.641201] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-08T18:45:47.702167] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-08T18:45:48.100720] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:48.166785] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-08T18:45:48.176002] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-08T18:45:48.170471] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:48.186780] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-08T18:45:48.200554] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-08T18:45:48.211348] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-08T18:45:48.262817] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-08T18:45:48.372667] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-08T18:45:48.326958] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T18:45:48.408968] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-08T18:45:48.383130] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-08T18:45:48.903321] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:48.926460] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T18:45:48.984876] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-08T18:45:48.932099] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-08T18:45:49.239302] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:49.251541] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-08T18:45:49.332440] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:49.332846] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-08T18:45:49.389022] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T18:45:49.390008] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-08T18:45:49.674935] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T18:45:49.676991] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-08T18:45:49.694967] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-08T18:45:50.252369] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T18:45:50.417535] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-08T18:45:50.677243] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-08T18:45:50.773074] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:45:51.080227] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T18:45:51.217600] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-08T18:45:51.792176] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T18:45:52.017708] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-08T18:45:52.817579] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-08T18:45:53.298242] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-08T18:45:53.378305] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:45:53.617546] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-08T18:45:54.417581] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-08T18:45:55.217544] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-08T18:45:55.338985] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:45:55.608739] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T18:45:56.017560] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-08T18:45:56.248807] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:45:56.817576] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-08T18:45:57.166857] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-08T18:45:57.617611] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-08T18:45:57.855835] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T18:45:58.417564] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-08T18:45:59.217543] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-08T18:45:59.270637] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:45:59.721071] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T18:46:00.017524] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-08T18:46:00.222726] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T18:46:00.403888] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-08T18:46:00.817587] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-08T18:46:01.617569] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-08T18:46:01.957622] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T18:46:02.417600] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-08T18:46:02.714690] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T18:46:03.217559] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-08T18:46:03.601711] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T18:46:03.952519] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T18:46:04.017505] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-08T18:46:04.817748] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-08T18:46:05.460800] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T18:46:05.617539] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-08T18:46:06.417558] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-08T18:46:06.773888] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T18:46:06.980526] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T18:46:07.217609] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-08T18:46:07.473629] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T18:46:08.017572] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-08T18:46:08.606770] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T18:46:08.817533] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-08T18:46:08.915485] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T18:46:09.233348] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T18:46:09.234096] [INFO ] [REMOTE ] EQS: Full fetch complete (2479 records). [2025-10-08T18:46:09.234163] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-08T18:46:09.422145] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-08T18:46:09.422351] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:46:09.422420] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:46:09.422493] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-08T18:46:09.422576] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-08T18:46:09.422630] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-08T18:46:09.422732] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-08T18:46:09.422826] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQS took 23.3s. Estimated remaining: 3h 44m 27s. Rate: 7.2 symbols/min [2025-10-08T18:46:09.607054] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:09.617571] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-08T18:46:09.653765] [DEBUG] [LOCAL ] ERO: Loaded 41407 existing records from primary storage. [2025-10-08T18:46:09.654174] [INFO ] [MAIN ] ERO: Loaded 41407 existing records. [2025-10-08T18:46:09.897501] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:09.897839] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-08T18:46:09.897902] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-08T18:46:09.898151] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-08T18:46:09.898220] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-08T18:46:10.429130] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-08T18:46:10.437495] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:11.217571] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-08T18:46:11.519278] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T18:46:11.613204] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-08T18:46:11.963951] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:46:12.017534] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-08T18:46:12.817566] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-08T18:46:13.617561] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-08T18:46:14.016518] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:46:14.184443] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T18:46:14.220732] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T18:46:14.417555] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-08T18:46:15.217527] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-08T18:46:16.017584] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-08T18:46:16.444578] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T18:46:16.652410] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:46:16.817554] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-08T18:46:17.485150] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:46:17.617570] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-08T18:46:17.981800] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T18:46:18.098899] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:46:18.103018] [INFO ] [REMOTE ] ERJ: Full fetch complete (72438 records). [2025-10-08T18:46:18.103189] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-08T18:46:18.422790] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-08T18:46:18.533496] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-08T18:46:18.533599] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-08T18:46:18.534467] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-08T18:46:18.534532] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-08T18:46:18.536082] [DEBUG] [LOCAL ] ERJ: Trimmed 72438 records to 50464 (keeping 200 days of data) [2025-10-08T18:46:18.839818] [DEBUG] [LOCAL ] ERJ: Primary data saved (50464 records). [2025-10-08T18:46:18.839964] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-08T18:46:18.840048] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. ERJ took 32.7s. Estimated remaining: 3h 44m 21s. Rate: 7.2 symbols/min [2025-10-08T18:46:19.011422] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:19.060963] [DEBUG] [LOCAL ] ES: Loaded 52614 existing records from primary storage. [2025-10-08T18:46:19.061296] [INFO ] [MAIN ] ES: Loaded 52614 existing records. [2025-10-08T18:46:19.232920] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-08T18:46:19.238165] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:19.239768] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-08T18:46:19.239840] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-08T18:46:19.240101] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-08T18:46:19.240160] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-08T18:46:19.598209] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:20.017626] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-08T18:46:20.480177] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T18:46:20.818913] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-08T18:46:20.821213] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:46:21.251640] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T18:46:21.252427] [INFO ] [REMOTE ] EQV: Full fetch complete (5764 records). [2025-10-08T18:46:21.252500] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-08T18:46:21.627473] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-08T18:46:21.647950] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:46:21.673256] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-08T18:46:21.685351] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-08T18:46:21.686494] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-08T18:46:21.686556] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-08T18:46:21.687091] [DEBUG] [LOCAL ] EQV: Trimmed 5764 records to 2709 (keeping 200 days of data) [2025-10-08T18:46:21.703287] [DEBUG] [LOCAL ] EQV: Primary data saved (2709 records). [2025-10-08T18:46:21.703406] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-08T18:46:21.703495] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQV took 35.5s. Estimated remaining: 3h 44m 1s. Rate: 7.2 symbols/min [2025-10-08T18:46:21.877370] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:21.906447] [DEBUG] [LOCAL ] ESAB: Loaded 26108 existing records from primary storage. [2025-10-08T18:46:21.906773] [INFO ] [MAIN ] ESAB: Loaded 26108 existing records. [2025-10-08T18:46:22.109489] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:22.109786] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-08T18:46:22.109861] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-08T18:46:22.110139] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-08T18:46:22.110200] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-08T18:46:22.426559] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-08T18:46:22.466926] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:23.217536] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-08T18:46:23.547721] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T18:46:23.551841] [INFO ] [REMOTE ] EQT: Full fetch complete (77694 records). [2025-10-08T18:46:23.551973] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-08T18:46:23.945257] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-08T18:46:23.945345] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-08T18:46:23.946297] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-08T18:46:23.946383] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-08T18:46:23.948002] [DEBUG] [LOCAL ] EQT: Trimmed 77694 records to 53682 (keeping 200 days of data) [2025-10-08T18:46:24.018066] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-08T18:46:24.248227] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T18:46:24.346071] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-10-08T18:46:24.346242] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-08T18:46:24.346333] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. EQT took 38.2s. Estimated remaining: 3h 43m 41s. Rate: 7.2 symbols/min [2025-10-08T18:46:24.528528] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:24.556675] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T18:46:24.579409] [DEBUG] [LOCAL ] ESE: Loaded 16585 existing records from primary storage. [2025-10-08T18:46:24.579703] [INFO ] [MAIN ] ESE: Loaded 16585 existing records. [2025-10-08T18:46:24.765036] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:24.765333] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-08T18:46:24.765520] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-08T18:46:24.765865] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-08T18:46:24.765940] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-08T18:46:24.822756] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-08T18:46:24.912011] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T18:46:25.141602] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:25.617540] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-08T18:46:26.417582] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-08T18:46:26.469227] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:46:26.545988] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:46:27.217545] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-08T18:46:27.996725] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T18:46:28.017490] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-08T18:46:28.100220] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:46:28.624363] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:46:28.817566] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-08T18:46:29.617540] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-08T18:46:29.768265] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T18:46:30.417556] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-08T18:46:31.021133] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T18:46:31.217544] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-08T18:46:31.554446] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T18:46:32.017546] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-08T18:46:32.817576] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-08T18:46:33.074942] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T18:46:33.451453] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T18:46:33.541291] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T18:46:33.617562] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-08T18:46:34.417515] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-08T18:46:34.544341] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T18:46:35.217547] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-08T18:46:36.017529] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T18:46:36.017614] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-08T18:46:36.817598] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-08T18:46:36.997910] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T18:46:37.028174] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T18:46:37.617596] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-08T18:46:37.867135] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T18:46:38.417530] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-08T18:46:38.686814] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T18:46:39.217547] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-08T18:46:39.375814] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T18:46:40.017577] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-08T18:46:40.817514] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-08T18:46:41.027610] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T18:46:41.239485] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T18:46:41.615395] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:46:41.618990] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-08T18:46:42.417520] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-08T18:46:42.712001] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T18:46:43.217558] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-08T18:46:44.027213] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-08T18:46:44.046953] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:46:44.108306] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:46:44.817530] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-08T18:46:45.075884] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T18:46:45.617610] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-08T18:46:46.417537] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-08T18:46:46.591701] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T18:46:46.970933] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T18:46:47.217573] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-08T18:46:47.421795] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T18:46:48.017572] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-08T18:46:48.817580] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-08T18:46:48.991114] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T18:46:49.177907] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:46:49.617607] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-08T18:46:50.088633] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T18:46:50.417569] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-08T18:46:51.217569] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-08T18:46:51.242273] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T18:46:51.363584] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T18:46:52.017617] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-08T18:46:52.784190] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T18:46:52.793068] [INFO ] [REMOTE ] ERO: Full fetch complete (59733 records). [2025-10-08T18:46:52.793260] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-08T18:46:52.824178] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-08T18:46:53.192487] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-08T18:46:53.192577] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-08T18:46:53.193451] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-08T18:46:53.193520] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-08T18:46:53.195006] [DEBUG] [LOCAL ] ERO: Trimmed 59733 records to 41514 (keeping 200 days of data) [2025-10-08T18:46:53.444063] [DEBUG] [LOCAL ] ERO: Primary data saved (41514 records). [2025-10-08T18:46:53.444196] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-08T18:46:53.444280] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERO took 44.0s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-08T18:46:53.618876] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-08T18:46:53.611014] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:46:53.641836] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:53.648307] [INFO ] [REMOTE ] ES: Full fetch complete (76241 records). [2025-10-08T18:46:53.648423] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-08T18:46:53.771316] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T18:46:53.826636] [INFO ] [REMOTE ] ESE: Full fetch complete (22408 records). [2025-10-08T18:46:53.857885] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-08T18:46:54.185625] [DEBUG] [LOCAL ] ESI: Loaded 50698 existing records from primary storage. [2025-10-08T18:46:54.235204] [INFO ] [MAIN ] ESI: Loaded 50698 existing records. [2025-10-08T18:46:54.453324] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-08T18:46:54.534307] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-08T18:46:54.577356] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-08T18:46:54.649473] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-08T18:46:54.776320] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:54.804334] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-08T18:46:54.804193] [DEBUG] [LOCAL ] ES: Trimmed 76241 records to 52628 (keeping 200 days of data) [2025-10-08T18:46:54.805213] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-08T18:46:54.805475] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-08T18:46:54.805546] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-08T18:46:54.806092] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-08T18:46:54.806570] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-08T18:46:54.807042] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-08T18:46:54.806998] [DEBUG] [LOCAL ] ESE: Trimmed 22408 records to 16540 (keeping 200 days of data) [2025-10-08T18:46:54.807150] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-08T18:46:55.071267] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T18:46:55.102631] [INFO ] [REMOTE ] ESAB: Full fetch complete (35888 records). [2025-10-08T18:46:55.116261] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-08T18:46:55.485709] [DEBUG] [LOCAL ] ESE: Primary data saved (16540 records). [2025-10-08T18:46:55.496888] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-08T18:46:55.502763] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ESE took 31.2s. Estimated remaining: 3h 43m 54s. Rate: 7.2 symbols/min [2025-10-08T18:46:55.688088] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:55.718824] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-08T18:46:56.004814] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:56.096016] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-08T18:46:56.096598] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-08T18:46:56.097702] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-08T18:46:56.098151] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-08T18:46:56.103030] [DEBUG] [LOCAL ] ESAB: Trimmed 35888 records to 26086 (keeping 200 days of data) [2025-10-08T18:46:56.331432] [DEBUG] [LOCAL ] ESNT: Loaded 38318 existing records from primary storage. [2025-10-08T18:46:56.332755] [INFO ] [MAIN ] ESNT: Loaded 38318 existing records. [2025-10-08T18:46:56.547608] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:56.550874] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-08T18:46:56.551680] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-08T18:46:56.553529] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-08T18:46:56.554396] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-08T18:46:57.081467] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:57.083504] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-08T18:46:57.142289] [DEBUG] [LOCAL ] ES: Primary data saved (52628 records). [2025-10-08T18:46:57.143233] [INFO ] [MAIN ] ES: Full history saved. [2025-10-08T18:46:57.143366] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ES took 38.3s. Estimated remaining: 3h 43m 32s. Rate: 7.2 symbols/min [2025-10-08T18:46:57.333438] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:57.337338] [DEBUG] [LOCAL ] ESAB: Primary data saved (26086 records). [2025-10-08T18:46:57.337524] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-08T18:46:57.337704] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESAB took 35.6s. Estimated remaining: 3h 43m 7s. Rate: 7.2 symbols/min [2025-10-08T18:46:57.562584] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:57.565779] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:46:57.577385] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-08T18:46:57.594103] [DEBUG] [LOCAL ] ESRT: Loaded 46351 existing records from primary storage. [2025-10-08T18:46:57.594525] [INFO ] [MAIN ] ESRT: Loaded 46351 existing records. [2025-10-08T18:46:57.806123] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:57.807114] [DEBUG] [LOCAL ] ESS: Loaded 29871 existing records from primary storage. [2025-10-08T18:46:57.807384] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-08T18:46:57.807526] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-08T18:46:57.807698] [INFO ] [MAIN ] ESS: Loaded 29871 existing records. [2025-10-08T18:46:57.839725] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-08T18:46:57.880562] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-08T18:46:58.149838] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:58.166180] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-08T18:46:58.220938] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-08T18:46:58.283104] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-08T18:46:58.294630] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-08T18:46:58.499930] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:58.505496] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-08T18:46:58.752731] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:58.753065] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-08T18:46:58.866919] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T18:46:58.896207] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-08T18:46:58.897891] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T18:46:59.217543] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-08T18:46:59.779971] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T18:47:00.017559] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-08T18:47:00.135725] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:47:00.267157] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T18:47:00.749947] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T18:47:00.817537] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-08T18:47:01.083813] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T18:47:01.617588] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-08T18:47:02.074668] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:47:02.417601] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-08T18:47:03.218751] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-08T18:47:03.228670] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:47:04.017889] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-08T18:47:04.116609] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T18:47:04.576177] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T18:47:04.817610] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-08T18:47:05.467922] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T18:47:05.617549] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-08T18:47:06.334799] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T18:47:06.417552] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-08T18:47:07.222760] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-08T18:47:07.237814] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T18:47:07.436830] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T18:47:08.017572] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-08T18:47:08.600996] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:47:08.817584] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-08T18:47:09.406012] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:47:09.617527] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-08T18:47:10.244800] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T18:47:10.417584] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-08T18:47:10.823582] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T18:47:11.217585] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-08T18:47:12.017528] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-08T18:47:12.183443] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T18:47:12.254557] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T18:47:12.817552] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-08T18:47:13.461514] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:47:13.617556] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-08T18:47:14.417513] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-08T18:47:14.547005] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:47:14.797695] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T18:47:15.217572] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-08T18:47:16.017523] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-08T18:47:16.042563] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:47:16.485929] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T18:47:16.817569] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-08T18:47:17.617690] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-08T18:47:17.663713] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:47:17.755608] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T18:47:18.417547] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-08T18:47:18.859964] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T18:47:19.217551] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-08T18:47:19.761694] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T18:47:20.017615] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-08T18:47:20.552365] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T18:47:20.817554] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-08T18:47:21.149044] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T18:47:21.617563] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-08T18:47:22.417532] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-08T18:47:22.459934] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:47:22.538351] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T18:47:23.217557] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-08T18:47:23.663904] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T18:47:24.017548] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-08T18:47:24.395498] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T18:47:24.397867] [INFO ] [REMOTE ] ESS: Full fetch complete (43321 records). [2025-10-08T18:47:24.397969] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-08T18:47:24.776492] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-08T18:47:24.776577] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-08T18:47:24.777233] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-08T18:47:24.777298] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-08T18:47:24.778172] [DEBUG] [LOCAL ] ESS: Trimmed 43321 records to 29778 (keeping 200 days of data) [2025-10-08T18:47:24.833882] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-08T18:47:24.972365] [DEBUG] [LOCAL ] ESS: Primary data saved (29778 records). [2025-10-08T18:47:24.972527] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-08T18:47:24.972663] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESS took 27.6s. Estimated remaining: 3h 43m 38s. Rate: 7.2 symbols/min [2025-10-08T18:47:25.141864] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:25.187601] [DEBUG] [LOCAL ] ESTC: Loaded 50060 existing records from primary storage. [2025-10-08T18:47:25.188008] [INFO ] [MAIN ] ESTC: Loaded 50060 existing records. [2025-10-08T18:47:25.378633] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:25.379036] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-08T18:47:25.379136] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-08T18:47:25.380627] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-08T18:47:25.380744] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-08T18:47:25.628614] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T18:47:25.628709] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-08T18:47:25.836137] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:26.417562] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-08T18:47:26.435999] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T18:47:26.440295] [INFO ] [REMOTE ] ESI: Full fetch complete (72857 records). [2025-10-08T18:47:26.440502] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-08T18:47:26.912018] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-08T18:47:26.912164] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-08T18:47:26.913344] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-08T18:47:26.913579] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-08T18:47:26.915856] [DEBUG] [LOCAL ] ESI: Trimmed 72857 records to 50673 (keeping 200 days of data) [2025-10-08T18:47:27.071404] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T18:47:27.236914] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-08T18:47:27.276798] [DEBUG] [LOCAL ] ESI: Primary data saved (50673 records). [2025-10-08T18:47:27.276958] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-08T18:47:27.277047] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESI took 33.8s. Estimated remaining: 3h 43m 17s. Rate: 7.2 symbols/min [2025-10-08T18:47:27.443899] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:27.496441] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-08T18:47:27.496801] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-08T18:47:27.677377] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:27.677673] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-08T18:47:27.677741] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-08T18:47:27.679121] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-08T18:47:27.679181] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-08T18:47:28.030370] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-08T18:47:28.037503] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:28.118786] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T18:47:28.737355] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:47:28.741680] [INFO ] [REMOTE ] ESRT: Full fetch complete (66511 records). [2025-10-08T18:47:28.741810] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-08T18:47:28.822827] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-08T18:47:29.129310] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-08T18:47:29.129547] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-08T18:47:29.130455] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-08T18:47:29.130589] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-08T18:47:29.132736] [DEBUG] [LOCAL ] ESRT: Trimmed 66511 records to 46356 (keeping 200 days of data) [2025-10-08T18:47:29.250715] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T18:47:29.447011] [DEBUG] [LOCAL ] ESRT: Primary data saved (46356 records). [2025-10-08T18:47:29.447178] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-08T18:47:29.447321] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESRT took 32.3s. Estimated remaining: 3h 42m 56s. Rate: 7.2 symbols/min [2025-10-08T18:47:29.614605] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:29.617575] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-08T18:47:29.629518] [DEBUG] [LOCAL ] ETB: Loaded 12221 existing records from primary storage. [2025-10-08T18:47:29.629811] [INFO ] [MAIN ] ETB: Loaded 12221 existing records. [2025-10-08T18:47:29.803496] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:29.803789] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-08T18:47:29.803838] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-08T18:47:29.804297] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-08T18:47:29.804356] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-08T18:47:30.154288] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:30.417566] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-08T18:47:30.706665] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T18:47:30.817806] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T18:47:31.167348] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T18:47:31.217495] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-08T18:47:31.780430] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:47:32.017566] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-08T18:47:32.817535] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-08T18:47:33.018228] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T18:47:33.617548] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-08T18:47:34.184248] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T18:47:34.187986] [INFO ] [REMOTE ] ESNT: Full fetch complete (57138 records). [2025-10-08T18:47:34.188142] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-08T18:47:34.351072] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T18:47:34.426517] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-08T18:47:34.696795] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-08T18:47:34.696891] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-08T18:47:34.697851] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-08T18:47:34.697919] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-08T18:47:34.699313] [DEBUG] [LOCAL ] ESNT: Trimmed 57138 records to 38246 (keeping 200 days of data) [2025-10-08T18:47:34.978801] [DEBUG] [LOCAL ] ESNT: Primary data saved (38246 records). [2025-10-08T18:47:34.979004] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-08T18:47:34.979135] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESNT took 39.4s. Estimated remaining: 3h 42m 42s. Rate: 7.2 symbols/min [2025-10-08T18:47:35.205693] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:35.221705] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-08T18:47:35.235322] [DEBUG] [LOCAL ] ETD: Loaded 27351 existing records from primary storage. [2025-10-08T18:47:35.235672] [INFO ] [MAIN ] ETD: Loaded 27351 existing records. [2025-10-08T18:47:35.477543] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:35.477908] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-08T18:47:35.477972] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-08T18:47:35.478869] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-08T18:47:35.478929] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-08T18:47:35.587171] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T18:47:35.838102] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:36.017532] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-08T18:47:36.817502] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-08T18:47:36.859084] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T18:47:37.617533] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-08T18:47:37.668885] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T18:47:37.858992] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T18:47:38.417541] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-08T18:47:38.669978] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:47:39.217570] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-08T18:47:40.012558] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T18:47:40.017488] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-08T18:47:40.512487] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-08T18:47:40.537524] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T18:47:40.817572] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-08T18:47:41.617507] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-08T18:47:41.994106] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T18:47:42.275037] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T18:47:42.417519] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-08T18:47:43.217563] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-08T18:47:43.517913] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:47:44.017578] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-08T18:47:44.538212] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:47:44.817599] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-08T18:47:45.244947] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:47:45.617566] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-08T18:47:46.234684] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T18:47:46.265253] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T18:47:46.417606] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-08T18:47:47.217521] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-08T18:47:47.319660] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:47:47.321324] [INFO ] [REMOTE ] ETB: Full fetch complete (18329 records). [2025-10-08T18:47:47.321395] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-08T18:47:47.685661] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-08T18:47:47.685768] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-08T18:47:47.686194] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-08T18:47:47.686235] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-08T18:47:47.686902] [DEBUG] [LOCAL ] ETB: Trimmed 18329 records to 12203 (keeping 200 days of data) [2025-10-08T18:47:47.763237] [DEBUG] [LOCAL ] ETB: Primary data saved (12203 records). [2025-10-08T18:47:47.763392] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-08T18:47:47.763493] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 18.3s. Estimated remaining: 3h 42m 43s. Rate: 7.2 symbols/min [2025-10-08T18:47:47.949734] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:47.967248] [DEBUG] [LOCAL ] ETG: Loaded 16574 existing records from primary storage. [2025-10-08T18:47:47.967511] [INFO ] [MAIN ] ETG: Loaded 16574 existing records. [2025-10-08T18:47:48.028220] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-08T18:47:48.148301] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:48.148569] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-08T18:47:48.148624] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-08T18:47:48.149198] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-08T18:47:48.149257] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-08T18:47:48.497599] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:48.817695] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-08T18:47:49.343006] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T18:47:49.372832] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T18:47:49.617557] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-08T18:47:50.232066] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T18:47:50.417514] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-08T18:47:51.217624] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-08T18:47:51.705946] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T18:47:52.017735] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-08T18:47:52.218048] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:47:52.269297] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T18:47:52.817579] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-08T18:47:53.617539] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-08T18:47:53.645016] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T18:47:54.152025] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-08T18:47:54.417634] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-08T18:47:55.217567] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-08T18:47:55.276640] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T18:47:55.329813] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T18:47:56.017563] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-08T18:47:56.817532] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-08T18:47:56.995407] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T18:47:57.364553] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-08T18:47:57.617547] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-08T18:47:58.080636] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T18:47:58.417527] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-08T18:47:59.217598] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-08T18:47:59.802970] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T18:47:59.961808] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-08T18:48:00.017515] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-08T18:48:00.324816] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T18:48:00.817608] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-08T18:48:01.617554] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-08T18:48:02.359677] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-08T18:48:02.409393] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T18:48:02.419734] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-08T18:48:03.102601] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T18:48:03.217586] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-08T18:48:04.017552] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-08T18:48:04.327174] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T18:48:04.711962] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T18:48:04.716470] [INFO ] [REMOTE ] ESTC: Full fetch complete (72106 records). [2025-10-08T18:48:04.716620] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-08T18:48:04.827275] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-08T18:48:05.151620] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-08T18:48:05.152849] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-08T18:48:05.153785] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-08T18:48:05.153868] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-08T18:48:05.152785] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T18:48:05.161813] [DEBUG] [LOCAL ] ESTC: Trimmed 72106 records to 50106 (keeping 200 days of data) [2025-10-08T18:48:05.466546] [DEBUG] [LOCAL ] ESTC: Primary data saved (50106 records). [2025-10-08T18:48:05.466724] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-08T18:48:05.466833] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ESTC took 40.5s. Estimated remaining: 3h 42m 54s. Rate: 7.2 symbols/min [2025-10-08T18:48:05.618238] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-08T18:48:05.643943] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:05.662031] [DEBUG] [LOCAL ] ETJ: Loaded 17010 existing records from primary storage. [2025-10-08T18:48:05.662329] [INFO ] [MAIN ] ETJ: Loaded 17010 existing records. [2025-10-08T18:48:05.850549] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:05.851110] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-08T18:48:05.851216] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-08T18:48:05.852066] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-08T18:48:05.852132] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-08T18:48:06.023060] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T18:48:06.225190] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:06.417560] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-08T18:48:06.689778] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T18:48:07.070344] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T18:48:07.217557] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-08T18:48:08.017549] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-08T18:48:08.241947] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T18:48:08.817566] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-08T18:48:09.617571] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-08T18:48:09.836480] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T18:48:10.066706] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-08T18:48:10.071092] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-08T18:48:10.071258] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-08T18:48:10.420239] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-08T18:48:10.464286] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-08T18:48:10.464389] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-08T18:48:10.465623] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-08T18:48:10.465721] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-08T18:48:10.467403] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-10-08T18:48:10.601503] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T18:48:10.605359] [INFO ] [REMOTE ] ETD: Full fetch complete (38459 records). [2025-10-08T18:48:10.606183] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-08T18:48:11.104595] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-08T18:48:11.132035] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-08T18:48:11.132870] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-08T18:48:11.134525] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-08T18:48:11.140091] [DEBUG] [LOCAL ] ETD: Trimmed 38459 records to 27379 (keeping 200 days of data) [2025-10-08T18:48:11.235091] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-08T18:48:11.254624] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T18:48:11.358255] [DEBUG] [LOCAL ] ETD: Primary data saved (27379 records). [2025-10-08T18:48:11.360344] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-08T18:48:11.360480] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETD took 36.4s. Estimated remaining: 3h 42m 40s. Rate: 7.2 symbols/min [2025-10-08T18:48:11.649046] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:11.653154] [DEBUG] [LOCAL ] ETN: No existing data file found in primary storage. [2025-10-08T18:48:11.653235] [WARN ] [MAIN ] ETN: No existing data found, performing full refresh instead. [2025-10-08T18:48:11.653721] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-08T18:48:11.653819] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-08T18:48:11.654711] [DEBUG] [LOCAL ] ETN: No primary data file found to delete. [2025-10-08T18:48:11.655329] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-08T18:48:11.823257] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-08T18:48:11.833696] [INFO ] [MAIN ] ET: Full history saved. [2025-10-08T18:48:11.833821] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ET took 44.6s. Estimated remaining: 3h 42m 16s. Rate: 7.2 symbols/min [2025-10-08T18:48:12.044138] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-08T18:48:12.219224] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:12.327830] [DEBUG] [LOCAL ] ETO: Loaded 6736 existing records from primary storage. [2025-10-08T18:48:12.327345] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:12.335535] [INFO ] [MAIN ] ETO: Loaded 6736 existing records. [2025-10-08T18:48:12.361453] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T18:48:12.545517] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:12.545822] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-08T18:48:12.545884] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-08T18:48:12.546201] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-08T18:48:12.546262] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-08T18:48:12.822891] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-08T18:48:13.104529] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:13.120694] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T18:48:13.617572] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-08T18:48:13.893859] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T18:48:14.398447] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-08T18:48:14.417561] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-08T18:48:14.944600] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-08T18:48:15.217581] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-08T18:48:16.017553] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-08T18:48:16.284002] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T18:48:16.710865] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T18:48:16.817564] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-08T18:48:17.488544] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T18:48:17.617599] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-08T18:48:18.417546] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-08T18:48:18.535799] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T18:48:19.068410] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T18:48:19.217537] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-08T18:48:20.017585] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-08T18:48:20.180017] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:48:20.817585] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-08T18:48:21.271344] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T18:48:21.565456] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T18:48:21.617538] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-08T18:48:22.417618] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-08T18:48:23.217567] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-08T18:48:23.341866] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T18:48:23.631241] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T18:48:23.667728] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T18:48:24.017561] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-08T18:48:24.817555] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-08T18:48:24.912498] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T18:48:24.914160] [INFO ] [REMOTE ] ETG: Full fetch complete (24847 records). [2025-10-08T18:48:24.914232] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-08T18:48:25.272785] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-08T18:48:25.272867] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-08T18:48:25.273344] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-08T18:48:25.273382] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-08T18:48:25.274037] [DEBUG] [LOCAL ] ETG: Trimmed 24847 records to 16576 (keeping 200 days of data) [2025-10-08T18:48:25.374157] [DEBUG] [LOCAL ] ETG: Primary data saved (16576 records). [2025-10-08T18:48:25.374309] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-08T18:48:25.374395] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETG took 37.6s. Estimated remaining: 3h 42m 18s. Rate: 7.2 symbols/min [2025-10-08T18:48:25.540363] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:48:25.560370] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:25.614601] [DEBUG] [LOCAL ] ETR: Loaded 53233 existing records from primary storage. [2025-10-08T18:48:25.614964] [INFO ] [MAIN ] ETR: Loaded 53233 existing records. [2025-10-08T18:48:25.625841] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-08T18:48:25.792050] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:25.792246] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-08T18:48:25.792294] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-08T18:48:25.792557] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-08T18:48:25.792615] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-08T18:48:26.132318] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:26.417551] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-08T18:48:27.217589] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-08T18:48:27.509285] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-08T18:48:27.759411] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T18:48:28.017532] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-08T18:48:28.346886] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T18:48:28.646760] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T18:48:28.817547] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-08T18:48:29.617557] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-08T18:48:30.375802] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T18:48:30.417556] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-08T18:48:31.217530] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-08T18:48:31.422751] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:48:31.753829] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:48:31.978536] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T18:48:32.017546] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-08T18:48:32.817518] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-08T18:48:33.056854] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T18:48:33.059055] [INFO ] [REMOTE ] ETJ: Full fetch complete (25682 records). [2025-10-08T18:48:33.059225] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-08T18:48:33.451346] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-08T18:48:33.451426] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-08T18:48:33.451911] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-08T18:48:33.451972] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-08T18:48:33.452572] [DEBUG] [LOCAL ] ETJ: Trimmed 25682 records to 17038 (keeping 200 days of data) [2025-10-08T18:48:33.549378] [DEBUG] [LOCAL ] ETJ: Primary data saved (17038 records). [2025-10-08T18:48:33.549519] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-08T18:48:33.549604] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETJ took 28.1s. Estimated remaining: 3h 42m 9s. Rate: 7.2 symbols/min [2025-10-08T18:48:33.623731] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-08T18:48:33.720305] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:33.742021] [DEBUG] [LOCAL ] ETV: Loaded 21890 existing records from primary storage. [2025-10-08T18:48:33.742273] [INFO ] [MAIN ] ETV: Loaded 21890 existing records. [2025-10-08T18:48:33.921321] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:33.921558] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-08T18:48:33.921604] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-08T18:48:33.921874] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-08T18:48:33.921931] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-08T18:48:34.272801] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:34.417548] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-08T18:48:34.485463] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T18:48:34.702583] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T18:48:35.217569] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-08T18:48:36.017607] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-08T18:48:36.586692] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T18:48:36.671130] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T18:48:36.817529] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-08T18:48:37.064085] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:48:37.590001] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T18:48:37.617506] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-08T18:48:38.149761] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T18:48:38.417604] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-08T18:48:39.217551] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-08T18:48:40.001078] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:48:40.017491] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-08T18:48:40.477260] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T18:48:40.817534] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-08T18:48:41.013272] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T18:48:41.617608] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-08T18:48:42.417575] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-08T18:48:42.593423] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:48:42.857884] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T18:48:43.217565] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-08T18:48:43.442377] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T18:48:44.017607] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-08T18:48:44.660618] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T18:48:44.661932] [INFO ] [REMOTE ] ETO: Full fetch complete (9564 records). [2025-10-08T18:48:44.662005] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-08T18:48:44.837962] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-08T18:48:45.038125] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-08T18:48:45.038239] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-08T18:48:45.038559] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-08T18:48:45.038664] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-08T18:48:45.039368] [DEBUG] [LOCAL ] ETO: Trimmed 9564 records to 6764 (keeping 200 days of data) [2025-10-08T18:48:45.106853] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T18:48:45.122356] [DEBUG] [LOCAL ] ETO: Primary data saved (6764 records). [2025-10-08T18:48:45.122513] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-08T18:48:45.122607] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 33.3s. Estimated remaining: 3h 42m 7s. Rate: 7.2 symbols/min [2025-10-08T18:48:45.290423] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:45.316889] [DEBUG] [LOCAL ] ETW: Loaded 25336 existing records from primary storage. [2025-10-08T18:48:45.317172] [INFO ] [MAIN ] ETW: Loaded 25336 existing records. [2025-10-08T18:48:45.492495] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:45.492763] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-08T18:48:45.492816] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-08T18:48:45.493047] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-08T18:48:45.493105] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-08T18:48:45.622716] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-08T18:48:45.859794] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:45.873987] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T18:48:46.417567] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-08T18:48:47.217594] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-08T18:48:47.517559] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T18:48:47.787409] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T18:48:48.017591] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-08T18:48:48.817528] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-08T18:48:48.864423] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T18:48:49.617520] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-08T18:48:50.056226] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T18:48:50.093384] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-08T18:48:50.417560] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-08T18:48:51.132030] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T18:48:51.217522] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-08T18:48:51.519396] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:48:52.017554] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-08T18:48:52.817534] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-08T18:48:53.243723] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T18:48:53.297744] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T18:48:53.617699] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-08T18:48:54.345841] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T18:48:54.417504] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-08T18:48:55.217581] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-08T18:48:55.786263] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-08T18:48:55.790933] [INFO ] [REMOTE ] ETN: Full fetch complete (76535 records). [2025-10-08T18:48:55.791104] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-08T18:48:55.933074] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T18:48:55.962808] [INFO ] [REMOTE ] ETR: Full fetch complete (77098 records). [2025-10-08T18:48:56.006439] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-08T18:48:56.027725] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-08T18:48:56.332885] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:48:56.610332] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-08T18:48:56.622194] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-08T18:48:56.643221] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-08T18:48:56.646311] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-08T18:48:56.703301] [DEBUG] [LOCAL ] ETN: Trimmed 76535 records to 52702 (keeping 200 days of data) [2025-10-08T18:48:56.749708] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-08T18:48:56.749829] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-08T18:48:56.750878] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-08T18:48:56.828330] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-08T18:48:56.837233] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-08T18:48:56.870817] [DEBUG] [LOCAL ] ETR: Trimmed 77098 records to 53231 (keeping 200 days of data) [2025-10-08T18:48:57.036819] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T18:48:57.483514] [DEBUG] [LOCAL ] ETN: Primary data saved (52702 records). [2025-10-08T18:48:57.484630] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-08T18:48:57.485084] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 46.1s. Estimated remaining: 3h 42m 7s. Rate: 7.2 symbols/min [2025-10-08T18:48:57.535580] [DEBUG] [LOCAL ] ETR: Primary data saved (53231 records). [2025-10-08T18:48:57.558186] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-08T18:48:57.558330] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETR took 32.2s. Estimated remaining: 3h 41m 42s. Rate: 7.2 symbols/min [2025-10-08T18:48:57.630313] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-08T18:48:57.794556] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:57.856479] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:57.864469] [DEBUG] [LOCAL ] ETX: Loaded 5181 existing records from primary storage. [2025-10-08T18:48:57.864747] [INFO ] [MAIN ] ETX: Loaded 5181 existing records. [2025-10-08T18:48:57.995493] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:48:58.038518] [DEBUG] [LOCAL ] ETY: Loaded 23014 existing records from primary storage. [2025-10-08T18:48:58.058334] [INFO ] [MAIN ] ETY: Loaded 23014 existing records. [2025-10-08T18:48:58.126146] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:58.196427] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-08T18:48:58.213097] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-08T18:48:58.237287] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-08T18:48:58.253085] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-08T18:48:58.424353] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-08T18:48:58.445488] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:58.446537] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-08T18:48:58.446600] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-08T18:48:58.457925] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-08T18:48:58.468323] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-08T18:48:58.992505] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:59.097745] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:59.116970] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:48:59.217504] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-08T18:48:59.550740] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:49:00.017557] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-08T18:49:00.327927] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T18:49:00.817629] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-08T18:49:00.928118] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T18:49:01.617550] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-08T18:49:01.845329] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T18:49:02.417601] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-08T18:49:02.784230] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:49:03.217556] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-08T18:49:03.245075] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T18:49:04.017529] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-08T18:49:04.362144] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T18:49:04.655111] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T18:49:04.817684] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-08T18:49:05.617575] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-08T18:49:05.977477] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T18:49:06.151637] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T18:49:06.417548] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-08T18:49:07.217597] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-08T18:49:07.562516] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T18:49:07.565234] [INFO ] [REMOTE ] ETV: Full fetch complete (32287 records). [2025-10-08T18:49:07.565309] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-08T18:49:07.947394] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-08T18:49:07.947524] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-08T18:49:07.948116] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-08T18:49:07.948178] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-08T18:49:07.948959] [DEBUG] [LOCAL ] ETV: Trimmed 32287 records to 22112 (keeping 200 days of data) [2025-10-08T18:49:08.037088] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-08T18:49:08.090385] [DEBUG] [LOCAL ] ETV: Primary data saved (22112 records). [2025-10-08T18:49:08.090514] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-08T18:49:08.090611] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETV took 34.5s. Estimated remaining: 3h 41m 38s. Rate: 7.2 symbols/min [2025-10-08T18:49:08.269211] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:08.290056] [DEBUG] [LOCAL ] EVC: Loaded 18322 existing records from primary storage. [2025-10-08T18:49:08.290305] [INFO ] [MAIN ] EVC: Loaded 18322 existing records. [2025-10-08T18:49:08.410265] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T18:49:08.455827] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T18:49:08.539166] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:08.539483] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-08T18:49:08.539541] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-08T18:49:08.539919] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-08T18:49:08.539978] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-08T18:49:08.822711] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-08T18:49:08.890618] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:09.617550] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-08T18:49:10.117454] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T18:49:10.155070] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T18:49:10.417576] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-08T18:49:11.217551] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-08T18:49:11.894951] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T18:49:12.017561] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-08T18:49:12.523769] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:49:12.761288] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-08T18:49:12.817518] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-08T18:49:13.617562] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-08T18:49:13.872425] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T18:49:14.219091] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T18:49:14.417548] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-08T18:49:15.000413] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T18:49:15.217536] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-08T18:49:16.017509] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-08T18:49:16.096120] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T18:49:16.767634] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T18:49:16.817506] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-08T18:49:17.255804] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-08T18:49:17.617547] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-08T18:49:18.417549] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-08T18:49:18.784716] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:49:19.217503] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-08T18:49:19.602448] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T18:49:20.017513] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-08T18:49:20.308428] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T18:49:20.707268] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T18:49:20.817540] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-08T18:49:21.617542] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-08T18:49:21.873285] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T18:49:22.417558] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-08T18:49:22.875979] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T18:49:22.919437] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T18:49:23.217547] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-08T18:49:23.831785] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T18:49:24.017571] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-08T18:49:24.817512] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-08T18:49:24.906352] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T18:49:25.459706] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T18:49:25.460773] [INFO ] [REMOTE ] ETX: Full fetch complete (7011 records). [2025-10-08T18:49:25.460846] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-08T18:49:25.618791] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-08T18:49:25.842180] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-08T18:49:25.842264] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-08T18:49:25.842465] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-08T18:49:25.842505] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-08T18:49:25.842984] [DEBUG] [LOCAL ] ETX: Trimmed 7011 records to 5220 (keeping 200 days of data) [2025-10-08T18:49:25.877971] [DEBUG] [LOCAL ] ETX: Primary data saved (5220 records). [2025-10-08T18:49:25.878081] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-08T18:49:25.878163] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETX took 28.4s. Estimated remaining: 3h 41m 48s. Rate: 7.2 symbols/min [2025-10-08T18:49:26.055875] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:26.085761] [DEBUG] [LOCAL ] EVEX: Loaded 31180 existing records from primary storage. [2025-10-08T18:49:26.086052] [INFO ] [MAIN ] EVEX: Loaded 31180 existing records. [2025-10-08T18:49:26.271615] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:26.271875] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-08T18:49:26.271923] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-08T18:49:26.272918] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-08T18:49:26.272981] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-08T18:49:26.422699] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-08T18:49:26.655123] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:26.791667] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T18:49:26.794470] [INFO ] [REMOTE ] ETW: Full fetch complete (36666 records). [2025-10-08T18:49:26.794590] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-08T18:49:27.176326] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-08T18:49:27.176433] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-08T18:49:27.177084] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-08T18:49:27.177149] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-08T18:49:27.178234] [DEBUG] [LOCAL ] ETW: Trimmed 36666 records to 25426 (keeping 200 days of data) [2025-10-08T18:49:27.231556] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-08T18:49:27.341015] [DEBUG] [LOCAL ] ETW: Primary data saved (25426 records). [2025-10-08T18:49:27.341176] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-08T18:49:27.341268] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 42.2s. Estimated remaining: 3h 41m 26s. Rate: 7.2 symbols/min [2025-10-08T18:49:27.519776] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:27.532549] [DEBUG] [LOCAL ] EVF: Loaded 9610 existing records from primary storage. [2025-10-08T18:49:27.532849] [INFO ] [MAIN ] EVF: Loaded 9610 existing records. [2025-10-08T18:49:27.719741] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:27.729021] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-08T18:49:27.729104] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-08T18:49:27.730815] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-08T18:49:27.730729] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:49:27.731086] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-08T18:49:28.022735] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-08T18:49:28.114457] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:28.352212] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:49:28.817551] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-08T18:49:29.283048] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T18:49:29.617519] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-08T18:49:29.701178] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T18:49:30.417623] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-08T18:49:30.517168] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:49:30.520030] [INFO ] [REMOTE ] ETY: Full fetch complete (34349 records). [2025-10-08T18:49:30.520154] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-08T18:49:30.904532] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-08T18:49:30.904623] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-08T18:49:30.905307] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-08T18:49:30.905369] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-08T18:49:30.906137] [DEBUG] [LOCAL ] ETY: Trimmed 34349 records to 23084 (keeping 200 days of data) [2025-10-08T18:49:31.047449] [DEBUG] [LOCAL ] ETY: Primary data saved (23084 records). [2025-10-08T18:49:31.047584] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-08T18:49:31.047712] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETY took 33.5s. Estimated remaining: 3h 41m 8s. Rate: 7.2 symbols/min [2025-10-08T18:49:31.221159] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:31.218280] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-08T18:49:31.237018] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T18:49:31.248321] [DEBUG] [LOCAL ] EVG: Loaded 5964 existing records from primary storage. [2025-10-08T18:49:31.248742] [INFO ] [MAIN ] EVG: Loaded 5964 existing records. [2025-10-08T18:49:31.420980] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:31.421203] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-08T18:49:31.421250] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-08T18:49:31.421549] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-08T18:49:31.421608] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-08T18:49:31.773835] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:32.017505] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-08T18:49:32.030081] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T18:49:32.657799] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T18:49:32.817627] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-08T18:49:33.527865] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T18:49:33.617567] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-08T18:49:34.369997] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T18:49:34.417589] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-08T18:49:35.068539] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T18:49:35.217530] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-08T18:49:35.942768] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T18:49:36.017521] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-08T18:49:36.736576] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T18:49:36.817555] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-08T18:49:37.413609] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:49:37.617575] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-08T18:49:38.277809] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T18:49:38.417540] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-08T18:49:39.122910] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T18:49:39.217498] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-08T18:49:39.881026] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T18:49:39.882458] [INFO ] [REMOTE ] EVC: Full fetch complete (29462 records). [2025-10-08T18:49:39.882530] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-08T18:49:40.022705] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-08T18:49:40.256293] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-08T18:49:40.256370] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-08T18:49:40.256903] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-08T18:49:40.256965] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-08T18:49:40.257638] [DEBUG] [LOCAL ] EVC: Trimmed 29462 records to 18236 (keeping 200 days of data) [2025-10-08T18:49:40.367497] [DEBUG] [LOCAL ] EVC: Primary data saved (18236 records). [2025-10-08T18:49:40.367664] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-08T18:49:40.367783] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 32.3s. Estimated remaining: 3h 41m 2s. Rate: 7.2 symbols/min [2025-10-08T18:49:40.541736] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:40.587268] [DEBUG] [LOCAL ] EVH: Loaded 49492 existing records from primary storage. [2025-10-08T18:49:40.587629] [INFO ] [MAIN ] EVH: Loaded 49492 existing records. [2025-10-08T18:49:40.671155] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T18:49:40.780596] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:40.780834] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-08T18:49:40.780880] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-08T18:49:40.782154] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-08T18:49:40.782214] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-08T18:49:40.822676] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-08T18:49:41.140694] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:41.600820] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T18:49:41.617488] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-08T18:49:42.286315] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T18:49:42.417527] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-08T18:49:43.217546] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-08T18:49:43.806073] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T18:49:44.017505] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-08T18:49:44.348553] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T18:49:44.552250] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T18:49:44.817603] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-08T18:49:45.278389] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-08T18:49:45.617559] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-08T18:49:46.417570] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-08T18:49:47.223522] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-08T18:49:47.241523] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T18:49:47.282397] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T18:49:47.284781] [INFO ] [REMOTE ] EVF: Full fetch complete (12617 records). [2025-10-08T18:49:47.284866] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-08T18:49:47.643055] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-08T18:49:47.643133] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-08T18:49:47.643483] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-08T18:49:47.643519] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-08T18:49:47.644025] [DEBUG] [LOCAL ] EVF: Trimmed 12617 records to 9735 (keeping 200 days of data) [2025-10-08T18:49:47.702193] [DEBUG] [LOCAL ] EVF: Primary data saved (9735 records). [2025-10-08T18:49:47.702316] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-08T18:49:47.702397] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVF took 20.4s. Estimated remaining: 3h 40m 51s. Rate: 7.2 symbols/min [2025-10-08T18:49:47.877542] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:47.882631] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-08T18:49:47.894312] [DEBUG] [LOCAL ] EVN: Loaded 11046 existing records from primary storage. [2025-10-08T18:49:47.894498] [INFO ] [MAIN ] EVN: Loaded 11046 existing records. [2025-10-08T18:49:48.022703] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-08T18:49:48.075192] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:48.075353] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-08T18:49:48.075398] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-08T18:49:48.075918] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-08T18:49:48.075977] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-08T18:49:48.423003] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:48.709942] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T18:49:48.817515] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-08T18:49:49.617602] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-08T18:49:50.296767] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T18:49:50.417542] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-08T18:49:50.590639] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T18:49:51.217592] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-08T18:49:51.745608] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T18:49:52.017536] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-08T18:49:52.193024] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T18:49:52.817517] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-08T18:49:53.387610] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:49:53.617565] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-08T18:49:53.890026] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T18:49:54.114242] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-08T18:49:54.417636] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-08T18:49:55.217525] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-08T18:49:55.299599] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:49:55.912038] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T18:49:56.017563] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-08T18:49:56.817709] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-08T18:49:57.263259] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T18:49:57.617574] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-08T18:49:57.804884] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T18:49:58.417614] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-08T18:49:59.149432] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T18:49:59.217571] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-08T18:49:59.316421] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T18:49:59.579555] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-08T18:50:00.017558] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-08T18:50:00.817609] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-08T18:50:01.309198] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T18:50:01.617616] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-08T18:50:01.981547] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:50:02.417578] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-08T18:50:02.763894] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T18:50:03.217550] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-08T18:50:03.947278] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T18:50:04.017554] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-08T18:50:04.082953] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T18:50:04.762725] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T18:50:04.817565] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-08T18:50:05.617551] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-08T18:50:06.201403] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T18:50:06.202919] [INFO ] [REMOTE ] EVG: Full fetch complete (8247 records). [2025-10-08T18:50:06.203038] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-08T18:50:06.418408] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-08T18:50:06.653888] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-08T18:50:06.660204] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-08T18:50:06.672243] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-08T18:50:06.673149] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-08T18:50:06.674281] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T18:50:06.686916] [DEBUG] [LOCAL ] EVG: Trimmed 8247 records to 5983 (keeping 200 days of data) [2025-10-08T18:50:06.731050] [DEBUG] [LOCAL ] EVG: Primary data saved (5983 records). [2025-10-08T18:50:06.731264] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-08T18:50:06.731390] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVG took 35.7s. Estimated remaining: 3h 41m 4s. Rate: 7.2 symbols/min [2025-10-08T18:50:06.938947] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:06.989811] [DEBUG] [LOCAL ] EVR: Loaded 34643 existing records from primary storage. [2025-10-08T18:50:06.990294] [INFO ] [MAIN ] EVR: Loaded 34643 existing records. [2025-10-08T18:50:07.199815] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:07.200275] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-08T18:50:07.200349] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-08T18:50:07.201747] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-08T18:50:07.201808] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-08T18:50:07.223607] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-08T18:50:07.565192] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T18:50:07.601427] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:07.880735] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T18:50:08.017534] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-08T18:50:08.817595] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-08T18:50:09.297816] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T18:50:09.617547] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-08T18:50:10.348722] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T18:50:10.417502] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-08T18:50:10.709272] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T18:50:11.217554] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-08T18:50:11.856987] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T18:50:12.017538] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-08T18:50:12.595115] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T18:50:12.817520] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-08T18:50:13.048009] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:50:13.617607] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-08T18:50:14.116289] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T18:50:14.417550] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-08T18:50:15.217623] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-08T18:50:15.377801] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T18:50:15.985730] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T18:50:16.017501] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-08T18:50:16.626359] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T18:50:16.817559] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-08T18:50:17.617548] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-08T18:50:18.017142] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T18:50:18.219211] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T18:50:18.222899] [INFO ] [REMOTE ] EVEX: Full fetch complete (42685 records). [2025-10-08T18:50:18.222999] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-08T18:50:18.426375] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-08T18:50:18.662481] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-08T18:50:18.662561] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-08T18:50:18.663195] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-08T18:50:18.663256] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-08T18:50:18.664183] [DEBUG] [LOCAL ] EVEX: Trimmed 42685 records to 31368 (keeping 200 days of data) [2025-10-08T18:50:18.842265] [DEBUG] [LOCAL ] EVEX: Primary data saved (31368 records). [2025-10-08T18:50:18.842397] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-08T18:50:18.842496] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVEX took 53.0s. Estimated remaining: 3h 41m 4s. Rate: 7.2 symbols/min [2025-10-08T18:50:19.019782] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:19.037737] [DEBUG] [LOCAL ] EVT: Loaded 16888 existing records from primary storage. [2025-10-08T18:50:19.037984] [INFO ] [MAIN ] EVT: Loaded 16888 existing records. [2025-10-08T18:50:19.173676] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T18:50:19.243359] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-08T18:50:19.209917] [INFO ] [REMOTE ] EVH: Full fetch complete (71770 records). [2025-10-08T18:50:19.248796] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-08T18:50:19.250974] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:19.251311] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-08T18:50:19.251414] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-08T18:50:19.267900] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-08T18:50:19.290957] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-08T18:50:19.591889] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T18:50:20.006342] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-08T18:50:20.024313] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-08T18:50:20.039773] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-08T18:50:20.045417] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:20.039882] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-08T18:50:20.024227] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-08T18:50:20.047477] [DEBUG] [LOCAL ] EVH: Trimmed 71770 records to 49565 (keeping 200 days of data) [2025-10-08T18:50:20.337686] [DEBUG] [LOCAL ] EVH: Primary data saved (49565 records). [2025-10-08T18:50:20.337914] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-08T18:50:20.338048] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVH took 40.0s. Estimated remaining: 3h 40m 41s. Rate: 7.2 symbols/min [2025-10-08T18:50:20.514712] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:20.545104] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T18:50:20.576477] [DEBUG] [LOCAL ] EVTC: Loaded 26406 existing records from primary storage. [2025-10-08T18:50:20.576803] [INFO ] [MAIN ] EVTC: Loaded 26406 existing records. [2025-10-08T18:50:20.754185] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:20.754391] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-08T18:50:20.754438] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-08T18:50:20.755357] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-08T18:50:20.755454] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-08T18:50:20.818275] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-08T18:50:21.056105] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T18:50:21.137983] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:21.617567] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-08T18:50:22.130358] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T18:50:22.417518] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-08T18:50:22.796930] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T18:50:23.179748] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:50:23.217544] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-08T18:50:24.017557] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-08T18:50:24.225444] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T18:50:24.817569] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-08T18:50:25.206448] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:50:25.617549] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-08T18:50:26.257782] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T18:50:26.417514] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-08T18:50:26.554546] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T18:50:27.217530] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-08T18:50:27.719329] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:50:28.017701] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-08T18:50:28.223319] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T18:50:28.817604] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-08T18:50:28.873260] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T18:50:28.874853] [INFO ] [REMOTE ] EVN: Full fetch complete (17733 records). [2025-10-08T18:50:28.874927] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-08T18:50:29.240292] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-08T18:50:29.240372] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-08T18:50:29.240758] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-08T18:50:29.240818] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-08T18:50:29.241319] [DEBUG] [LOCAL ] EVN: Trimmed 17733 records to 11115 (keeping 200 days of data) [2025-10-08T18:50:29.306565] [DEBUG] [LOCAL ] EVN: Primary data saved (11115 records). [2025-10-08T18:50:29.306723] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-08T18:50:29.306819] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVN took 41.6s. Estimated remaining: 3h 40m 34s. Rate: 7.2 symbols/min [2025-10-08T18:50:29.472949] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:29.510294] [DEBUG] [LOCAL ] EVTL: Loaded 38975 existing records from primary storage. [2025-10-08T18:50:29.510586] [INFO ] [MAIN ] EVTL: Loaded 38975 existing records. [2025-10-08T18:50:29.622786] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-08T18:50:29.689586] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:29.689823] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-08T18:50:29.689892] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-08T18:50:29.690954] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-08T18:50:29.691016] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-08T18:50:30.098399] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:30.114930] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:50:30.417552] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-08T18:50:30.767783] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T18:50:31.217548] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-08T18:50:31.284252] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T18:50:32.017561] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-08T18:50:32.240113] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T18:50:32.817574] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-08T18:50:33.345478] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T18:50:33.617513] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-08T18:50:33.855015] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T18:50:34.417575] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-08T18:50:34.764138] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:50:35.217540] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-08T18:50:35.343011] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T18:50:36.017504] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-08T18:50:36.326969] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T18:50:36.330412] [INFO ] [REMOTE ] EVR: Full fetch complete (50638 records). [2025-10-08T18:50:36.330577] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-08T18:50:36.724184] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-08T18:50:36.724273] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-08T18:50:36.724968] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-08T18:50:36.725029] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-08T18:50:36.726057] [DEBUG] [LOCAL ] EVR: Trimmed 50638 records to 34583 (keeping 200 days of data) [2025-10-08T18:50:36.817591] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-08T18:50:36.946404] [DEBUG] [LOCAL ] EVR: Primary data saved (34583 records). [2025-10-08T18:50:36.946564] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-08T18:50:36.946690] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 30.2s. Estimated remaining: 3h 40m 24s. Rate: 7.2 symbols/min [2025-10-08T18:50:37.149701] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:37.173888] [DEBUG] [LOCAL ] EVTR: Loaded 24189 existing records from primary storage. [2025-10-08T18:50:37.174152] [INFO ] [MAIN ] EVTR: Loaded 24189 existing records. [2025-10-08T18:50:37.358276] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:37.358584] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-08T18:50:37.358638] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-08T18:50:37.358915] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-08T18:50:37.358973] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-08T18:50:37.636249] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-08T18:50:37.667524] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:50:37.756086] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:37.858512] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T18:50:38.417575] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-08T18:50:39.058581] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T18:50:39.135429] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:50:39.217582] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-08T18:50:40.017516] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-08T18:50:40.160420] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T18:50:40.817579] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-08T18:50:40.988831] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T18:50:41.617583] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-08T18:50:42.005332] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T18:50:42.417638] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-08T18:50:43.191835] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T18:50:43.217505] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-08T18:50:43.370052] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T18:50:43.371815] [INFO ] [REMOTE ] EVT: Full fetch complete (25237 records). [2025-10-08T18:50:43.371911] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-08T18:50:43.744691] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-08T18:50:43.744786] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-08T18:50:43.745341] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-08T18:50:43.745410] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-08T18:50:43.746206] [DEBUG] [LOCAL ] EVT: Trimmed 25237 records to 16893 (keeping 200 days of data) [2025-10-08T18:50:43.852707] [DEBUG] [LOCAL ] EVT: Primary data saved (16893 records). [2025-10-08T18:50:43.852879] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-08T18:50:43.852968] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 25.0s. Estimated remaining: 3h 40m 13s. Rate: 7.2 symbols/min [2025-10-08T18:50:44.020976] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:44.021048] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-08T18:50:44.074119] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-08T18:50:44.074463] [INFO ] [MAIN ] EW: Loaded 53402 existing records. [2025-10-08T18:50:44.265803] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:44.266144] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-08T18:50:44.271477] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-08T18:50:44.279790] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T18:50:44.281560] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-08T18:50:44.285032] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-08T18:50:44.638488] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:44.817552] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-08T18:50:44.979848] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T18:50:45.617598] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-08T18:50:46.360492] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:50:46.417549] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-08T18:50:46.613563] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T18:50:47.217517] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-08T18:50:47.775737] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:50:47.933320] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:50:48.017578] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-08T18:50:48.817552] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-08T18:50:49.182686] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T18:50:49.617590] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-08T18:50:50.431134] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-08T18:50:50.463985] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:50:50.603639] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T18:50:51.217599] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-08T18:50:51.557924] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T18:50:52.017558] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-08T18:50:52.817527] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-08T18:50:53.008129] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T18:50:53.060960] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T18:50:53.617605] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-08T18:50:54.027153] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:50:54.029737] [INFO ] [REMOTE ] EVTC: Full fetch complete (38134 records). [2025-10-08T18:50:54.029820] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-08T18:50:54.404123] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-08T18:50:54.404271] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-08T18:50:54.404910] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-08T18:50:54.404973] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-08T18:50:54.406040] [DEBUG] [LOCAL ] EVTC: Trimmed 38134 records to 26384 (keeping 200 days of data) [2025-10-08T18:50:54.459106] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-08T18:50:54.571867] [DEBUG] [LOCAL ] EVTC: Primary data saved (26384 records). [2025-10-08T18:50:54.572744] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-08T18:50:54.572868] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 34.2s. Estimated remaining: 3h 40m 9s. Rate: 7.2 symbols/min [2025-10-08T18:50:54.707438] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T18:50:54.768447] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:54.803264] [DEBUG] [LOCAL ] EXG: Loaded 34226 existing records from primary storage. [2025-10-08T18:50:54.803598] [INFO ] [MAIN ] EXG: Loaded 34226 existing records. [2025-10-08T18:50:54.980503] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:54.980801] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-08T18:50:54.980871] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-08T18:50:54.982071] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-08T18:50:54.982136] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-08T18:50:55.230553] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-08T18:50:55.349268] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:56.026009] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-08T18:50:56.033158] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T18:50:56.549786] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T18:50:56.817578] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-08T18:50:57.347313] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:50:57.617601] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-08T18:50:58.210608] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:50:58.417596] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-08T18:50:58.796039] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T18:50:59.217519] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-08T18:50:59.509240] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T18:51:00.017587] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-08T18:51:00.817554] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-08T18:51:01.276100] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T18:51:01.326554] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T18:51:01.617593] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-08T18:51:02.417547] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-08T18:51:02.523227] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T18:51:02.834792] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T18:51:03.217628] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-08T18:51:04.017600] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-08T18:51:04.439271] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T18:51:04.662552] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:51:04.817526] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-08T18:51:05.133091] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T18:51:05.617561] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-08T18:51:06.325823] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:51:06.417523] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-08T18:51:07.115048] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T18:51:07.217606] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-08T18:51:07.800920] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T18:51:08.017568] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-08T18:51:08.583006] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:51:08.817621] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-08T18:51:09.617593] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-08T18:51:09.930877] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:51:10.266279] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T18:51:10.417575] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-08T18:51:11.142459] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T18:51:11.217526] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-08T18:51:12.017568] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-08T18:51:12.239322] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T18:51:12.617411] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T18:51:12.817631] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-08T18:51:12.980275] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:51:12.982927] [INFO ] [REMOTE ] EVTR: Full fetch complete (32859 records). [2025-10-08T18:51:12.983003] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-08T18:51:13.373614] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-08T18:51:13.373750] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-08T18:51:13.374374] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-08T18:51:13.374417] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-08T18:51:13.375217] [DEBUG] [LOCAL ] EVTR: Trimmed 32859 records to 24255 (keeping 200 days of data) [2025-10-08T18:51:13.523619] [DEBUG] [LOCAL ] EVTR: Primary data saved (24255 records). [2025-10-08T18:51:13.523792] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-08T18:51:13.523885] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTR took 36.6s. Estimated remaining: 3h 40m 22s. Rate: 7.2 symbols/min [2025-10-08T18:51:13.627155] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-08T18:51:13.705154] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:13.757237] [DEBUG] [LOCAL ] EXK: Loaded 53139 existing records from primary storage. [2025-10-08T18:51:13.757618] [INFO ] [MAIN ] EXK: Loaded 53139 existing records. [2025-10-08T18:51:13.950880] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:13.951106] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-08T18:51:13.951154] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-08T18:51:13.952423] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-08T18:51:13.952488] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-08T18:51:14.333595] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:14.422693] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-08T18:51:14.428731] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T18:51:14.433311] [INFO ] [REMOTE ] EW: Full fetch complete (77353 records). [2025-10-08T18:51:14.433453] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-08T18:51:14.846089] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-08T18:51:14.846310] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-08T18:51:14.847357] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-08T18:51:14.847480] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-08T18:51:14.866507] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:51:14.874180] [DEBUG] [LOCAL ] EW: Trimmed 77353 records to 53402 (keeping 200 days of data) [2025-10-08T18:51:15.209842] [DEBUG] [LOCAL ] EW: Primary data saved (53402 records). [2025-10-08T18:51:15.210027] [INFO ] [MAIN ] EW: Full history saved. [2025-10-08T18:51:15.210133] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EW took 31.4s. Estimated remaining: 3h 40m 0s. Rate: 7.2 symbols/min [2025-10-08T18:51:15.222779] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-08T18:51:15.393594] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:15.421589] [DEBUG] [LOCAL ] EXP: Loaded 29608 existing records from primary storage. [2025-10-08T18:51:15.421930] [INFO ] [MAIN ] EXP: Loaded 29608 existing records. [2025-10-08T18:51:15.603532] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:15.603852] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-08T18:51:15.603906] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-08T18:51:15.604997] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-08T18:51:15.605082] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-08T18:51:15.962789] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:16.017516] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-08T18:51:16.428769] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T18:51:16.817567] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-08T18:51:16.936606] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T18:51:17.068133] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T18:51:17.617502] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-08T18:51:17.744719] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T18:51:18.417575] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-08T18:51:19.217534] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-08T18:51:19.289693] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T18:51:19.721679] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T18:51:20.017547] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-08T18:51:20.809778] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T18:51:20.819972] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-08T18:51:21.363891] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:51:21.617506] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-08T18:51:21.937666] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T18:51:21.941814] [INFO ] [REMOTE ] EXG: Full fetch complete (49854 records). [2025-10-08T18:51:21.942008] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-08T18:51:22.328951] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-08T18:51:22.329039] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-08T18:51:22.329760] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-08T18:51:22.329825] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-08T18:51:22.330900] [DEBUG] [LOCAL ] EXG: Trimmed 49854 records to 34256 (keeping 200 days of data) [2025-10-08T18:51:22.424766] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-08T18:51:22.569343] [DEBUG] [LOCAL ] EXG: Primary data saved (34256 records). [2025-10-08T18:51:22.569502] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-08T18:51:22.569592] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EXG took 28.0s. Estimated remaining: 3h 39m 50s. Rate: 7.2 symbols/min [2025-10-08T18:51:23.217565] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-08T18:51:23.553767] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T18:51:23.560261] [INFO ] [REMOTE ] EVTL: Full fetch complete (53270 records). [2025-10-08T18:51:23.560458] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-08T18:51:23.932686] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T18:51:24.023594] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-08T18:51:24.069849] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-08T18:51:24.069939] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-08T18:51:24.070839] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-08T18:51:24.070906] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-08T18:51:24.072173] [DEBUG] [LOCAL ] EVTL: Trimmed 53270 records to 39239 (keeping 200 days of data) [2025-10-08T18:51:24.299285] [DEBUG] [LOCAL ] EVTL: Primary data saved (39239 records). [2025-10-08T18:51:24.299672] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-08T18:51:24.299780] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EVTL took 55.0s. Estimated remaining: 3h 39m 28s. Rate: 7.2 symbols/min [2025-10-08T18:51:24.614231] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:51:24.817617] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-08T18:51:25.200429] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T18:51:25.617567] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-08T18:51:26.646082] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T18:51:26.657548] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-08T18:51:26.726329] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T18:51:27.217741] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-08T18:51:28.537994] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T18:51:28.545292] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-08T18:51:28.630075] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T18:51:28.817620] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-08T18:51:29.947602] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T18:51:29.958741] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-08T18:51:30.699045] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:51:30.710617] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-08T18:51:31.307010] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:51:31.313860] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-08T18:51:32.205393] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:51:32.216810] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-08T18:51:32.753686] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T18:51:32.817502] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-08T18:51:33.872830] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:51:33.884626] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-08T18:51:34.042339] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T18:51:34.044700] [INFO ] [REMOTE ] EXP: Full fetch complete (42860 records). [2025-10-08T18:51:34.044819] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-08T18:51:34.447294] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-08T18:51:34.447383] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-08T18:51:34.448033] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-08T18:51:34.448098] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-08T18:51:34.452072] [DEBUG] [LOCAL ] EXP: Trimmed 42860 records to 29620 (keeping 200 days of data) [2025-10-08T18:51:34.646857] [DEBUG] [LOCAL ] EXP: Primary data saved (29620 records). [2025-10-08T18:51:34.647018] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-08T18:51:34.647102] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXP took 19.4s. Estimated remaining: 3h 39m 24s. Rate: 7.2 symbols/min [2025-10-08T18:51:35.811932] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T18:51:35.824198] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-08T18:51:37.585095] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T18:51:37.599512] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-08T18:51:39.588319] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-08T18:51:39.593532] [INFO ] [REMOTE ] EXK: Full fetch complete (76569 records). [2025-10-08T18:51:39.593713] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-08T18:51:40.002896] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-08T18:51:40.003000] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-08T18:51:40.003945] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-08T18:51:40.004012] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-08T18:51:40.005549] [DEBUG] [LOCAL ] EXK: Trimmed 76569 records to 53142 (keeping 200 days of data) [2025-10-08T18:51:40.321570] [DEBUG] [LOCAL ] EXK: Primary data saved (53142 records). [2025-10-08T18:51:40.321778] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-08T18:51:40.321946] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXK took 26.8s. Estimated remaining: 3h 39m 10s. Rate: 7.2 symbols/min [2025-10-08T18:51:41.061389] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:41.081333] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:41.111928] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:41.087573] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:41.239959] [DEBUG] [LOCAL ] EXPD: Loaded 47815 existing records from primary storage. [2025-10-08T18:51:41.239231] [DEBUG] [LOCAL ] EXR: Loaded 45261 existing records from primary storage. [2025-10-08T18:51:41.241215] [INFO ] [MAIN ] EXPD: Loaded 47815 existing records. [2025-10-08T18:51:41.240618] [DEBUG] [LOCAL ] FAF: Loaded 41605 existing records from primary storage. [2025-10-08T18:51:41.241561] [INFO ] [MAIN ] EXR: Loaded 45261 existing records. [2025-10-08T18:51:41.238400] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-08T18:51:41.252748] [INFO ] [MAIN ] FAF: Loaded 41605 existing records. [2025-10-08T18:51:41.268196] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-08T18:51:41.834609] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:41.893021] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:41.933585] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-08T18:51:41.941734] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-08T18:51:41.976684] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-08T18:51:42.013728] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-08T18:51:42.013617] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:42.013900] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-08T18:51:42.029434] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-08T18:51:42.029368] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-08T18:51:42.040515] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-08T18:51:42.040442] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-08T18:51:42.076954] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-08T18:51:42.089622] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-08T18:51:42.055966] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:42.103948] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-08T18:51:42.135987] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-08T18:51:42.176792] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-08T18:51:42.267731] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-08T18:51:42.308325] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-08T18:51:43.427312] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:43.441337] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:43.475807] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-08T18:51:43.475400] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-08T18:51:43.511437] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:43.538924] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-08T18:51:43.595209] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:43.595521] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-08T18:51:44.881457] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:51:44.889208] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-08T18:51:44.970930] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T18:51:44.979839] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-08T18:51:45.201971] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T18:51:45.211299] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-08T18:51:46.059735] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:51:46.067730] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-08T18:51:46.126946] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-08T18:51:46.138260] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-08T18:51:46.501308] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T18:51:46.510816] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-08T18:51:46.940182] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:51:46.949600] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-08T18:51:47.322719] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T18:51:47.330064] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-08T18:51:47.679200] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T18:51:47.687949] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-08T18:51:48.212146] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:51:48.221431] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-08T18:51:48.414792] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-08T18:51:48.428304] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-08T18:51:48.800086] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T18:51:48.809347] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-08T18:51:48.911552] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T18:51:48.921811] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-08T18:51:49.589591] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:51:49.617505] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-08T18:51:50.107046] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T18:51:50.417518] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-08T18:51:50.560529] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-08T18:51:50.721552] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T18:51:51.217559] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-08T18:51:51.329406] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T18:51:51.827847] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T18:51:52.017557] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-08T18:51:52.485084] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T18:51:52.817599] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-08T18:51:53.437146] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T18:51:53.617567] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-08T18:51:54.417572] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-08T18:51:54.631213] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T18:51:54.822909] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T18:51:55.217574] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-08T18:51:55.660042] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:51:56.017559] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-08T18:51:56.817571] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-08T18:51:56.888779] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T18:51:57.617571] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-08T18:51:58.192262] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:51:58.417510] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-08T18:51:58.577032] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-08T18:51:58.819779] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T18:51:59.217613] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-08T18:51:59.803117] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:52:00.017625] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-08T18:52:00.736705] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T18:52:00.817620] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-08T18:52:01.016038] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T18:52:01.019288] [INFO ] [REMOTE ] FAF: Full fetch complete (57748 records). [2025-10-08T18:52:01.019452] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-08T18:52:01.442067] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-08T18:52:01.442163] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-08T18:52:01.442954] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-08T18:52:01.443020] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-08T18:52:01.444359] [DEBUG] [LOCAL ] FAF: Trimmed 57748 records to 41546 (keeping 200 days of data) [2025-10-08T18:52:01.629010] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-08T18:52:01.719287] [DEBUG] [LOCAL ] FAF: Primary data saved (41546 records). [2025-10-08T18:52:01.719475] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-08T18:52:01.719626] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FAF took 21.4s. Estimated remaining: 3h 39m 27s. Rate: 7.2 symbols/min [2025-10-08T18:52:01.896234] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:01.942208] [DEBUG] [LOCAL ] FBIN: Loaded 50405 existing records from primary storage. [2025-10-08T18:52:01.942558] [INFO ] [MAIN ] FBIN: Loaded 50405 existing records. [2025-10-08T18:52:02.151527] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:02.151892] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-08T18:52:02.151964] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-08T18:52:02.153451] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-08T18:52:02.153533] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-08T18:52:02.419284] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-08T18:52:02.591120] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:02.619077] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T18:52:03.217551] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-08T18:52:04.017524] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-08T18:52:04.140296] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-08T18:52:04.193346] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T18:52:04.817525] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-08T18:52:04.925726] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:52:05.173584] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:52:05.617600] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-08T18:52:06.417598] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-08T18:52:07.217535] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-08T18:52:07.368527] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T18:52:07.715884] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T18:52:08.017585] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-08T18:52:08.083881] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-10-08T18:52:08.426874] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:52:08.431207] [INFO ] [REMOTE ] EXR: Full fetch complete (65951 records). [2025-10-08T18:52:08.431389] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-08T18:52:08.830770] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-08T18:52:08.886697] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-08T18:52:08.886793] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-08T18:52:08.887861] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-08T18:52:08.887925] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-08T18:52:08.889212] [DEBUG] [LOCAL ] EXR: Trimmed 65951 records to 45251 (keeping 200 days of data) [2025-10-08T18:52:09.168216] [DEBUG] [LOCAL ] EXR: Primary data saved (45251 records). [2025-10-08T18:52:09.168351] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-08T18:52:09.168437] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXR took 28.8s. Estimated remaining: 3h 39m 17s. Rate: 7.2 symbols/min [2025-10-08T18:52:09.338966] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:09.364976] [DEBUG] [LOCAL ] FBK: Loaded 26609 existing records from primary storage. [2025-10-08T18:52:09.365266] [INFO ] [MAIN ] FBK: Loaded 26609 existing records. [2025-10-08T18:52:09.543468] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:09.543801] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-08T18:52:09.543916] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-08T18:52:09.544959] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-08T18:52:09.545023] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-08T18:52:09.635308] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-08T18:52:09.854914] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-08T18:52:09.943677] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:10.362852] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:52:10.366412] [INFO ] [REMOTE ] EXPD: Full fetch complete (69280 records). [2025-10-08T18:52:10.366561] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-08T18:52:10.429377] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-08T18:52:10.761339] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-08T18:52:10.761429] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-08T18:52:10.762386] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-08T18:52:10.762449] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-08T18:52:10.763802] [DEBUG] [LOCAL ] EXPD: Trimmed 69280 records to 47841 (keeping 200 days of data) [2025-10-08T18:52:11.058639] [DEBUG] [LOCAL ] EXPD: Primary data saved (47841 records). [2025-10-08T18:52:11.058807] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-08T18:52:11.058914] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXPD took 30.7s. Estimated remaining: 3h 38m 56s. Rate: 7.2 symbols/min [2025-10-08T18:52:11.219109] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-08T18:52:11.237307] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:11.248209] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T18:52:11.290963] [DEBUG] [LOCAL ] FBP: Loaded 45850 existing records from primary storage. [2025-10-08T18:52:11.291307] [INFO ] [MAIN ] FBP: Loaded 45850 existing records. [2025-10-08T18:52:11.475007] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:11.475202] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-08T18:52:11.475264] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-08T18:52:11.476615] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-08T18:52:11.476699] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-08T18:52:11.846429] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:11.888361] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-08T18:52:12.017540] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-08T18:52:12.824082] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-08T18:52:12.850481] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:52:12.874486] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T18:52:13.617543] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-08T18:52:14.417521] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-08T18:52:14.625523] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T18:52:15.207573] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-08T18:52:15.220392] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-08T18:52:16.017545] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-08T18:52:16.052890] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T18:52:16.677517] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T18:52:16.817584] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-08T18:52:17.141621] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T18:52:17.617576] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-08T18:52:18.417592] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-08T18:52:19.189780] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:52:19.217808] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-08T18:52:19.234549] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-08T18:52:19.265590] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T18:52:20.017551] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-08T18:52:20.817557] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-08T18:52:20.956580] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T18:52:21.005791] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T18:52:21.617551] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-08T18:52:22.338435] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T18:52:22.417507] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-08T18:52:22.485609] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T18:52:23.217593] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-08T18:52:23.711033] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T18:52:24.017551] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-08T18:52:24.367731] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T18:52:24.817594] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-08T18:52:25.617548] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-08T18:52:25.673068] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:52:26.151744] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T18:52:26.417587] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-08T18:52:27.217611] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-08T18:52:27.676543] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T18:52:27.975428] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T18:52:28.017504] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-08T18:52:28.826263] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-08T18:52:28.831958] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T18:52:29.273593] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T18:52:29.590226] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T18:52:29.617526] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-08T18:52:30.417615] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-08T18:52:31.126933] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:52:31.217558] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-08T18:52:31.571926] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T18:52:32.017555] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-08T18:52:32.817557] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-08T18:52:32.888003] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T18:52:33.617593] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-08T18:52:33.692820] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T18:52:34.417570] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-08T18:52:34.914459] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:52:35.224729] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-08T18:52:35.229321] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-08T18:52:35.234119] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-08T18:52:35.234246] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-08T18:52:35.670283] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-08T18:52:35.670377] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-08T18:52:35.671343] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-08T18:52:35.671416] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-08T18:52:35.672981] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-08T18:52:35.799283] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T18:52:35.804736] [INFO ] [REMOTE ] FBIN: Full fetch complete (72745 records). [2025-10-08T18:52:35.805696] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-08T18:52:36.019973] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-08T18:52:36.365789] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-08T18:52:36.366572] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-08T18:52:36.367809] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-08T18:52:36.367903] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-08T18:52:36.382862] [DEBUG] [LOCAL ] FBIN: Trimmed 72745 records to 50379 (keeping 200 days of data) [2025-10-08T18:52:36.598408] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-08T18:52:36.600139] [INFO ] [MAIN ] F: Full history saved. [2025-10-08T18:52:36.600889] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 56.3s. Estimated remaining: 3h 39m 21s. Rate: 7.1 symbols/min [2025-10-08T18:52:36.800031] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:52:36.841074] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:36.856904] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-08T18:52:37.003058] [DEBUG] [LOCAL ] FBRT: Loaded 35007 existing records from primary storage. [2025-10-08T18:52:37.005027] [INFO ] [MAIN ] FBRT: Loaded 35007 existing records. [2025-10-08T18:52:37.213449] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:37.221546] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-08T18:52:37.221928] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-08T18:52:37.226017] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-08T18:52:37.226462] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:52:37.226582] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-08T18:52:37.268948] [INFO ] [REMOTE ] FBK: Full fetch complete (34193 records). [2025-10-08T18:52:37.302622] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-08T18:52:37.975925] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:37.988362] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-08T18:52:38.119024] [DEBUG] [LOCAL ] FBIN: Primary data saved (50379 records). [2025-10-08T18:52:38.149144] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-08T18:52:38.162842] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBIN took 36.4s. Estimated remaining: 3h 38m 59s. Rate: 7.2 symbols/min [2025-10-08T18:52:38.188297] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-08T18:52:38.222350] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-08T18:52:38.232618] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-08T18:52:38.238248] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-08T18:52:38.287559] [DEBUG] [LOCAL ] FBK: Trimmed 34193 records to 26718 (keeping 200 days of data) [2025-10-08T18:52:38.357202] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:38.457212] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T18:52:38.466287] [INFO ] [REMOTE ] FBP: Full fetch complete (66424 records). [2025-10-08T18:52:38.467261] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-08T18:52:38.480598] [DEBUG] [LOCAL ] FC: Loaded 15301 existing records from primary storage. [2025-10-08T18:52:38.508342] [INFO ] [MAIN ] FC: Loaded 15301 existing records. [2025-10-08T18:52:38.887506] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:38.910045] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-08T18:52:38.915515] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-08T18:52:38.951630] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-08T18:52:38.964926] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-08T18:52:39.218328] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-08T18:52:39.218849] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-08T18:52:39.244202] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-08T18:52:39.267139] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-08T18:52:39.362063] [DEBUG] [LOCAL ] FBP: Trimmed 66424 records to 45763 (keeping 200 days of data) [2025-10-08T18:52:39.583440] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:39.600308] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-08T18:52:39.633539] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T18:52:39.645209] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-08T18:52:39.681052] [DEBUG] [LOCAL ] FBK: Primary data saved (26718 records). [2025-10-08T18:52:39.683437] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-08T18:52:39.683599] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBK took 30.5s. Estimated remaining: 3h 38m 38s. Rate: 7.2 symbols/min [2025-10-08T18:52:39.945492] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:40.020789] [DEBUG] [LOCAL ] FBP: Primary data saved (45763 records). [2025-10-08T18:52:40.031899] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-08T18:52:40.032053] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 29.0s. Estimated remaining: 3h 38m 14s. Rate: 7.2 symbols/min [2025-10-08T18:52:40.032575] [DEBUG] [LOCAL ] FCF: Loaded 39294 existing records from primary storage. [2025-10-08T18:52:40.075612] [INFO ] [MAIN ] FCF: Loaded 39294 existing records. [2025-10-08T18:52:40.349857] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:40.385040] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:40.385286] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-08T18:52:40.385330] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-08T18:52:40.386391] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-08T18:52:40.386457] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-08T18:52:40.522926] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T18:52:40.546468] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-08T18:52:40.702892] [DEBUG] [LOCAL ] FCN: Loaded 26013 existing records from primary storage. [2025-10-08T18:52:40.709222] [INFO ] [MAIN ] FCN: Loaded 26013 existing records. [2025-10-08T18:52:40.840915] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:40.861812] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-08T18:52:40.981458] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:40.981769] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-08T18:52:40.981913] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-08T18:52:40.982779] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-08T18:52:40.982843] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-08T18:52:41.113498] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:52:41.357910] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:41.425863] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T18:52:41.617526] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-08T18:52:42.004346] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T18:52:42.407894] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T18:52:42.417489] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-08T18:52:43.217567] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-08T18:52:43.509951] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T18:52:44.017564] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-08T18:52:44.121899] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T18:52:44.817554] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-08T18:52:45.306504] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T18:52:45.617530] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-08T18:52:45.712185] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T18:52:46.417578] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-08T18:52:46.606203] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T18:52:47.217597] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-08T18:52:47.786317] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:52:48.017631] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-08T18:52:48.353007] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T18:52:48.817551] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-08T18:52:49.581782] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:52:49.617508] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-08T18:52:50.178463] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:52:50.417601] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-08T18:52:50.955493] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T18:52:51.217528] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-08T18:52:51.547695] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T18:52:52.017631] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-08T18:52:52.321455] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T18:52:52.817610] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-08T18:52:53.112837] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T18:52:53.617560] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-08T18:52:53.918259] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T18:52:54.417558] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-08T18:52:55.153759] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T18:52:55.217489] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-08T18:52:55.555407] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T18:52:56.017604] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-08T18:52:56.673211] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T18:52:56.817519] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-08T18:52:56.936912] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T18:52:57.617562] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-08T18:52:58.086888] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T18:52:58.270211] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T18:52:58.417610] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-08T18:52:59.217558] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-08T18:52:59.715937] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T18:53:00.017639] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-08T18:53:00.689620] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T18:53:00.817552] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-08T18:53:01.299917] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:53:01.304740] [INFO ] [REMOTE ] FBRT: Full fetch complete (49285 records). [2025-10-08T18:53:01.304925] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-08T18:53:01.622853] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-08T18:53:01.713404] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-08T18:53:01.713498] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-08T18:53:01.714216] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-08T18:53:01.714278] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-08T18:53:01.715350] [DEBUG] [LOCAL ] FBRT: Trimmed 49285 records to 35080 (keeping 200 days of data) [2025-10-08T18:53:01.933253] [DEBUG] [LOCAL ] FBRT: Primary data saved (35080 records). [2025-10-08T18:53:01.933397] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-08T18:53:01.933483] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 25.3s. Estimated remaining: 3h 38m 32s. Rate: 7.2 symbols/min [2025-10-08T18:53:02.113841] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:02.153050] [DEBUG] [LOCAL ] FCPT: Loaded 37319 existing records from primary storage. [2025-10-08T18:53:02.153374] [INFO ] [MAIN ] FCPT: Loaded 37319 existing records. [2025-10-08T18:53:02.341576] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:02.342154] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-08T18:53:02.342442] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-08T18:53:02.342792] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-08T18:53:02.350973] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-08T18:53:02.377340] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T18:53:02.419219] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-08T18:53:02.445806] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T18:53:02.756717] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:03.217600] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-08T18:53:03.326200] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T18:53:04.017620] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-08T18:53:04.153390] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T18:53:04.817561] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-08T18:53:05.100488] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T18:53:05.617549] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-08T18:53:05.680274] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:53:06.417522] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-08T18:53:06.502626] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T18:53:07.097853] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T18:53:07.217580] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-08T18:53:08.017583] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-08T18:53:08.235077] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T18:53:08.817527] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-08T18:53:09.418748] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T18:53:09.617599] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-08T18:53:09.800668] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T18:53:09.802241] [INFO ] [REMOTE ] FC: Full fetch complete (21785 records). [2025-10-08T18:53:09.802314] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-08T18:53:10.175324] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-08T18:53:10.175403] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-08T18:53:10.175936] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-08T18:53:10.176000] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-08T18:53:10.176574] [DEBUG] [LOCAL ] FC: Trimmed 21785 records to 15157 (keeping 200 days of data) [2025-10-08T18:53:10.262004] [DEBUG] [LOCAL ] FC: Primary data saved (15157 records). [2025-10-08T18:53:10.262138] [INFO ] [MAIN ] FC: Full history saved. [2025-10-08T18:53:10.262222] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 32.1s. Estimated remaining: 3h 38m 23s. Rate: 7.2 symbols/min [2025-10-08T18:53:10.428160] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-08T18:53:10.430867] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:10.431691] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-08T18:53:10.431743] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-08T18:53:10.431849] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-08T18:53:10.431894] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-08T18:53:10.431936] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-08T18:53:10.431967] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-08T18:53:10.795692] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:11.058425] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T18:53:11.217607] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-08T18:53:11.835067] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T18:53:11.837342] [INFO ] [REMOTE ] FCN: Full fetch complete (35755 records). [2025-10-08T18:53:11.837444] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-08T18:53:12.026718] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-08T18:53:12.248560] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-08T18:53:12.248674] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-08T18:53:12.249310] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-08T18:53:12.249403] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-08T18:53:12.250298] [DEBUG] [LOCAL ] FCN: Trimmed 35755 records to 26003 (keeping 200 days of data) [2025-10-08T18:53:12.410337] [DEBUG] [LOCAL ] FCN: Primary data saved (26003 records). [2025-10-08T18:53:12.410484] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-08T18:53:12.413149] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCN took 32.4s. Estimated remaining: 3h 38m 3s. Rate: 7.2 symbols/min [2025-10-08T18:53:12.413260] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-08T18:53:12.592747] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:12.609230] [DEBUG] [LOCAL ] FCT: Loaded 14747 existing records from primary storage. [2025-10-08T18:53:12.609714] [INFO ] [MAIN ] FCT: Loaded 14747 existing records. [2025-10-08T18:53:12.733593] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T18:53:12.823594] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-08T18:53:12.832120] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:12.832394] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-08T18:53:12.832447] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-08T18:53:12.832718] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-08T18:53:12.832778] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-08T18:53:13.235621] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:13.270628] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T18:53:13.617576] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-08T18:53:14.417613] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-08T18:53:14.705850] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-08T18:53:15.003731] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T18:53:15.217563] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-08T18:53:15.632888] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T18:53:16.017567] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-08T18:53:16.817522] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-08T18:53:16.999791] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T18:53:17.617516] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-08T18:53:17.725364] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T18:53:18.417546] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-08T18:53:18.548716] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:53:19.217625] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-08T18:53:19.514401] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-08T18:53:19.816397] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T18:53:20.017594] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-08T18:53:20.817587] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-08T18:53:20.918788] [DEBUG] [REMOTE ] FCRX: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-08T18:53:20.919055] [WARN ] [REMOTE ] FCRX: No data returned for month 2025-05 [2025-10-08T18:53:20.919143] [FATAL] [REMOTE ] FCRX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:53:20.919246] [FATAL] [MAIN ] FCRX: Failed to fetch primary data. [2025-10-08T18:53:20.919312] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:53:20.919382] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-08T18:53:20.919443] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-08T18:53:20.919482] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-08T18:53:20.919560] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-08T18:53:20.919624] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCRX took 10.7s. Estimated remaining: 3h 37m 55s. Rate: 7.2 symbols/min [2025-10-08T18:53:21.084720] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:21.134254] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-08T18:53:21.134583] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-08T18:53:21.331979] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:21.332495] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-08T18:53:21.332549] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-08T18:53:21.332894] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-08T18:53:21.332954] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-08T18:53:21.618922] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-08T18:53:21.710457] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:21.733725] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:53:22.417518] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-08T18:53:22.501939] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:53:23.217630] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-08T18:53:23.979682] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:53:24.017497] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-08T18:53:24.337372] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T18:53:24.340745] [INFO ] [REMOTE ] FCF: Full fetch complete (58138 records). [2025-10-08T18:53:24.340863] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-08T18:53:24.735519] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-08T18:53:24.735603] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-08T18:53:24.736358] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-08T18:53:24.736420] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-08T18:53:24.737679] [DEBUG] [LOCAL ] FCF: Trimmed 58138 records to 39188 (keeping 200 days of data) [2025-10-08T18:53:24.825404] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-08T18:53:24.976784] [DEBUG] [LOCAL ] FCF: Primary data saved (39188 records). [2025-10-08T18:53:24.976928] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-08T18:53:24.977011] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCF took 45.3s. Estimated remaining: 3h 37m 38s. Rate: 7.2 symbols/min [2025-10-08T18:53:25.150611] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:25.183363] [DEBUG] [LOCAL ] FDP: Loaded 30089 existing records from primary storage. [2025-10-08T18:53:25.183636] [INFO ] [MAIN ] FDP: Loaded 30089 existing records. [2025-10-08T18:53:25.366463] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:25.366935] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-08T18:53:25.367017] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-08T18:53:25.367358] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-08T18:53:25.367603] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-08T18:53:25.556179] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:53:25.619824] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-08T18:53:25.755881] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:26.417513] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-08T18:53:26.566942] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T18:53:26.840512] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T18:53:27.217566] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-08T18:53:27.438801] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T18:53:28.017584] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-08T18:53:28.094997] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T18:53:28.817630] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-08T18:53:29.402171] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T18:53:29.617553] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-08T18:53:29.841369] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T18:53:30.417591] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-08T18:53:31.217517] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-08T18:53:31.595129] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-08T18:53:31.728360] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T18:53:31.806473] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T18:53:32.017612] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-08T18:53:32.817558] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-08T18:53:33.617553] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-08T18:53:33.903103] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T18:53:33.985709] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T18:53:34.064101] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T18:53:34.417622] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-08T18:53:35.217567] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-08T18:53:35.772755] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T18:53:36.017531] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-08T18:53:36.262280] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:53:36.817590] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-08T18:53:37.091685] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T18:53:37.617560] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-08T18:53:38.417618] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-08T18:53:38.877464] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T18:53:38.989737] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-08T18:53:39.217562] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-08T18:53:39.554621] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T18:53:39.557962] [INFO ] [REMOTE ] FCPT: Full fetch complete (53849 records). [2025-10-08T18:53:39.558104] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-08T18:53:39.944723] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-08T18:53:39.944814] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-08T18:53:39.945594] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-08T18:53:39.945678] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-08T18:53:39.946851] [DEBUG] [LOCAL ] FCPT: Trimmed 53849 records to 37317 (keeping 200 days of data) [2025-10-08T18:53:40.036455] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-08T18:53:40.203732] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:53:40.214563] [DEBUG] [LOCAL ] FCPT: Primary data saved (37317 records). [2025-10-08T18:53:40.214711] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-08T18:53:40.214800] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCPT took 38.3s. Estimated remaining: 3h 37m 43s. Rate: 7.2 symbols/min [2025-10-08T18:53:40.382587] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:40.409940] [DEBUG] [LOCAL ] FDS: Loaded 26938 existing records from primary storage. [2025-10-08T18:53:40.410221] [INFO ] [MAIN ] FDS: Loaded 26938 existing records. [2025-10-08T18:53:40.585025] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:40.585243] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-08T18:53:40.585289] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-08T18:53:40.585558] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-08T18:53:40.585616] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-08T18:53:40.822594] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-08T18:53:40.953966] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:40.998334] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T18:53:41.617563] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-08T18:53:42.417592] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-08T18:53:42.669096] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T18:53:42.780503] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T18:53:43.179361] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:53:43.217502] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-08T18:53:44.017609] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-08T18:53:44.493847] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T18:53:44.817637] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-08T18:53:44.979540] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:53:45.617537] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-08T18:53:46.283994] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-08T18:53:46.417562] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-08T18:53:46.477869] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T18:53:47.217529] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-08T18:53:47.382092] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T18:53:48.017631] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-08T18:53:48.325055] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:53:48.817556] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-08T18:53:49.617521] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-08T18:53:49.787478] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T18:53:49.968993] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T18:53:50.417565] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-08T18:53:50.742705] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T18:53:51.208782] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T18:53:51.217494] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-08T18:53:52.017563] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-08T18:53:52.442515] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T18:53:52.817612] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-08T18:53:53.617623] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-08T18:53:54.417513] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-08T18:53:54.721036] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:53:54.723394] [INFO ] [REMOTE ] FDP: Full fetch complete (42888 records). [2025-10-08T18:53:54.723502] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-08T18:53:55.107450] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-08T18:53:55.107570] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-08T18:53:55.108359] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-08T18:53:55.108503] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-08T18:53:55.109770] [DEBUG] [LOCAL ] FDP: Trimmed 42888 records to 30061 (keeping 200 days of data) [2025-10-08T18:53:55.238070] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-08T18:53:55.252048] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-08T18:53:55.375579] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T18:53:55.390753] [DEBUG] [LOCAL ] FDP: Primary data saved (30061 records). [2025-10-08T18:53:55.390927] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-08T18:53:55.391033] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FDP took 30.4s. Estimated remaining: 3h 37m 47s. Rate: 7.1 symbols/min [2025-10-08T18:53:55.559899] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:55.613357] [DEBUG] [LOCAL ] FDX: Loaded 51485 existing records from primary storage. [2025-10-08T18:53:55.613737] [INFO ] [MAIN ] FDX: Loaded 51485 existing records. [2025-10-08T18:53:55.741738] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (3.72 seconds). [2025-10-08T18:53:55.782792] [INFO ] [REMOTE ] FCT: Full fetch complete (21171 records). [2025-10-08T18:53:55.806704] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-08T18:53:55.806540] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:55.807087] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-08T18:53:55.807197] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-08T18:53:55.839510] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-08T18:53:55.888892] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-08T18:53:56.024004] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-08T18:53:56.542107] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-08T18:53:56.542695] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-08T18:53:56.560031] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-08T18:53:56.566534] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:56.566689] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-08T18:53:56.567555] [DEBUG] [LOCAL ] FCT: Trimmed 21171 records to 14779 (keeping 200 days of data) [2025-10-08T18:53:56.661395] [DEBUG] [LOCAL ] FCT: Primary data saved (14779 records). [2025-10-08T18:53:56.661560] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-08T18:53:56.661718] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FCT took 44.2s. Estimated remaining: 3h 37m 25s. Rate: 7.2 symbols/min [2025-10-08T18:53:56.825523] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-08T18:53:56.829259] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:56.882071] [DEBUG] [LOCAL ] FE: Loaded 53431 existing records from primary storage. [2025-10-08T18:53:56.882419] [INFO ] [MAIN ] FE: Loaded 53431 existing records. [2025-10-08T18:53:57.065211] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:57.065436] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-08T18:53:57.065483] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-08T18:53:57.065743] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-08T18:53:57.065803] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-08T18:53:57.442585] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:57.458806] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T18:53:57.496606] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-08T18:53:57.617498] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-08T18:53:58.417531] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-08T18:53:58.622681] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:53:59.217557] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-08T18:53:59.731149] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-08T18:54:00.017544] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-08T18:54:00.051102] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:54:00.817577] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-08T18:54:00.860440] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T18:54:00.936294] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T18:54:01.617592] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-08T18:54:02.417559] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-08T18:54:02.563877] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T18:54:03.217555] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-08T18:54:03.769328] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-08T18:54:03.774901] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-08T18:54:03.775048] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-08T18:54:04.022281] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-08T18:54:04.189946] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-08T18:54:04.190301] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-08T18:54:04.191420] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-08T18:54:04.201572] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-08T18:54:04.221411] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T18:54:04.221560] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 53700 (keeping 200 days of data) [2025-10-08T18:54:04.570408] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:54:04.596886] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-10-08T18:54:04.597059] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-08T18:54:04.597164] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCX took 43.7s. Estimated remaining: 3h 37m 16s. Rate: 7.2 symbols/min [2025-10-08T18:54:04.766614] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:04.766819] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-08T18:54:04.766861] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-08T18:54:04.766976] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-08T18:54:04.767017] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-08T18:54:04.767058] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-08T18:54:04.767088] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-08T18:54:04.830126] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-08T18:54:05.140527] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:05.617544] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-08T18:54:05.704885] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:54:06.420266] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-08T18:54:06.423300] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:54:07.154441] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T18:54:07.217554] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-08T18:54:08.017561] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-08T18:54:08.260930] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T18:54:08.377228] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T18:54:08.653923] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:54:08.657003] [INFO ] [REMOTE ] FDS: Full fetch complete (38028 records). [2025-10-08T18:54:08.657125] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-08T18:54:08.825197] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-08T18:54:09.069966] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-08T18:54:09.070073] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-08T18:54:09.070735] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-08T18:54:09.070800] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-08T18:54:09.071875] [DEBUG] [LOCAL ] FDS: Trimmed 38028 records to 26941 (keeping 200 days of data) [2025-10-08T18:54:09.256594] [DEBUG] [LOCAL ] FDS: Primary data saved (26941 records). [2025-10-08T18:54:09.256775] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-08T18:54:09.256868] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDS took 29.0s. Estimated remaining: 3h 37m 1s. Rate: 7.2 symbols/min [2025-10-08T18:54:09.436936] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:09.484232] [DEBUG] [LOCAL ] FERG: Loaded 48782 existing records from primary storage. [2025-10-08T18:54:09.484564] [INFO ] [MAIN ] FERG: Loaded 48782 existing records. [2025-10-08T18:54:09.623341] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-08T18:54:09.665514] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:09.665990] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-08T18:54:09.666047] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-08T18:54:09.666273] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-08T18:54:09.666330] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-08T18:54:10.071250] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:10.132055] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T18:54:10.417528] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-08T18:54:10.488181] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:54:10.788534] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-08T18:54:11.217556] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-08T18:54:12.017559] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-08T18:54:12.440722] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T18:54:12.817530] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-08T18:54:12.909901] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T18:54:13.146770] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-08T18:54:13.617553] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-08T18:54:14.417548] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-08T18:54:15.217525] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-08T18:54:15.393112] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T18:54:15.863532] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:54:16.017519] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-08T18:54:16.817575] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-08T18:54:16.936922] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:54:17.348901] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T18:54:17.617508] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-08T18:54:17.693710] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:54:18.417571] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-08T18:54:19.217517] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-08T18:54:19.501091] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T18:54:20.017590] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-08T18:54:20.217316] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T18:54:20.294470] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-08T18:54:20.817531] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-08T18:54:20.992958] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T18:54:21.617587] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-08T18:54:22.382732] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T18:54:22.417584] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-08T18:54:23.217518] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-08T18:54:23.372791] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:54:24.017568] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-08T18:54:24.049695] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T18:54:24.295899] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-08T18:54:24.817587] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-08T18:54:24.898253] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T18:54:25.177406] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:54:25.617540] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-08T18:54:25.998457] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-08T18:54:26.417593] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-08T18:54:27.217562] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-08T18:54:28.017506] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-08T18:54:28.452346] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T18:54:28.817531] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-08T18:54:28.883596] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-08T18:54:28.888071] [INFO ] [REMOTE ] FE: Full fetch complete (77281 records). [2025-10-08T18:54:28.888216] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-08T18:54:29.276681] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T18:54:29.297334] [INFO ] [REMOTE ] FENG: Full fetch complete (2258 records). [2025-10-08T18:54:29.297433] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-08T18:54:29.343734] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-08T18:54:29.364735] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-08T18:54:29.365873] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-08T18:54:29.371389] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-08T18:54:29.430887] [DEBUG] [LOCAL ] FE: Trimmed 77281 records to 53433 (keeping 200 days of data) [2025-10-08T18:54:29.486336] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T18:54:29.539245] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:54:29.548255] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:54:29.574565] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-08T18:54:29.575406] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-08T18:54:29.575720] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-08T18:54:29.576101] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-08T18:54:29.576213] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FENG took 25.0s. Estimated remaining: 3h 37m 15s. Rate: 7.1 symbols/min [2025-10-08T18:54:29.620121] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-08T18:54:29.768983] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:29.789272] [DEBUG] [LOCAL ] FET: Loaded 12791 existing records from primary storage. [2025-10-08T18:54:29.791148] [INFO ] [MAIN ] FET: Loaded 12791 existing records. [2025-10-08T18:54:29.996276] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:29.997448] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-08T18:54:29.997918] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-08T18:54:29.999245] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-08T18:54:30.000282] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-08T18:54:30.324931] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-08T18:54:30.426749] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-08T18:54:30.545228] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:30.649140] [DEBUG] [LOCAL ] FE: Primary data saved (53433 records). [2025-10-08T18:54:30.649302] [INFO ] [MAIN ] FE: Full history saved. [2025-10-08T18:54:30.649446] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FE took 34.0s. Estimated remaining: 3h 36m 53s. Rate: 7.2 symbols/min [2025-10-08T18:54:30.835596] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:30.858396] [DEBUG] [LOCAL ] FF: Loaded 24565 existing records from primary storage. [2025-10-08T18:54:30.858736] [INFO ] [MAIN ] FF: Loaded 24565 existing records. [2025-10-08T18:54:31.035734] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:31.035942] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-08T18:54:31.035988] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-08T18:54:31.036293] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-08T18:54:31.036349] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-08T18:54:31.224091] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-08T18:54:31.390494] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:31.655130] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T18:54:32.017547] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-08T18:54:32.088102] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T18:54:32.150945] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T18:54:32.817601] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-08T18:54:33.385083] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T18:54:33.617491] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-08T18:54:34.006741] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-08T18:54:34.010489] [INFO ] [REMOTE ] FDX: Full fetch complete (74397 records). [2025-10-08T18:54:34.010594] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-08T18:54:34.414319] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T18:54:34.417435] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-08T18:54:34.416813] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-08T18:54:34.418432] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-08T18:54:34.419826] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-08T18:54:34.420021] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-08T18:54:34.421839] [DEBUG] [LOCAL ] FDX: Trimmed 74397 records to 51462 (keeping 200 days of data) [2025-10-08T18:54:34.752294] [DEBUG] [LOCAL ] FDX: Primary data saved (51462 records). [2025-10-08T18:54:34.752433] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-08T18:54:34.753389] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FDX took 39.4s. Estimated remaining: 3h 36m 36s. Rate: 7.2 symbols/min [2025-10-08T18:54:34.927825] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:34.936766] [DEBUG] [LOCAL ] FFA: Loaded 5982 existing records from primary storage. [2025-10-08T18:54:34.937008] [INFO ] [MAIN ] FFA: Loaded 5982 existing records. [2025-10-08T18:54:35.121490] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:35.121903] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-08T18:54:35.122150] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-08T18:54:35.130371] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-08T18:54:35.131011] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-08T18:54:35.131323] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T18:54:35.222697] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-08T18:54:35.489515] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:36.017620] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-08T18:54:36.162716] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T18:54:36.619457] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-08T18:54:36.817740] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-08T18:54:37.499608] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T18:54:37.617559] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-08T18:54:38.417552] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-08T18:54:38.457949] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T18:54:39.217517] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-08T18:54:39.353320] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T18:54:39.674447] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T18:54:40.017533] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-08T18:54:40.817563] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-08T18:54:40.888547] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T18:54:41.602896] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T18:54:41.617503] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-08T18:54:42.417556] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-08T18:54:42.510452] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:54:43.217512] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-08T18:54:43.251130] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T18:54:44.017520] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-08T18:54:44.134821] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T18:54:44.817573] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-08T18:54:45.617507] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-08T18:54:45.885530] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T18:54:46.289828] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T18:54:46.352448] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:54:46.417507] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-08T18:54:47.217588] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-08T18:54:47.669168] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T18:54:47.962328] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T18:54:48.017510] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-08T18:54:48.817571] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-08T18:54:49.550450] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:54:49.617518] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-08T18:54:49.801322] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:54:50.417549] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-08T18:54:50.992696] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T18:54:51.217512] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-08T18:54:51.317458] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T18:54:51.964532] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T18:54:51.966051] [INFO ] [REMOTE ] FET: Full fetch complete (18288 records). [2025-10-08T18:54:51.966125] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-08T18:54:52.027036] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-08T18:54:52.337659] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-08T18:54:52.337756] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-08T18:54:52.338174] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-08T18:54:52.338214] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-08T18:54:52.338875] [DEBUG] [LOCAL ] FET: Trimmed 18288 records to 12811 (keeping 200 days of data) [2025-10-08T18:54:52.414393] [DEBUG] [LOCAL ] FET: Primary data saved (12811 records). [2025-10-08T18:54:52.414542] [INFO ] [MAIN ] FET: Full history saved. [2025-10-08T18:54:52.414662] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FET took 22.8s. Estimated remaining: 3h 36m 45s. Rate: 7.2 symbols/min [2025-10-08T18:54:52.587303] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:52.605947] [DEBUG] [LOCAL ] FFC: Loaded 16682 existing records from primary storage. [2025-10-08T18:54:52.606204] [INFO ] [MAIN ] FFC: Loaded 16682 existing records. [2025-10-08T18:54:52.781662] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:52.781941] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-08T18:54:52.782001] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-08T18:54:52.782216] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-08T18:54:52.782311] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-08T18:54:52.823555] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-08T18:54:53.146700] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:53.179212] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T18:54:53.617628] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-08T18:54:54.417520] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-08T18:54:54.437780] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T18:54:54.533204] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T18:54:55.217560] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-08T18:54:55.307248] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T18:54:56.017573] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-08T18:54:56.817552] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-08T18:54:56.943334] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:54:56.946524] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T18:54:57.292345] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:54:57.617585] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-08T18:54:58.417548] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-08T18:54:59.217517] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-08T18:54:59.354411] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T18:54:59.358591] [INFO ] [REMOTE ] FERG: Full fetch complete (70870 records). [2025-10-08T18:54:59.358750] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-08T18:54:59.552116] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:54:59.779982] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-08T18:54:59.780179] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-08T18:54:59.781101] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-08T18:54:59.781164] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-08T18:54:59.782567] [DEBUG] [LOCAL ] FERG: Trimmed 70870 records to 48754 (keeping 200 days of data) [2025-10-08T18:55:00.021339] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-08T18:55:00.031334] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T18:55:00.118494] [DEBUG] [LOCAL ] FERG: Primary data saved (48754 records). [2025-10-08T18:55:00.118702] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-08T18:55:00.118830] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FERG took 50.9s. Estimated remaining: 3h 36m 36s. Rate: 7.2 symbols/min [2025-10-08T18:55:00.287827] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:00.319979] [DEBUG] [LOCAL ] FFWM: Loaded 35834 existing records from primary storage. [2025-10-08T18:55:00.320266] [INFO ] [MAIN ] FFWM: Loaded 35834 existing records. [2025-10-08T18:55:00.495267] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:00.495499] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-08T18:55:00.495546] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-08T18:55:00.495810] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-08T18:55:00.495869] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-08T18:55:00.603819] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T18:55:00.824993] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-08T18:55:00.856073] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:01.407044] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T18:55:01.617553] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-08T18:55:02.417559] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-08T18:55:02.987142] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:55:03.204510] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:55:03.217501] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-08T18:55:04.017550] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-08T18:55:04.343603] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T18:55:04.585818] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T18:55:04.817569] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-08T18:55:05.617563] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-08T18:55:05.853222] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T18:55:06.417603] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-08T18:55:06.790293] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T18:55:06.792142] [INFO ] [REMOTE ] FF: Full fetch complete (36593 records). [2025-10-08T18:55:06.792215] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-08T18:55:07.163157] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-08T18:55:07.163237] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-08T18:55:07.163972] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-08T18:55:07.164051] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-08T18:55:07.165177] [DEBUG] [LOCAL ] FF: Trimmed 36593 records to 24514 (keeping 200 days of data) [2025-10-08T18:55:07.223594] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-08T18:55:07.311954] [DEBUG] [LOCAL ] FF: Primary data saved (24514 records). [2025-10-08T18:55:07.312096] [INFO ] [MAIN ] FF: Full history saved. [2025-10-08T18:55:07.312183] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FF took 36.7s. Estimated remaining: 3h 36m 25s. Rate: 7.2 symbols/min [2025-10-08T18:55:07.484970] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:07.508855] [DEBUG] [LOCAL ] FG: Loaded 22959 existing records from primary storage. [2025-10-08T18:55:07.509138] [INFO ] [MAIN ] FG: Loaded 22959 existing records. [2025-10-08T18:55:07.696498] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:07.696713] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-08T18:55:07.696768] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-08T18:55:07.696993] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-08T18:55:07.697050] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-08T18:55:07.906630] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T18:55:08.018854] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-08T18:55:08.018747] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T18:55:08.110111] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:08.817542] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-08T18:55:09.439923] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T18:55:09.515391] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T18:55:09.617539] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-08T18:55:10.232720] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T18:55:10.417536] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-08T18:55:11.217557] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-08T18:55:11.454830] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T18:55:12.017543] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-08T18:55:12.292949] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T18:55:12.817536] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-08T18:55:13.483317] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T18:55:13.617529] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-08T18:55:13.876895] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T18:55:14.417590] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-08T18:55:14.646240] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T18:55:15.217626] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-08T18:55:15.459428] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T18:55:16.017549] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-08T18:55:16.596535] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T18:55:16.753306] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T18:55:16.817545] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-08T18:55:17.617615] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-08T18:55:17.780429] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:55:17.781998] [INFO ] [REMOTE ] FFC: Full fetch complete (24650 records). [2025-10-08T18:55:17.782072] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-08T18:55:18.149133] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-08T18:55:18.149216] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-08T18:55:18.149891] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-08T18:55:18.149955] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-08T18:55:18.150621] [DEBUG] [LOCAL ] FFC: Trimmed 24650 records to 16723 (keeping 200 days of data) [2025-10-08T18:55:18.230221] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T18:55:18.232791] [INFO ] [REMOTE ] FFA: Full fetch complete (8709 records). [2025-10-08T18:55:18.232892] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-08T18:55:18.434321] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-08T18:55:18.628441] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-08T18:55:18.628818] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-08T18:55:18.629404] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-08T18:55:18.629741] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-08T18:55:18.631069] [DEBUG] [LOCAL ] FFA: Trimmed 8709 records to 6060 (keeping 200 days of data) [2025-10-08T18:55:18.676539] [DEBUG] [LOCAL ] FFC: Primary data saved (16723 records). [2025-10-08T18:55:18.677205] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-08T18:55:18.677345] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FFC took 26.3s. Estimated remaining: 3h 36m 22s. Rate: 7.1 symbols/min [2025-10-08T18:55:18.788594] [DEBUG] [LOCAL ] FFA: Primary data saved (6060 records). [2025-10-08T18:55:18.794621] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-08T18:55:18.810328] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFA took 44.1s. Estimated remaining: 3h 35m 58s. Rate: 7.2 symbols/min [2025-10-08T18:55:18.992183] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:19.073263] [DEBUG] [LOCAL ] FGN: Loaded 3819 existing records from primary storage. [2025-10-08T18:55:19.090793] [INFO ] [MAIN ] FGN: Loaded 3819 existing records. [2025-10-08T18:55:19.092300] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:19.136554] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-08T18:55:19.158158] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-08T18:55:19.170022] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-08T18:55:19.175215] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-08T18:55:19.198440] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-08T18:55:19.198546] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-08T18:55:19.229449] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-08T18:55:19.389635] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:19.392411] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-08T18:55:19.392484] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-08T18:55:19.392901] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-08T18:55:19.403530] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-08T18:55:19.974059] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:20.026095] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-08T18:55:20.070326] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:20.090182] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:55:20.190391] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T18:55:20.290300] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:55:20.290870] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-08T18:55:20.291002] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:55:20.291091] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-08T18:55:20.291169] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:55:20.291265] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-08T18:55:20.291388] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-08T18:55:20.291463] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-08T18:55:20.291523] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-08T18:55:20.291612] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 1.5s. Estimated remaining: 3h 35m 37s. Rate: 7.2 symbols/min [2025-10-08T18:55:20.462869] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:20.501381] [DEBUG] [LOCAL ] FHI: Loaded 39965 existing records from primary storage. [2025-10-08T18:55:20.501711] [INFO ] [MAIN ] FHI: Loaded 39965 existing records. [2025-10-08T18:55:20.681805] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:20.682076] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-08T18:55:20.682129] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-08T18:55:20.682402] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-08T18:55:20.682459] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-08T18:55:20.822770] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-08T18:55:21.040270] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:21.492900] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T18:55:21.617590] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-08T18:55:22.417548] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-08T18:55:22.710507] [DEBUG] [REMOTE ] FHI: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-08T18:55:22.710869] [WARN ] [REMOTE ] FHI: No data returned for month 2024-12 [2025-10-08T18:55:22.710959] [FATAL] [REMOTE ] FHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:55:22.711010] [FATAL] [MAIN ] FHI: Failed to fetch primary data. [2025-10-08T18:55:22.711044] [WARN ] [MAIN ] FHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:55:22.711080] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-08T18:55:22.711135] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-10-08T18:55:22.711169] [INFO ] [LOCAL ] FHI: Starting deletion of derivative data. [2025-10-08T18:55:22.711446] [DEBUG] [LOCAL ] FHI: Deleted derivative data file. [2025-10-08T18:55:22.711544] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FHI took 2.4s. Estimated remaining: 3h 35m 17s. Rate: 7.2 symbols/min [2025-10-08T18:55:22.877582] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T18:55:22.904808] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:22.959595] [DEBUG] [LOCAL ] FHN: Loaded 53368 existing records from primary storage. [2025-10-08T18:55:22.959974] [INFO ] [MAIN ] FHN: Loaded 53368 existing records. [2025-10-08T18:55:23.143310] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:23.143511] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-08T18:55:23.143559] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-08T18:55:23.143851] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-08T18:55:23.143911] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-08T18:55:23.222705] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-08T18:55:23.506346] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:23.848715] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T18:55:24.017588] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-08T18:55:24.594462] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T18:55:24.817590] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-08T18:55:25.617567] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-08T18:55:26.292009] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:55:26.417570] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-08T18:55:26.941933] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:55:26.954719] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T18:55:27.217592] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-08T18:55:28.017552] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-08T18:55:28.309542] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T18:55:28.467639] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T18:55:28.817554] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-08T18:55:29.617534] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-08T18:55:30.002139] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T18:55:30.174771] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T18:55:30.417597] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-08T18:55:31.198714] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T18:55:31.217531] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-08T18:55:32.017560] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-08T18:55:32.330598] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T18:55:32.574686] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T18:55:32.817580] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-08T18:55:33.499160] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T18:55:33.617605] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-08T18:55:34.417570] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-08T18:55:35.062871] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:55:35.217544] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-08T18:55:35.427969] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T18:55:35.768894] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T18:55:36.017545] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-08T18:55:36.817587] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-08T18:55:37.098979] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T18:55:37.348822] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T18:55:37.617554] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-08T18:55:38.400172] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T18:55:38.402479] [INFO ] [REMOTE ] FG: Full fetch complete (28066 records). [2025-10-08T18:55:38.402568] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-08T18:55:38.425117] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-08T18:55:38.791117] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-08T18:55:38.791213] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-08T18:55:38.791739] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-08T18:55:38.791802] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-08T18:55:38.792509] [DEBUG] [LOCAL ] FG: Trimmed 28066 records to 22742 (keeping 200 days of data) [2025-10-08T18:55:38.946726] [DEBUG] [LOCAL ] FG: Primary data saved (22742 records). [2025-10-08T18:55:38.946864] [INFO ] [MAIN ] FG: Full history saved. [2025-10-08T18:55:38.946950] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FG took 31.6s. Estimated remaining: 3h 35m 24s. Rate: 7.2 symbols/min [2025-10-08T18:55:39.112447] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:39.164989] [DEBUG] [LOCAL ] FI: Loaded 53526 existing records from primary storage. [2025-10-08T18:55:39.165350] [INFO ] [MAIN ] FI: Loaded 53526 existing records. [2025-10-08T18:55:39.227769] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-08T18:55:39.351508] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:39.352094] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-08T18:55:39.352156] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-08T18:55:39.352567] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-08T18:55:39.352626] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-08T18:55:39.713435] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:39.802333] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T18:55:40.017537] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-08T18:55:40.185784] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T18:55:40.591802] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T18:55:40.592592] [INFO ] [REMOTE ] FGN: Full fetch complete (5686 records). [2025-10-08T18:55:40.592686] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-08T18:55:40.823738] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-08T18:55:40.952766] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-08T18:55:40.952849] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-08T18:55:40.953009] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-08T18:55:40.953047] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-08T18:55:40.953412] [DEBUG] [LOCAL ] FGN: Trimmed 5686 records to 3793 (keeping 200 days of data) [2025-10-08T18:55:40.977501] [DEBUG] [LOCAL ] FGN: Primary data saved (3793 records). [2025-10-08T18:55:40.977659] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-08T18:55:40.977770] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FGN took 22.3s. Estimated remaining: 3h 35m 4s. Rate: 7.2 symbols/min [2025-10-08T18:55:41.163548] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:41.187139] [DEBUG] [LOCAL ] FICO: Loaded 21194 existing records from primary storage. [2025-10-08T18:55:41.187442] [INFO ] [MAIN ] FICO: Loaded 21194 existing records. [2025-10-08T18:55:41.373858] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:41.374112] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-08T18:55:41.374160] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-08T18:55:41.374417] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-08T18:55:41.374475] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-08T18:55:41.623086] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-08T18:55:41.755760] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:41.920084] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T18:55:42.417597] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-08T18:55:43.217532] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-08T18:55:43.433324] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T18:55:43.674888] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:55:43.677786] [INFO ] [REMOTE ] FFWM: Full fetch complete (51873 records). [2025-10-08T18:55:43.677875] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-08T18:55:44.026976] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-08T18:55:44.064577] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T18:55:44.086692] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-08T18:55:44.086790] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-08T18:55:44.087526] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-08T18:55:44.087568] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-08T18:55:44.088823] [DEBUG] [LOCAL ] FFWM: Trimmed 51873 records to 35821 (keeping 200 days of data) [2025-10-08T18:55:44.290324] [DEBUG] [LOCAL ] FFWM: Primary data saved (35821 records). [2025-10-08T18:55:44.290504] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-08T18:55:44.290595] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FFWM took 44.2s. Estimated remaining: 3h 34m 46s. Rate: 7.2 symbols/min [2025-10-08T18:55:44.462068] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:44.462270] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-08T18:55:44.462307] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-08T18:55:44.462454] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-08T18:55:44.462494] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-08T18:55:44.462535] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-08T18:55:44.462566] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-08T18:55:44.817162] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:44.817519] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-08T18:55:45.083311] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-08T18:55:45.617622] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-08T18:55:45.860264] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-08T18:55:45.906835] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T18:55:46.417579] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-08T18:55:46.739136] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-08T18:55:47.217597] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-08T18:55:47.457466] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-08T18:55:48.017544] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-08T18:55:48.817577] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-08T18:55:49.138182] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T18:55:49.617549] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-08T18:55:50.294496] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T18:55:50.417732] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-08T18:55:50.697342] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:55:51.217559] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-08T18:55:51.625168] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T18:55:52.017561] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-08T18:55:52.394008] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T18:55:52.618527] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-08T18:55:52.817557] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-08T18:55:53.617558] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-08T18:55:53.816572] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:55:53.816949] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-08T18:55:53.817038] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:55:53.817117] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-08T18:55:53.817154] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:55:53.817219] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-08T18:55:53.817283] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-08T18:55:53.817337] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-08T18:55:53.817399] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-08T18:55:53.817469] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FIG took 9.5s. Estimated remaining: 3h 34m 40s. Rate: 7.2 symbols/min [2025-10-08T18:55:53.990781] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:54.040173] [DEBUG] [LOCAL ] FIGS: Loaded 48805 existing records from primary storage. [2025-10-08T18:55:54.040557] [INFO ] [MAIN ] FIGS: Loaded 48805 existing records. [2025-10-08T18:55:54.225903] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:54.226177] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-08T18:55:54.226239] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-08T18:55:54.226499] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-08T18:55:54.226557] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-08T18:55:54.422701] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-08T18:55:54.593139] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:54.622995] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:55:55.217631] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-08T18:55:56.017557] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-08T18:55:56.363179] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T18:55:56.694486] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:55:56.817562] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-08T18:55:57.562201] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:55:57.617540] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-08T18:55:58.417531] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-08T18:55:58.825849] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T18:55:58.907132] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T18:55:59.145410] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T18:55:59.217603] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-08T18:56:00.017591] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-08T18:56:00.817562] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-08T18:56:01.455345] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-08T18:56:01.617566] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-08T18:56:01.676168] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T18:56:01.820726] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:56:02.417562] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-08T18:56:02.913484] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T18:56:03.217564] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-08T18:56:03.851287] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T18:56:04.017566] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-08T18:56:04.817592] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-08T18:56:05.296732] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-08T18:56:05.560013] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T18:56:05.617522] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-08T18:56:05.917920] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T18:56:06.417567] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-08T18:56:07.217525] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-08T18:56:07.338592] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:56:08.017552] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-08T18:56:08.356628] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T18:56:08.393379] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T18:56:08.817557] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-08T18:56:09.432369] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:56:09.617544] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-08T18:56:10.417516] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-08T18:56:10.955124] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T18:56:11.217557] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-08T18:56:11.534991] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T18:56:11.833832] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:56:12.017630] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-08T18:56:12.527621] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T18:56:12.779949] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T18:56:12.783932] [INFO ] [REMOTE ] FI: Full fetch complete (77215 records). [2025-10-08T18:56:12.784067] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-08T18:56:12.822689] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-08T18:56:13.199693] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-08T18:56:13.199813] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-08T18:56:13.200997] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-08T18:56:13.201075] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-08T18:56:13.202706] [DEBUG] [LOCAL ] FI: Trimmed 77215 records to 53534 (keeping 200 days of data) [2025-10-08T18:56:13.534162] [DEBUG] [LOCAL ] FI: Primary data saved (53534 records). [2025-10-08T18:56:13.534308] [INFO ] [MAIN ] FI: Full history saved. [2025-10-08T18:56:13.534394] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FI took 34.6s. Estimated remaining: 3h 34m 52s. Rate: 7.2 symbols/min [2025-10-08T18:56:13.623565] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-08T18:56:13.705576] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:13.742664] [DEBUG] [LOCAL ] FIHL: Loaded 39681 existing records from primary storage. [2025-10-08T18:56:13.742971] [INFO ] [MAIN ] FIHL: Loaded 39681 existing records. [2025-10-08T18:56:13.916976] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:13.917204] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-08T18:56:13.917268] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-08T18:56:13.917512] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-08T18:56:13.917571] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-08T18:56:14.279282] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:14.417539] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-08T18:56:14.550595] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T18:56:15.217618] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-08T18:56:15.385920] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T18:56:15.391380] [INFO ] [REMOTE ] FHN: Full fetch complete (77294 records). [2025-10-08T18:56:15.391557] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-08T18:56:15.744889] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T18:56:15.834815] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-08T18:56:15.834901] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-08T18:56:15.835890] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-08T18:56:15.835953] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-08T18:56:15.837455] [DEBUG] [LOCAL ] FHN: Trimmed 77294 records to 53373 (keeping 200 days of data) [2025-10-08T18:56:16.018849] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-08T18:56:16.168105] [DEBUG] [LOCAL ] FHN: Primary data saved (53373 records). [2025-10-08T18:56:16.168240] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-08T18:56:16.168335] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FHN took 53.5s. Estimated remaining: 3h 34m 33s. Rate: 7.2 symbols/min [2025-10-08T18:56:16.340877] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:16.352104] [DEBUG] [LOCAL ] FINS: Loaded 8266 existing records from primary storage. [2025-10-08T18:56:16.352343] [INFO ] [MAIN ] FINS: Loaded 8266 existing records. [2025-10-08T18:56:16.534073] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:16.534322] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-08T18:56:16.534384] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-08T18:56:16.534545] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-08T18:56:16.534601] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-08T18:56:16.839299] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-08T18:56:16.894062] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:16.966347] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T18:56:17.060676] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:56:17.617543] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-08T18:56:17.782146] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T18:56:18.417581] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-08T18:56:18.614071] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T18:56:19.217686] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-08T18:56:19.753575] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:56:20.017578] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-08T18:56:20.438232] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T18:56:20.817608] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-08T18:56:20.993545] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T18:56:20.996421] [INFO ] [REMOTE ] FICO: Full fetch complete (29345 records). [2025-10-08T18:56:20.996613] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-08T18:56:21.361823] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-08T18:56:21.361909] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-08T18:56:21.362458] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-08T18:56:21.362524] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-08T18:56:21.363340] [DEBUG] [LOCAL ] FICO: Trimmed 29345 records to 21409 (keeping 200 days of data) [2025-10-08T18:56:21.497546] [DEBUG] [LOCAL ] FICO: Primary data saved (21409 records). [2025-10-08T18:56:21.497700] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-08T18:56:21.497796] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FICO took 40.5s. Estimated remaining: 3h 34m 19s. Rate: 7.2 symbols/min [2025-10-08T18:56:21.622696] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-08T18:56:21.676761] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:21.719356] [DEBUG] [LOCAL ] FINV: Loaded 45208 existing records from primary storage. [2025-10-08T18:56:21.719751] [INFO ] [MAIN ] FINV: Loaded 45208 existing records. [2025-10-08T18:56:21.897998] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:21.898247] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-08T18:56:21.898295] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-08T18:56:21.898517] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-08T18:56:21.898573] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-08T18:56:22.261509] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:22.292312] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T18:56:22.417544] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-08T18:56:22.440397] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T18:56:23.217554] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-08T18:56:23.839424] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T18:56:24.017567] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-08T18:56:24.486504] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T18:56:24.518339] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:56:24.817707] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-08T18:56:25.617549] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-08T18:56:26.358390] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T18:56:26.387178] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T18:56:26.417517] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-08T18:56:27.217575] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-08T18:56:28.017566] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-08T18:56:28.155445] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T18:56:28.588803] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T18:56:28.817586] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-08T18:56:29.280439] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T18:56:29.617585] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-08T18:56:30.134246] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T18:56:30.417576] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-08T18:56:31.125064] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:56:31.217504] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-08T18:56:31.786813] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T18:56:31.791306] [INFO ] [REMOTE ] FIGS: Full fetch complete (70870 records). [2025-10-08T18:56:31.791521] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-08T18:56:32.025336] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-08T18:56:32.221794] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-08T18:56:32.221873] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-08T18:56:32.222739] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-08T18:56:32.222801] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-08T18:56:32.224141] [DEBUG] [LOCAL ] FIGS: Trimmed 70870 records to 48743 (keeping 200 days of data) [2025-10-08T18:56:32.449555] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T18:56:32.539032] [DEBUG] [LOCAL ] FIGS: Primary data saved (48743 records). [2025-10-08T18:56:32.539220] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-08T18:56:32.539338] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 38.7s. Estimated remaining: 3h 34m 16s. Rate: 7.2 symbols/min [2025-10-08T18:56:32.711449] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:32.718744] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T18:56:32.770227] [DEBUG] [LOCAL ] FIS: Loaded 53356 existing records from primary storage. [2025-10-08T18:56:32.770595] [INFO ] [MAIN ] FIS: Loaded 53356 existing records. [2025-10-08T18:56:32.822687] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-08T18:56:32.949285] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:32.949537] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-08T18:56:32.949611] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-08T18:56:32.949989] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-08T18:56:32.950070] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-08T18:56:33.303093] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:33.617507] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-08T18:56:34.410552] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:56:34.419131] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-08T18:56:34.691919] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T18:56:35.118343] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T18:56:35.217523] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-08T18:56:36.017561] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-08T18:56:36.451525] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:56:36.481536] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T18:56:36.817560] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-08T18:56:37.582565] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T18:56:37.617517] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-08T18:56:38.417627] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-08T18:56:39.080578] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T18:56:39.217170] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:56:39.224560] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-08T18:56:39.965750] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T18:56:40.017584] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-08T18:56:40.817613] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-08T18:56:41.440175] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T18:56:41.441264] [INFO ] [REMOTE ] FINS: Full fetch complete (11948 records). [2025-10-08T18:56:41.441355] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-08T18:56:41.621137] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-08T18:56:41.847718] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-08T18:56:41.847905] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-08T18:56:41.848250] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-08T18:56:41.848328] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-08T18:56:41.849027] [DEBUG] [LOCAL ] FINS: Trimmed 11948 records to 8304 (keeping 200 days of data) [2025-10-08T18:56:41.923502] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T18:56:41.945115] [DEBUG] [LOCAL ] FINS: Primary data saved (8304 records). [2025-10-08T18:56:41.945251] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-08T18:56:41.945333] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 25.8s. Estimated remaining: 3h 34m 9s. Rate: 7.2 symbols/min [2025-10-08T18:56:42.128181] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:42.159414] [DEBUG] [LOCAL ] FIX: Loaded 29405 existing records from primary storage. [2025-10-08T18:56:42.159862] [INFO ] [MAIN ] FIX: Loaded 29405 existing records. [2025-10-08T18:56:42.338943] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:42.339191] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-08T18:56:42.339252] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-08T18:56:42.339502] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-08T18:56:42.339559] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-08T18:56:42.422690] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-08T18:56:42.694532] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:43.217519] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-08T18:56:43.326687] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T18:56:43.979517] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T18:56:44.017518] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-08T18:56:44.494462] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T18:56:44.817545] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-08T18:56:45.487555] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:56:45.490815] [INFO ] [REMOTE ] FIHL: Full fetch complete (56062 records). [2025-10-08T18:56:45.490924] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-08T18:56:45.631112] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-08T18:56:45.881008] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-08T18:56:45.881134] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-08T18:56:45.881910] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-08T18:56:45.881973] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-08T18:56:45.883152] [DEBUG] [LOCAL ] FIHL: Trimmed 56062 records to 39645 (keeping 200 days of data) [2025-10-08T18:56:46.128063] [DEBUG] [LOCAL ] FIHL: Primary data saved (39645 records). [2025-10-08T18:56:46.128199] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-08T18:56:46.128317] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 32.6s. Estimated remaining: 3h 33m 53s. Rate: 7.2 symbols/min [2025-10-08T18:56:46.417511] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-08T18:56:46.619111] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:56:46.814272] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T18:56:47.217565] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-08T18:56:47.500387] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T18:56:48.017555] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-08T18:56:48.817574] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-08T18:56:49.192956] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T18:56:49.226693] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T18:56:49.617605] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-08T18:56:49.833953] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T18:56:50.417536] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-08T18:56:51.127411] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T18:56:51.217511] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-08T18:56:52.017527] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-08T18:56:52.181907] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:56:52.817518] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-08T18:56:52.945606] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:56:53.290102] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T18:56:53.617557] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-08T18:56:54.417557] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-08T18:56:54.603742] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:56:54.847713] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:56:55.217554] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-08T18:56:56.017524] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-08T18:56:56.326127] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T18:56:56.797566] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:56:56.817496] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-08T18:56:57.267894] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T18:56:57.617549] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-08T18:56:58.254202] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:56:58.257846] [INFO ] [REMOTE ] FINV: Full fetch complete (63780 records). [2025-10-08T18:56:58.257946] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-08T18:56:58.430386] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-08T18:56:58.671942] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-08T18:56:58.672091] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-08T18:56:58.673061] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-08T18:56:58.673250] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-08T18:56:58.674639] [DEBUG] [LOCAL ] FINV: Trimmed 63780 records to 45214 (keeping 200 days of data) [2025-10-08T18:56:58.894695] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T18:56:58.963551] [DEBUG] [LOCAL ] FINV: Primary data saved (45214 records). [2025-10-08T18:56:58.963746] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-08T18:56:58.963844] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FINV took 37.5s. Estimated remaining: 3h 33m 53s. Rate: 7.2 symbols/min [2025-10-08T18:56:59.217553] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-08T18:57:00.237324] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T18:57:00.250506] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-08T18:57:00.428377] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T18:57:00.817557] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-08T18:57:01.968695] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T18:57:01.975906] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-08T18:57:02.248562] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T18:57:02.417544] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-08T18:57:03.377151] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T18:57:03.383244] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-08T18:57:03.977980] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T18:57:03.981965] [INFO ] [REMOTE ] FIS: Full fetch complete (77179 records). [2025-10-08T18:57:03.982078] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-08T18:57:04.372234] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-08T18:57:04.372317] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-08T18:57:04.373232] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-08T18:57:04.373296] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-08T18:57:04.374720] [DEBUG] [LOCAL ] FIS: Trimmed 77179 records to 53350 (keeping 200 days of data) [2025-10-08T18:57:04.586635] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T18:57:04.633149] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-08T18:57:04.735841] [DEBUG] [LOCAL ] FIS: Primary data saved (53350 records). [2025-10-08T18:57:04.736004] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-08T18:57:04.736111] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIS took 32.2s. Estimated remaining: 3h 33m 40s. Rate: 7.2 symbols/min [2025-10-08T18:57:05.857482] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T18:57:05.859902] [INFO ] [REMOTE ] FIX: Full fetch complete (45343 records). [2025-10-08T18:57:05.859990] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-08T18:57:06.244940] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-08T18:57:06.245032] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-08T18:57:06.245715] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-08T18:57:06.245778] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-08T18:57:06.246830] [DEBUG] [LOCAL ] FIX: Trimmed 45343 records to 29294 (keeping 200 days of data) [2025-10-08T18:57:06.427973] [DEBUG] [LOCAL ] FIX: Primary data saved (29294 records). [2025-10-08T18:57:06.428116] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-08T18:57:06.428203] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIX took 24.5s. Estimated remaining: 3h 33m 20s. Rate: 7.2 symbols/min [2025-10-08T18:57:06.949290] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:07.066694] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:07.173983] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:07.176835] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:07.177051] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-08T18:57:07.177278] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-08T18:57:07.177895] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-08T18:57:07.177963] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-08T18:57:07.178057] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-08T18:57:07.178130] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-08T18:57:07.223016] [DEBUG] [LOCAL ] FLC: Loaded 5372 existing records from primary storage. [2025-10-08T18:57:07.254228] [INFO ] [MAIN ] FLC: Loaded 5372 existing records. [2025-10-08T18:57:07.548121] [DEBUG] [LOCAL ] FLG: Loaded 53331 existing records from primary storage. [2025-10-08T18:57:07.584492] [DEBUG] [LOCAL ] FLNG: Loaded 33596 existing records from primary storage. [2025-10-08T18:57:07.639052] [INFO ] [MAIN ] FLG: Loaded 53331 existing records. [2025-10-08T18:57:07.633792] [INFO ] [MAIN ] FLNG: Loaded 33596 existing records. [2025-10-08T18:57:07.900472] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:08.014669] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-08T18:57:08.032121] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-08T18:57:08.080152] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-08T18:57:08.085487] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-08T18:57:08.281164] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:08.307905] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:08.367167] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:08.367556] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-08T18:57:08.367807] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-08T18:57:08.384764] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-08T18:57:08.397488] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-08T18:57:08.402806] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-08T18:57:08.413435] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-08T18:57:08.408258] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-08T18:57:08.418774] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-08T18:57:08.429206] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-08T18:57:08.771246] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:57:08.813602] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-08T18:57:08.840265] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:57:08.858134] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-08T18:57:08.929002] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:57:09.008727] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-08T18:57:09.072925] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-08T18:57:09.128253] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-08T18:57:09.131336] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:09.194313] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-08T18:57:09.225435] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-08T18:57:09.270379] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.8s. Estimated remaining: 3h 33m 1s. Rate: 7.2 symbols/min [2025-10-08T18:57:09.536879] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:09.574900] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:09.588986] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-08T18:57:09.588767] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-08T18:57:09.690863] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:09.743396] [DEBUG] [LOCAL ] FLO: Loaded 51949 existing records from primary storage. [2025-10-08T18:57:09.743782] [INFO ] [MAIN ] FLO: Loaded 51949 existing records. [2025-10-08T18:57:09.928553] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:09.928848] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-08T18:57:09.928897] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-08T18:57:09.929245] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-08T18:57:09.929307] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-08T18:57:10.037177] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T18:57:10.050150] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-08T18:57:10.292320] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:10.292714] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-08T18:57:10.723918] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T18:57:10.725842] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-08T18:57:11.164055] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T18:57:11.166084] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-08T18:57:11.188844] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:57:11.221261] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-08T18:57:11.226881] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T18:57:11.664530] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T18:57:11.925894] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:57:12.017514] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-08T18:57:12.452603] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T18:57:12.817594] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-08T18:57:13.446968] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T18:57:13.477831] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T18:57:13.617529] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-08T18:57:14.417597] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-08T18:57:15.017143] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:57:15.074939] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T18:57:15.217547] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-08T18:57:16.017573] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-08T18:57:16.817515] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-08T18:57:16.874567] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T18:57:17.458798] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T18:57:17.591735] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T18:57:17.617522] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-08T18:57:18.417581] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-08T18:57:18.884933] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T18:57:19.217548] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-08T18:57:19.925708] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:57:20.017496] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-08T18:57:20.705635] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:57:20.817511] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-08T18:57:21.617589] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-08T18:57:21.886504] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:57:21.920898] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T18:57:22.233965] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T18:57:22.417590] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-08T18:57:23.217530] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-08T18:57:23.834712] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T18:57:24.017565] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-08T18:57:24.719078] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T18:57:24.817512] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-08T18:57:25.531153] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T18:57:25.617493] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-08T18:57:26.417566] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-08T18:57:26.598544] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:57:26.818288] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T18:57:26.910615] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-08T18:57:27.217603] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-08T18:57:28.017632] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-08T18:57:28.598662] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T18:57:28.817565] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-08T18:57:28.861861] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T18:57:29.617561] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-08T18:57:30.242702] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T18:57:30.243539] [INFO ] [REMOTE ] FLC: Full fetch complete (7808 records). [2025-10-08T18:57:30.243611] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-08T18:57:30.419160] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-08T18:57:30.507270] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T18:57:30.753305] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-08T18:57:30.753452] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-08T18:57:30.753968] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-08T18:57:30.754052] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-08T18:57:30.755015] [DEBUG] [LOCAL ] FLC: Trimmed 7808 records to 5366 (keeping 200 days of data) [2025-10-08T18:57:30.801250] [DEBUG] [LOCAL ] FLC: Primary data saved (5366 records). [2025-10-08T18:57:30.801425] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-08T18:57:30.801557] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 24.4s. Estimated remaining: 3h 33m 17s. Rate: 7.2 symbols/min [2025-10-08T18:57:31.039443] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:31.039676] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-08T18:57:31.039811] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-08T18:57:31.039942] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-08T18:57:31.040006] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-08T18:57:31.040082] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-08T18:57:31.040139] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-08T18:57:31.222892] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-08T18:57:31.591083] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:31.976895] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:57:32.017569] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-08T18:57:32.229360] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:57:32.229725] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-08T18:57:32.229829] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:57:32.229907] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-08T18:57:32.229974] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:57:32.230045] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-08T18:57:32.230123] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-08T18:57:32.230180] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-08T18:57:32.230225] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-08T18:57:32.230276] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLOC took 1.4s. Estimated remaining: 3h 32m 56s. Rate: 7.2 symbols/min [2025-10-08T18:57:32.410729] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:32.408370] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T18:57:32.413992] [INFO ] [REMOTE ] FLNG: Full fetch complete (50284 records). [2025-10-08T18:57:32.414175] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-08T18:57:32.751516] [DEBUG] [LOCAL ] FLR: Loaded 53161 existing records from primary storage. [2025-10-08T18:57:32.772618] [INFO ] [MAIN ] FLR: Loaded 53161 existing records. [2025-10-08T18:57:32.821867] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-08T18:57:32.962461] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-08T18:57:32.962613] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-08T18:57:32.963750] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-08T18:57:32.964166] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-08T18:57:33.024719] [DEBUG] [LOCAL ] FLNG: Trimmed 50284 records to 33564 (keeping 200 days of data) [2025-10-08T18:57:33.047992] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:33.048502] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-08T18:57:33.048561] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-08T18:57:33.048919] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-08T18:57:33.048979] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-08T18:57:33.623928] [DEBUG] [LOCAL ] FLNG: Primary data saved (33564 records). [2025-10-08T18:57:33.629763] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-08T18:57:33.629928] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLNG took 27.2s. Estimated remaining: 3h 32m 35s. Rate: 7.2 symbols/min [2025-10-08T18:57:33.629622] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-08T18:57:33.662806] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:33.853801] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:33.898405] [DEBUG] [LOCAL ] FLS: Loaded 50242 existing records from primary storage. [2025-10-08T18:57:33.898845] [INFO ] [MAIN ] FLS: Loaded 50242 existing records. [2025-10-08T18:57:34.074555] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:34.074818] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-08T18:57:34.074873] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-08T18:57:34.075157] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-08T18:57:34.075218] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-08T18:57:34.426157] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:34.426222] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-08T18:57:34.473906] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T18:57:35.110955] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:57:35.217530] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-08T18:57:36.017560] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-08T18:57:36.054051] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:57:36.487961] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T18:57:36.817623] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-08T18:57:37.556215] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T18:57:37.617510] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-08T18:57:38.137624] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T18:57:38.417566] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-08T18:57:39.217571] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-08T18:57:39.382232] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:57:40.018229] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-08T18:57:40.024594] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T18:57:40.540357] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:57:40.817588] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-08T18:57:41.617607] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-08T18:57:41.719106] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T18:57:42.283175] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T18:57:42.417562] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-08T18:57:43.116409] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:57:43.217508] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-08T18:57:44.017627] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-08T18:57:44.110049] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T18:57:44.719352] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:57:44.723382] [INFO ] [REMOTE ] FLG: Full fetch complete (77295 records). [2025-10-08T18:57:44.723504] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-08T18:57:44.822553] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-08T18:57:45.113584] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-08T18:57:45.113727] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-08T18:57:45.114625] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-08T18:57:45.114702] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-08T18:57:45.116142] [DEBUG] [LOCAL ] FLG: Trimmed 77295 records to 53325 (keeping 200 days of data) [2025-10-08T18:57:45.449103] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:57:45.480229] [DEBUG] [LOCAL ] FLG: Primary data saved (53325 records). [2025-10-08T18:57:45.480368] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-08T18:57:45.480455] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLG took 39.0s. Estimated remaining: 3h 32m 33s. Rate: 7.2 symbols/min [2025-10-08T18:57:45.623253] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-08T18:57:45.648253] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:45.695449] [DEBUG] [LOCAL ] FLUT: Loaded 50783 existing records from primary storage. [2025-10-08T18:57:45.695809] [INFO ] [MAIN ] FLUT: Loaded 50783 existing records. [2025-10-08T18:57:45.869778] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:45.870008] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-08T18:57:45.870054] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-08T18:57:45.870262] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-08T18:57:45.870318] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-08T18:57:46.219979] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:46.417495] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-08T18:57:46.741977] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T18:57:46.818733] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T18:57:47.217615] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-08T18:57:48.017519] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-08T18:57:48.120816] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T18:57:48.817515] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-08T18:57:48.898094] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T18:57:48.901971] [INFO ] [REMOTE ] FLO: Full fetch complete (75053 records). [2025-10-08T18:57:48.902078] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-08T18:57:49.290453] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-08T18:57:49.290708] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-08T18:57:49.291710] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-08T18:57:49.291776] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-08T18:57:49.293208] [DEBUG] [LOCAL ] FLO: Trimmed 75053 records to 51950 (keeping 200 days of data) [2025-10-08T18:57:49.620463] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-08T18:57:49.626500] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T18:57:49.655735] [DEBUG] [LOCAL ] FLO: Primary data saved (51950 records). [2025-10-08T18:57:49.655855] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-08T18:57:49.655944] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLO took 40.3s. Estimated remaining: 3h 32m 17s. Rate: 7.2 symbols/min [2025-10-08T18:57:49.825196] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:49.846561] [DEBUG] [LOCAL ] FLXR: Loaded 20685 existing records from primary storage. [2025-10-08T18:57:49.846947] [INFO ] [MAIN ] FLXR: Loaded 20685 existing records. [2025-10-08T18:57:50.028980] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:50.029246] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-08T18:57:50.029293] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-08T18:57:50.029590] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-08T18:57:50.029680] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-08T18:57:50.392530] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:50.423637] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-08T18:57:50.433876] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T18:57:51.104207] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:57:51.186522] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:57:51.217579] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-08T18:57:52.017709] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-08T18:57:52.817511] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-08T18:57:52.999440] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T18:57:53.558237] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:57:53.617578] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-08T18:57:54.093262] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T18:57:54.417683] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-08T18:57:54.419541] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T18:57:55.217565] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-08T18:57:55.980934] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T18:57:56.017500] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-08T18:57:56.669471] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:57:56.817540] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-08T18:57:57.617519] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-08T18:57:57.732151] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:57:58.027548] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T18:57:58.417547] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-08T18:57:59.217525] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-08T18:57:59.427520] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:57:59.750484] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T18:58:00.017564] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-08T18:58:00.817511] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-08T18:58:01.012871] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T18:58:01.212837] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T18:58:01.617582] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-08T18:58:02.312498] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:58:02.417534] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-08T18:58:03.217518] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-08T18:58:03.374025] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T18:58:04.017548] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-08T18:58:04.105967] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T18:58:04.555063] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T18:58:04.588086] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:58:04.817525] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-08T18:58:05.617560] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-08T18:58:06.346795] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:58:06.417516] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-08T18:58:07.217564] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-08T18:58:07.316968] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:58:07.321764] [INFO ] [REMOTE ] FLR: Full fetch complete (76476 records). [2025-10-08T18:58:07.321891] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-08T18:58:07.709470] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-08T18:58:07.709558] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-08T18:58:07.710505] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-08T18:58:07.710572] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-08T18:58:07.712113] [DEBUG] [LOCAL ] FLR: Trimmed 76476 records to 53168 (keeping 200 days of data) [2025-10-08T18:58:07.950259] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T18:58:08.026862] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-08T18:58:08.077825] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:58:08.092530] [DEBUG] [LOCAL ] FLR: Primary data saved (53168 records). [2025-10-08T18:58:08.092787] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-08T18:58:08.093162] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLR took 35.9s. Estimated remaining: 3h 32m 27s. Rate: 7.2 symbols/min [2025-10-08T18:58:08.263854] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:08.312515] [DEBUG] [LOCAL ] FMC: Loaded 51806 existing records from primary storage. [2025-10-08T18:58:08.312891] [INFO ] [MAIN ] FMC: Loaded 51806 existing records. [2025-10-08T18:58:08.490020] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:08.490198] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-08T18:58:08.490249] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-08T18:58:08.490552] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-08T18:58:08.490613] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-08T18:58:08.820089] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-08T18:58:08.846782] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:09.617551] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-08T18:58:09.716145] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T18:58:09.721553] [INFO ] [REMOTE ] FLS: Full fetch complete (71814 records). [2025-10-08T18:58:09.721726] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-08T18:58:09.996309] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T18:58:10.134158] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-08T18:58:10.134261] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-08T18:58:10.135256] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-08T18:58:10.135325] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-08T18:58:10.137138] [DEBUG] [LOCAL ] FLS: Trimmed 71814 records to 50253 (keeping 200 days of data) [2025-10-08T18:58:10.422345] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-08T18:58:10.455482] [DEBUG] [LOCAL ] FLS: Primary data saved (50253 records). [2025-10-08T18:58:10.455668] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-08T18:58:10.455792] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLS took 36.8s. Estimated remaining: 3h 32m 8s. Rate: 7.2 symbols/min [2025-10-08T18:58:10.622899] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:10.631338] [DEBUG] [LOCAL ] FMN: Loaded 5266 existing records from primary storage. [2025-10-08T18:58:10.631535] [INFO ] [MAIN ] FMN: Loaded 5266 existing records. [2025-10-08T18:58:10.808870] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:10.809125] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-08T18:58:10.809173] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-08T18:58:10.809391] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-08T18:58:10.809448] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-08T18:58:11.179931] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:11.217554] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-08T18:58:11.249496] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T18:58:11.451600] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T18:58:12.017569] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-08T18:58:12.819210] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-08T18:58:12.821031] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:58:12.904837] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T18:58:13.617565] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-08T18:58:14.298272] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T18:58:14.417572] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-08T18:58:14.626997] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T18:58:15.198983] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T18:58:15.217499] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-08T18:58:16.017564] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-08T18:58:16.165737] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T18:58:16.817570] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-08T18:58:17.594169] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T18:58:17.617505] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-08T18:58:17.636346] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T18:58:17.638885] [INFO ] [REMOTE ] FLXR: Full fetch complete (26195 records). [2025-10-08T18:58:17.638988] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-08T18:58:18.040312] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-08T18:58:18.040408] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-08T18:58:18.040999] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-08T18:58:18.041064] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-08T18:58:18.041827] [DEBUG] [LOCAL ] FLXR: Trimmed 26195 records to 20757 (keeping 200 days of data) [2025-10-08T18:58:18.172991] [DEBUG] [LOCAL ] FLXR: Primary data saved (20757 records). [2025-10-08T18:58:18.173126] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-08T18:58:18.173207] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLXR took 28.5s. Estimated remaining: 3h 31m 58s. Rate: 7.2 symbols/min [2025-10-08T18:58:18.367237] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T18:58:18.371078] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:18.402268] [DEBUG] [LOCAL ] FMS: Loaded 29997 existing records from primary storage. [2025-10-08T18:58:18.402570] [INFO ] [MAIN ] FMS: Loaded 29997 existing records. [2025-10-08T18:58:18.422730] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-08T18:58:18.598925] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:18.599343] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-08T18:58:18.599390] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-08T18:58:18.599615] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-08T18:58:18.599701] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-08T18:58:18.951403] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:19.217563] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-08T18:58:20.017549] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-08T18:58:20.149624] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T18:58:20.153528] [INFO ] [REMOTE ] FLUT: Full fetch complete (73029 records). [2025-10-08T18:58:20.153677] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-08T18:58:20.446183] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T18:58:20.570779] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-08T18:58:20.570865] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-08T18:58:20.571814] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-08T18:58:20.571885] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-08T18:58:20.573408] [DEBUG] [LOCAL ] FLUT: Trimmed 73029 records to 50781 (keeping 200 days of data) [2025-10-08T18:58:20.842596] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-08T18:58:20.881602] [DEBUG] [LOCAL ] FLUT: Primary data saved (50781 records). [2025-10-08T18:58:20.881745] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-08T18:58:20.881845] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 35.4s. Estimated remaining: 3h 31m 40s. Rate: 7.2 symbols/min [2025-10-08T18:58:21.047572] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:21.089095] [DEBUG] [LOCAL ] FMX: Loaded 40660 existing records from primary storage. [2025-10-08T18:58:21.089482] [INFO ] [MAIN ] FMX: Loaded 40660 existing records. [2025-10-08T18:58:21.268840] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:21.269068] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-08T18:58:21.269116] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-08T18:58:21.269354] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-08T18:58:21.269412] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-08T18:58:21.618868] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-08T18:58:21.630534] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:21.632879] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T18:58:21.879362] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T18:58:22.417510] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-08T18:58:22.795524] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T18:58:23.217614] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-08T18:58:23.815563] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T18:58:23.855670] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T18:58:24.017572] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-08T18:58:24.783926] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T18:58:24.817619] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-08T18:58:25.552489] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T18:58:25.617563] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-08T18:58:26.417587] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-08T18:58:26.999025] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T18:58:27.217522] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-08T18:58:27.531325] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:58:27.726111] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-08T18:58:28.017572] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-08T18:58:28.817563] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-08T18:58:29.315291] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:58:29.416628] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T18:58:29.617603] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-08T18:58:30.417513] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-08T18:58:30.891512] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T18:58:31.217569] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-08T18:58:31.856037] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:58:32.017561] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-08T18:58:32.697981] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:58:32.817571] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-08T18:58:33.397924] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T18:58:33.580402] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T18:58:33.617572] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-08T18:58:34.417561] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-08T18:58:34.922742] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T18:58:35.217561] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-08T18:58:35.714436] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T18:58:36.017601] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-08T18:58:36.817592] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-08T18:58:36.898672] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:58:37.617611] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-08T18:58:38.000956] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T18:58:38.186545] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T18:58:38.417553] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-08T18:58:38.793534] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T18:58:38.917892] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T18:58:39.217586] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-08T18:58:40.017563] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-08T18:58:40.319940] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T18:58:40.817592] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-08T18:58:41.301228] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T18:58:41.311361] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T18:58:41.617573] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-08T18:58:42.077414] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T18:58:42.078530] [INFO ] [REMOTE ] FMN: Full fetch complete (9962 records). [2025-10-08T18:58:42.078616] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-08T18:58:42.421327] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-08T18:58:42.454566] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-08T18:58:42.455943] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-08T18:58:42.456263] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-08T18:58:42.456306] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-08T18:58:42.457088] [DEBUG] [LOCAL ] FMN: Trimmed 9962 records to 5285 (keeping 200 days of data) [2025-10-08T18:58:42.491072] [DEBUG] [LOCAL ] FMN: Primary data saved (5285 records). [2025-10-08T18:58:42.491195] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-08T18:58:42.491548] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 32.0s. Estimated remaining: 3h 31m 55s. Rate: 7.2 symbols/min [2025-10-08T18:58:42.665408] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:42.669527] [DEBUG] [LOCAL ] FMY: Loaded 1385 existing records from primary storage. [2025-10-08T18:58:42.669709] [INFO ] [MAIN ] FMY: Loaded 1385 existing records. [2025-10-08T18:58:42.891046] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:42.891321] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-08T18:58:42.891370] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-08T18:58:42.891550] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-08T18:58:42.891609] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-08T18:58:43.222844] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-08T18:58:43.262178] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:43.736980] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T18:58:44.017548] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-08T18:58:44.640730] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T18:58:44.817543] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-08T18:58:45.126020] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:58:45.617566] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-08T18:58:46.127444] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T18:58:46.417575] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-08T18:58:46.931873] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:58:47.217628] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-08T18:58:47.487364] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-08T18:58:47.897966] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:58:48.017547] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-08T18:58:48.817577] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-08T18:58:49.592128] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T18:58:49.617539] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-08T18:58:49.968420] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T18:58:49.970896] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T18:58:49.975087] [INFO ] [REMOTE ] FMS: Full fetch complete (42445 records). [2025-10-08T18:58:49.975193] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-08T18:58:50.403236] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-08T18:58:50.403339] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-08T18:58:50.404079] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-08T18:58:50.404176] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-08T18:58:50.405380] [DEBUG] [LOCAL ] FMS: Trimmed 42445 records to 29995 (keeping 200 days of data) [2025-10-08T18:58:50.461814] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-08T18:58:50.593817] [DEBUG] [LOCAL ] FMS: Primary data saved (29995 records). [2025-10-08T18:58:50.593985] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-08T18:58:50.594093] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMS took 32.4s. Estimated remaining: 3h 31m 46s. Rate: 7.2 symbols/min [2025-10-08T18:58:50.762666] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:50.799340] [DEBUG] [LOCAL ] FN: Loaded 38245 existing records from primary storage. [2025-10-08T18:58:50.799677] [INFO ] [MAIN ] FN: Loaded 38245 existing records. [2025-10-08T18:58:50.987121] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:50.987468] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-08T18:58:50.987558] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-08T18:58:50.987891] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-08T18:58:50.987951] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-08T18:58:51.227401] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-08T18:58:51.356202] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:51.711779] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T18:58:51.957569] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:58:52.017504] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-08T18:58:52.817563] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-08T18:58:53.282706] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T18:58:53.285684] [INFO ] [REMOTE ] FMX: Full fetch complete (57622 records). [2025-10-08T18:58:53.285773] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-08T18:58:53.632448] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-08T18:58:53.689873] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-08T18:58:53.689984] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-08T18:58:53.691214] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-08T18:58:53.691280] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-08T18:58:53.692679] [DEBUG] [LOCAL ] FMX: Trimmed 57622 records to 40585 (keeping 200 days of data) [2025-10-08T18:58:53.944723] [DEBUG] [LOCAL ] FMX: Primary data saved (40585 records). [2025-10-08T18:58:53.944858] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-08T18:58:53.944953] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMX took 33.1s. Estimated remaining: 3h 31m 29s. Rate: 7.2 symbols/min [2025-10-08T18:58:54.145406] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:54.165824] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:58:54.221545] [DEBUG] [LOCAL ] FNB: Loaded 52527 existing records from primary storage. [2025-10-08T18:58:54.221940] [INFO ] [MAIN ] FNB: Loaded 52527 existing records. [2025-10-08T18:58:54.415075] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:54.415315] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-08T18:58:54.415361] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-08T18:58:54.415593] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-08T18:58:54.415685] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-08T18:58:54.426719] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-08T18:58:54.792209] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:55.217520] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-08T18:58:55.476446] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T18:58:55.566919] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-08T18:58:55.950915] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T18:58:56.017578] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-08T18:58:56.817558] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-08T18:58:57.334956] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:58:57.617549] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-08T18:58:58.417518] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-08T18:58:58.636089] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T18:58:58.640952] [INFO ] [REMOTE ] FMC: Full fetch complete (75140 records). [2025-10-08T18:58:58.641094] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-08T18:58:58.913565] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T18:58:59.107166] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-08T18:58:59.107275] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-08T18:58:59.108216] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-08T18:58:59.108302] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-08T18:58:59.110295] [DEBUG] [LOCAL ] FMC: Trimmed 75140 records to 51801 (keeping 200 days of data) [2025-10-08T18:58:59.134551] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T18:58:59.229409] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-08T18:58:59.466705] [DEBUG] [LOCAL ] FMC: Primary data saved (51801 records). [2025-10-08T18:58:59.466882] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-08T18:58:59.466976] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMC took 51.4s. Estimated remaining: 3h 31m 15s. Rate: 7.2 symbols/min [2025-10-08T18:58:59.619570] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-08T18:58:59.645089] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:59.693971] [DEBUG] [LOCAL ] FND: Loaded 52089 existing records from primary storage. [2025-10-08T18:58:59.694337] [INFO ] [MAIN ] FND: Loaded 52089 existing records. [2025-10-08T18:58:59.875985] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:59.876167] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-08T18:58:59.876215] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-08T18:58:59.876466] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-08T18:58:59.876523] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-08T18:59:00.022689] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-08T18:59:00.228576] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:00.491584] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:59:00.817558] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-08T18:59:01.617554] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-08T18:59:02.417472] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-08T18:59:02.460025] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T18:59:02.954929] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T18:59:03.217599] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-08T18:59:04.025960] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-08T18:59:04.032513] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T18:59:04.375054] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T18:59:04.540273] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:59:04.817614] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-08T18:59:05.617580] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-08T18:59:06.065403] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T18:59:06.417629] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-08T18:59:06.570429] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T18:59:06.795127] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-08T18:59:07.217610] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-08T18:59:08.017623] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-08T18:59:08.416263] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T18:59:08.417500] [INFO ] [REMOTE ] FMY: Full fetch complete (1961 records). [2025-10-08T18:59:08.418868] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T18:59:08.419068] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-08T18:59:08.790108] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-08T18:59:08.790201] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-08T18:59:08.790295] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-08T18:59:08.790333] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-08T18:59:08.790709] [DEBUG] [LOCAL ] FMY: Trimmed 1961 records to 1384 (keeping 200 days of data) [2025-10-08T18:59:08.799948] [DEBUG] [LOCAL ] FMY: Primary data saved (1384 records). [2025-10-08T18:59:08.800024] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-08T18:59:08.800113] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 26.3s. Estimated remaining: 3h 31m 9s. Rate: 7.2 symbols/min [2025-10-08T18:59:08.822746] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-08T18:59:08.976253] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:09.023287] [DEBUG] [LOCAL ] FNF: Loaded 48940 existing records from primary storage. [2025-10-08T18:59:09.023610] [INFO ] [MAIN ] FNF: Loaded 48940 existing records. [2025-10-08T18:59:09.199971] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:09.200280] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-08T18:59:09.200345] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-08T18:59:09.200634] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-08T18:59:09.200882] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-08T18:59:09.561546] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:09.617556] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-08T18:59:10.296280] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:59:10.417584] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-08T18:59:10.816474] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:59:11.217634] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-08T18:59:12.022896] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-08T18:59:12.028017] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:59:12.777788] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T18:59:12.817511] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-08T18:59:13.617593] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-08T18:59:13.895636] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:59:14.401359] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T18:59:14.417483] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-08T18:59:15.156947] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T18:59:15.217514] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-08T18:59:16.022639] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-08T18:59:16.043250] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:59:16.801399] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T18:59:16.817502] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-08T18:59:17.623356] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-08T18:59:17.634814] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T18:59:17.809382] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T18:59:18.417535] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-08T18:59:19.002953] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T18:59:19.217537] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-08T18:59:19.839094] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T18:59:20.017565] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-08T18:59:20.817546] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-08T18:59:20.924441] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T18:59:21.231227] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:59:21.233885] [INFO ] [REMOTE ] FN: Full fetch complete (56068 records). [2025-10-08T18:59:21.234016] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-08T18:59:21.623784] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-08T18:59:21.624755] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-08T18:59:21.625817] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-08T18:59:21.626771] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-08T18:59:21.626976] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-08T18:59:21.628439] [DEBUG] [LOCAL ] FN: Trimmed 56068 records to 38138 (keeping 200 days of data) [2025-10-08T18:59:21.874601] [DEBUG] [LOCAL ] FN: Primary data saved (38138 records). [2025-10-08T18:59:21.874791] [INFO ] [MAIN ] FN: Full history saved. [2025-10-08T18:59:21.874881] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 31.3s. Estimated remaining: 3h 31m 9s. Rate: 7.2 symbols/min [2025-10-08T18:59:22.049977] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:22.092491] [DEBUG] [LOCAL ] FNV: Loaded 46152 existing records from primary storage. [2025-10-08T18:59:22.092899] [INFO ] [MAIN ] FNV: Loaded 46152 existing records. [2025-10-08T18:59:22.277205] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:22.277614] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-08T18:59:22.277723] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-08T18:59:22.278426] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-08T18:59:22.278670] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-08T18:59:22.427785] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-08T18:59:22.434960] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T18:59:22.697164] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:23.217527] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-08T18:59:23.368125] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T18:59:24.017564] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-08T18:59:24.109336] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:59:24.754196] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:59:24.817527] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-08T18:59:25.596011] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:59:25.617502] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-08T18:59:26.390596] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:59:26.417538] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-08T18:59:27.070918] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:59:27.217578] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-08T18:59:27.728636] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T18:59:28.017552] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-08T18:59:28.543898] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:59:28.817616] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-08T18:59:29.307583] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T18:59:29.617535] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-08T18:59:30.185479] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T18:59:30.417549] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-08T18:59:31.000461] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:59:31.217567] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-08T18:59:32.017628] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-08T18:59:32.181137] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:59:32.817553] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-08T18:59:33.100883] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T18:59:33.617576] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-08T18:59:33.716169] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T18:59:34.417525] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-08T18:59:34.522930] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:59:35.007664] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:59:35.217561] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-08T18:59:36.017514] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-08T18:59:36.137394] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T18:59:36.817560] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-08T18:59:36.846472] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T18:59:37.391337] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:59:37.617562] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-08T18:59:38.417578] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-08T18:59:38.507173] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T18:59:39.217508] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-08T18:59:39.246132] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:59:40.018975] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-08T18:59:40.022112] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T18:59:40.722406] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:59:40.726318] [INFO ] [REMOTE ] FND: Full fetch complete (74725 records). [2025-10-08T18:59:40.726444] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-08T18:59:40.825281] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-08T18:59:41.130089] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-08T18:59:41.130215] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-08T18:59:41.131176] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-08T18:59:41.131246] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-08T18:59:41.132855] [DEBUG] [LOCAL ] FND: Trimmed 74725 records to 52108 (keeping 200 days of data) [2025-10-08T18:59:41.452035] [DEBUG] [LOCAL ] FND: Primary data saved (52108 records). [2025-10-08T18:59:41.452192] [INFO ] [MAIN ] FND: Full history saved. [2025-10-08T18:59:41.452280] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FND took 42.0s. Estimated remaining: 3h 31m 20s. Rate: 7.2 symbols/min [2025-10-08T18:59:41.627675] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:41.624290] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-08T18:59:41.647053] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T18:59:41.651520] [INFO ] [REMOTE ] FNB: Full fetch complete (75888 records). [2025-10-08T18:59:41.656691] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-08T18:59:41.657195] [DEBUG] [LOCAL ] FOA: Loaded 13075 existing records from primary storage. [2025-10-08T18:59:41.657532] [INFO ] [MAIN ] FOA: Loaded 13075 existing records. [2025-10-08T18:59:42.015493] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:42.015870] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-08T18:59:42.015962] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-08T18:59:42.016294] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-08T18:59:42.016353] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-08T18:59:42.640155] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-08T18:59:42.639994] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:42.640842] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-08T18:59:42.640923] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-08T18:59:42.642976] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-08T18:59:42.643222] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-08T18:59:42.671400] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T18:59:42.671547] [DEBUG] [LOCAL ] FNB: Trimmed 75888 records to 52530 (keeping 200 days of data) [2025-10-08T18:59:43.006434] [DEBUG] [LOCAL ] FNB: Primary data saved (52530 records). [2025-10-08T18:59:43.006669] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-08T18:59:43.006855] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNB took 49.1s. Estimated remaining: 3h 30m 60s. Rate: 7.2 symbols/min [2025-10-08T18:59:43.129996] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T18:59:43.167266] [INFO ] [REMOTE ] FNF: Full fetch complete (69698 records). [2025-10-08T18:59:43.180960] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-08T18:59:43.233355] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-08T18:59:43.224440] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:43.367631] [DEBUG] [LOCAL ] FOF: Loaded 8500 existing records from primary storage. [2025-10-08T18:59:43.398224] [INFO ] [MAIN ] FOF: Loaded 8500 existing records. [2025-10-08T18:59:43.684507] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T18:59:43.837155] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:43.840960] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-08T18:59:43.841138] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-08T18:59:43.841252] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-08T18:59:43.841341] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-08T18:59:43.842365] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-08T18:59:43.842451] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-08T18:59:43.842532] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-08T18:59:43.842705] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-08T18:59:43.947781] [DEBUG] [LOCAL ] FNF: Trimmed 69698 records to 48933 (keeping 200 days of data) [2025-10-08T18:59:44.057725] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-08T18:59:44.331861] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:44.549686] [DEBUG] [LOCAL ] FNF: Primary data saved (48933 records). [2025-10-08T18:59:44.549865] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-08T18:59:44.549968] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNF took 35.7s. Estimated remaining: 3h 30m 39s. Rate: 7.2 symbols/min [2025-10-08T18:59:44.764811] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T18:59:44.777147] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:44.798558] [DEBUG] [LOCAL ] FOR: Loaded 19691 existing records from primary storage. [2025-10-08T18:59:44.798863] [INFO ] [MAIN ] FOR: Loaded 19691 existing records. [2025-10-08T18:59:44.828954] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-08T18:59:44.984304] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:44.984698] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-08T18:59:44.984927] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-08T18:59:44.998073] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-08T18:59:44.998792] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T18:59:44.998935] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-08T18:59:45.363803] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:45.617566] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-08T18:59:45.638403] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T18:59:46.417583] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-08T18:59:47.128911] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T18:59:47.175557] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:59:47.217492] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-08T18:59:48.017571] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-08T18:59:48.157865] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T18:59:48.817595] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-08T18:59:49.600215] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T18:59:49.604595] [INFO ] [REMOTE ] FNV: Full fetch complete (66524 records). [2025-10-08T18:59:49.604787] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-08T18:59:49.627220] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-08T18:59:49.921494] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:59:50.017532] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-08T18:59:50.017661] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-08T18:59:50.018502] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-08T18:59:50.018562] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-08T18:59:50.019833] [DEBUG] [LOCAL ] FNV: Trimmed 66524 records to 46166 (keeping 200 days of data) [2025-10-08T18:59:50.311783] [DEBUG] [LOCAL ] FNV: Primary data saved (46166 records). [2025-10-08T18:59:50.311939] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-08T18:59:50.312052] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 28.4s. Estimated remaining: 3h 30m 26s. Rate: 7.2 symbols/min [2025-10-08T18:59:50.422733] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-08T18:59:50.489218] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:50.497042] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T18:59:50.541412] [DEBUG] [LOCAL ] FOUR: Loaded 49599 existing records from primary storage. [2025-10-08T18:59:50.541783] [INFO ] [MAIN ] FOUR: Loaded 49599 existing records. [2025-10-08T18:59:50.720822] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:50.721073] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-08T18:59:50.721123] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-08T18:59:50.721375] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-08T18:59:50.721431] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-08T18:59:51.077056] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:51.217501] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-08T18:59:51.548830] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T18:59:52.017596] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-08T18:59:52.817565] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-08T18:59:52.968739] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T18:59:53.181998] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-08T18:59:53.573083] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T18:59:53.617557] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-08T18:59:54.310621] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T18:59:54.417519] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-08T18:59:55.166754] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T18:59:55.217516] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-08T18:59:56.018975] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-08T18:59:56.021016] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T18:59:56.817531] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-08T18:59:57.317913] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T18:59:57.541471] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T18:59:57.617511] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-08T18:59:58.417503] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-08T18:59:58.435985] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T18:59:59.132564] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T18:59:59.217577] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-08T18:59:59.997968] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T19:00:00.017512] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-08T19:00:00.817599] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-08T19:00:01.216960] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T19:00:01.347898] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T19:00:01.617592] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-08T19:00:02.417615] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-08T19:00:02.528081] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T19:00:03.217634] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-08T19:00:03.259767] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T19:00:04.017558] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-08T19:00:04.304723] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:00:04.722021] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T19:00:04.817567] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-08T19:00:05.617559] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-08T19:00:05.629475] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T19:00:06.417532] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-08T19:00:07.136046] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:00:07.217499] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-08T19:00:07.298777] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:00:08.017566] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-08T19:00:08.817522] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-08T19:00:08.924434] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T19:00:09.017936] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T19:00:09.593512] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T19:00:09.595295] [INFO ] [REMOTE ] FOR: Full fetch complete (29818 records). [2025-10-08T19:00:09.595400] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-08T19:00:09.625452] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-08T19:00:09.982492] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-08T19:00:09.982579] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-08T19:00:09.983137] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-08T19:00:09.983200] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-08T19:00:09.984068] [DEBUG] [LOCAL ] FOR: Trimmed 29818 records to 19696 (keeping 200 days of data) [2025-10-08T19:00:10.104010] [DEBUG] [LOCAL ] FOR: Primary data saved (19696 records). [2025-10-08T19:00:10.104168] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-08T19:00:10.104261] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOR took 25.6s. Estimated remaining: 3h 30m 38s. Rate: 7.2 symbols/min [2025-10-08T19:00:10.270340] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:10.293573] [DEBUG] [LOCAL ] FPF: Loaded 18492 existing records from primary storage. [2025-10-08T19:00:10.293877] [INFO ] [MAIN ] FPF: Loaded 18492 existing records. [2025-10-08T19:00:10.422682] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-08T19:00:10.478243] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:10.479129] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-08T19:00:10.479180] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-08T19:00:10.479491] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-08T19:00:10.479549] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-08T19:00:10.860130] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:10.863473] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T19:00:11.217614] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-08T19:00:12.017524] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-08T19:00:12.250627] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:00:12.252406] [INFO ] [REMOTE ] FOA: Full fetch complete (22178 records). [2025-10-08T19:00:12.252523] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-08T19:00:12.553291] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T19:00:12.551554] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T19:00:12.687762] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-08T19:00:12.687850] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-08T19:00:12.688353] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-08T19:00:12.688392] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-08T19:00:12.689116] [DEBUG] [LOCAL ] FOA: Trimmed 22178 records to 13062 (keeping 200 days of data) [2025-10-08T19:00:12.765299] [DEBUG] [LOCAL ] FOA: Primary data saved (13062 records). [2025-10-08T19:00:12.765434] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-08T19:00:12.765518] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOA took 31.3s. Estimated remaining: 3h 30m 20s. Rate: 7.2 symbols/min [2025-10-08T19:00:12.826076] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-08T19:00:12.938788] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:12.957695] [DEBUG] [LOCAL ] FPH: Loaded 19275 existing records from primary storage. [2025-10-08T19:00:12.957955] [INFO ] [MAIN ] FPH: Loaded 19275 existing records. [2025-10-08T19:00:13.132424] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:13.132686] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-08T19:00:13.132759] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-08T19:00:13.132963] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-08T19:00:13.133024] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-08T19:00:13.478075] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:13.617540] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-08T19:00:14.417587] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-08T19:00:14.546124] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T19:00:14.693867] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T19:00:14.988181] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T19:00:15.217603] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-08T19:00:16.017733] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-08T19:00:16.537703] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:00:16.817566] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-08T19:00:17.474136] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T19:00:17.478410] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T19:00:17.479149] [INFO ] [REMOTE ] FOF: Full fetch complete (11897 records). [2025-10-08T19:00:17.494589] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-08T19:00:17.622749] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-08T19:00:17.906331] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-08T19:00:17.906408] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-08T19:00:17.906718] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-08T19:00:17.906780] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-08T19:00:17.907219] [DEBUG] [LOCAL ] FOF: Trimmed 11897 records to 8522 (keeping 200 days of data) [2025-10-08T19:00:17.963231] [DEBUG] [LOCAL ] FOF: Primary data saved (8522 records). [2025-10-08T19:00:17.963375] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-08T19:00:17.963461] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOF took 35.0s. Estimated remaining: 3h 30m 6s. Rate: 7.2 symbols/min [2025-10-08T19:00:18.140305] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:18.175914] [DEBUG] [LOCAL ] FPI: Loaded 31067 existing records from primary storage. [2025-10-08T19:00:18.176222] [INFO ] [MAIN ] FPI: Loaded 31067 existing records. [2025-10-08T19:00:18.370367] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:18.370622] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-08T19:00:18.370714] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-08T19:00:18.370947] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-08T19:00:18.371024] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-08T19:00:18.423611] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-08T19:00:18.717548] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T19:00:18.787100] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:19.217630] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-08T19:00:20.017517] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-08T19:00:20.176914] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T19:00:20.346491] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T19:00:20.616679] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T19:00:20.817577] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-08T19:00:21.526527] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T19:00:21.617550] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-08T19:00:22.417637] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-08T19:00:22.978558] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:00:23.217598] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-08T19:00:23.790576] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:00:24.017592] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-08T19:00:24.113116] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T19:00:24.817553] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-08T19:00:25.075343] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T19:00:25.574572] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:00:25.617567] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-08T19:00:26.229963] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T19:00:26.417582] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-08T19:00:27.217586] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-08T19:00:28.017559] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-08T19:00:28.201733] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T19:00:28.363118] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T19:00:28.817607] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-08T19:00:29.146845] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T19:00:29.617537] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-08T19:00:29.777077] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T19:00:30.417546] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-08T19:00:30.660257] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:00:31.217557] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-08T19:00:31.829155] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T19:00:32.017550] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-08T19:00:32.216827] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:00:32.817557] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-08T19:00:32.982110] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T19:00:33.580476] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T19:00:33.617550] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-08T19:00:34.368765] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:00:34.417513] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-08T19:00:35.217565] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-08T19:00:36.017598] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-08T19:00:36.102146] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T19:00:36.104256] [INFO ] [REMOTE ] FPH: Full fetch complete (31244 records). [2025-10-08T19:00:36.104463] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-08T19:00:36.397095] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-08T19:00:36.434711] [INFO ] [REMOTE ] FOUR: Full fetch complete (72038 records). [2025-10-08T19:00:36.450567] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-08T19:00:36.628936] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-08T19:00:36.634492] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-08T19:00:36.635324] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-08T19:00:36.640532] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-08T19:00:36.705615] [DEBUG] [LOCAL ] FPH: Trimmed 31244 records to 19300 (keeping 200 days of data) [2025-10-08T19:00:36.854968] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-08T19:00:37.059916] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-08T19:00:37.061131] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-08T19:00:37.065022] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-08T19:00:37.065603] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-08T19:00:37.074694] [DEBUG] [LOCAL ] FOUR: Trimmed 72038 records to 49586 (keeping 200 days of data) [2025-10-08T19:00:37.162153] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T19:00:37.213204] [DEBUG] [LOCAL ] FPH: Primary data saved (19300 records). [2025-10-08T19:00:37.213933] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-08T19:00:37.214303] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPH took 24.4s. Estimated remaining: 3h 30m 17s. Rate: 7.2 symbols/min [2025-10-08T19:00:37.395023] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:37.532489] [DEBUG] [LOCAL ] FR: Loaded 46429 existing records from primary storage. [2025-10-08T19:00:37.533990] [INFO ] [MAIN ] FR: Loaded 46429 existing records. [2025-10-08T19:00:37.635191] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-08T19:00:37.723352] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:37.725454] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-08T19:00:37.726278] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-08T19:00:37.726879] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-08T19:00:37.726945] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-08T19:00:38.191947] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:38.209544] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T19:00:38.227407] [DEBUG] [LOCAL ] FOUR: Primary data saved (49586 records). [2025-10-08T19:00:38.227551] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-08T19:00:38.227635] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FOUR took 47.9s. Estimated remaining: 3h 29m 55s. Rate: 7.2 symbols/min [2025-10-08T19:00:38.394215] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:38.410162] [DEBUG] [LOCAL ] FRA: Loaded 14607 existing records from primary storage. [2025-10-08T19:00:38.410402] [INFO ] [MAIN ] FRA: Loaded 14607 existing records. [2025-10-08T19:00:38.423447] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-08T19:00:38.588915] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:38.589144] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-08T19:00:38.589192] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-08T19:00:38.589374] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-08T19:00:38.589431] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-08T19:00:38.967775] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:39.115332] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:00:39.217520] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-08T19:00:40.017520] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-08T19:00:40.049401] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T19:00:40.301299] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T19:00:40.817553] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-08T19:00:40.898765] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T19:00:41.617545] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-08T19:00:42.333459] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:00:42.417550] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-08T19:00:42.609068] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T19:00:43.217554] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-08T19:00:43.939538] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T19:00:44.017572] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-08T19:00:44.288303] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T19:00:44.817627] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-08T19:00:44.870316] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T19:00:45.617548] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-08T19:00:46.417580] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-08T19:00:46.436060] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:00:46.565302] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T19:00:47.217509] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-08T19:00:47.236934] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T19:00:48.017605] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-08T19:00:48.817526] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-08T19:00:48.942826] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T19:00:49.263574] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T19:00:49.617538] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-08T19:00:49.694728] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T19:00:50.417529] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-08T19:00:50.552247] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T19:00:51.180275] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:00:51.217509] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-08T19:00:52.017554] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-08T19:00:52.327255] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:00:52.329552] [INFO ] [REMOTE ] FPF: Full fetch complete (26739 records). [2025-10-08T19:00:52.329710] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-08T19:00:52.728281] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-08T19:00:52.728493] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-08T19:00:52.729235] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-08T19:00:52.729318] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-08T19:00:52.730462] [DEBUG] [LOCAL ] FPF: Trimmed 26739 records to 18595 (keeping 200 days of data) [2025-10-08T19:00:52.796239] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T19:00:52.838514] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-08T19:00:52.876588] [DEBUG] [LOCAL ] FPF: Primary data saved (18595 records). [2025-10-08T19:00:52.876805] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-08T19:00:52.876908] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPF took 42.8s. Estimated remaining: 3h 29m 58s. Rate: 7.2 symbols/min [2025-10-08T19:00:53.043497] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:53.062566] [DEBUG] [LOCAL ] FRGE: Loaded 16981 existing records from primary storage. [2025-10-08T19:00:53.062880] [INFO ] [MAIN ] FRGE: Loaded 16981 existing records. [2025-10-08T19:00:53.238956] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:53.239208] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-08T19:00:53.239268] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-08T19:00:53.239574] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-08T19:00:53.239633] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-08T19:00:53.622769] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-08T19:00:53.681038] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:54.003886] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T19:00:54.007033] [INFO ] [REMOTE ] FPI: Full fetch complete (44145 records). [2025-10-08T19:00:54.007176] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-08T19:00:54.384226] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-08T19:00:54.384310] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-08T19:00:54.384973] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-08T19:00:54.385035] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-08T19:00:54.386001] [DEBUG] [LOCAL ] FPI: Trimmed 44145 records to 31074 (keeping 200 days of data) [2025-10-08T19:00:54.441555] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-08T19:00:54.588278] [DEBUG] [LOCAL ] FPI: Primary data saved (31074 records). [2025-10-08T19:00:54.588484] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-08T19:00:54.588677] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPI took 36.6s. Estimated remaining: 3h 29m 38s. Rate: 7.2 symbols/min [2025-10-08T19:00:54.757977] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:54.807569] [DEBUG] [LOCAL ] FRO: Loaded 51679 existing records from primary storage. [2025-10-08T19:00:54.807982] [INFO ] [MAIN ] FRO: Loaded 51679 existing records. [2025-10-08T19:00:54.988986] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:54.989194] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-08T19:00:54.989241] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-08T19:00:54.989462] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-08T19:00:54.989520] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-08T19:00:55.227528] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-08T19:00:55.352370] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:55.381469] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:00:55.969477] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T19:00:56.024459] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-08T19:00:56.027342] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T19:00:56.817589] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-08T19:00:57.617546] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-08T19:00:57.658594] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T19:00:57.920447] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T19:00:58.417544] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-08T19:00:58.927267] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T19:00:59.217593] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-08T19:01:00.017566] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-08T19:01:00.234532] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T19:01:00.638872] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T19:01:00.817511] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-08T19:01:00.974433] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T19:01:01.617548] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-08T19:01:02.317060] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T19:01:02.371084] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T19:01:02.417513] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-08T19:01:03.217516] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-08T19:01:03.245503] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T19:01:04.017578] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-08T19:01:04.339359] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T19:01:04.817587] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-08T19:01:05.617540] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-08T19:01:05.879783] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T19:01:05.994565] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:01:06.417614] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-08T19:01:06.621351] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:01:07.217564] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-08T19:01:08.017576] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-08T19:01:08.328082] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T19:01:08.501227] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T19:01:08.504725] [INFO ] [REMOTE ] FR: Full fetch complete (66709 records). [2025-10-08T19:01:08.504842] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-08T19:01:08.817814] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-08T19:01:08.901240] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-08T19:01:08.901346] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-08T19:01:08.902459] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-08T19:01:08.902545] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-08T19:01:08.913353] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T19:01:08.919086] [DEBUG] [LOCAL ] FR: Trimmed 66709 records to 46358 (keeping 200 days of data) [2025-10-08T19:01:09.205633] [DEBUG] [LOCAL ] FR: Primary data saved (46358 records). [2025-10-08T19:01:09.205804] [INFO ] [MAIN ] FR: Full history saved. [2025-10-08T19:01:09.205908] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FR took 32.0s. Estimated remaining: 3h 29m 40s. Rate: 7.2 symbols/min [2025-10-08T19:01:09.372814] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:09.411760] [DEBUG] [LOCAL ] FRT: Loaded 41989 existing records from primary storage. [2025-10-08T19:01:09.412084] [INFO ] [MAIN ] FRT: Loaded 41989 existing records. [2025-10-08T19:01:09.585304] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:09.585547] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-08T19:01:09.585617] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-08T19:01:09.585937] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-08T19:01:09.586016] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-08T19:01:09.627724] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-08T19:01:09.959050] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:10.417517] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-08T19:01:10.528213] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T19:01:10.530164] [INFO ] [REMOTE ] FRA: Full fetch complete (23931 records). [2025-10-08T19:01:10.530245] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-08T19:01:10.959929] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-08T19:01:10.970295] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-08T19:01:10.976074] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-08T19:01:10.976165] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-08T19:01:10.990435] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T19:01:10.990775] [DEBUG] [LOCAL ] FRA: Trimmed 23931 records to 14561 (keeping 200 days of data) [2025-10-08T19:01:11.094869] [DEBUG] [LOCAL ] FRA: Primary data saved (14561 records). [2025-10-08T19:01:11.095049] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-08T19:01:11.095159] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FRA took 32.9s. Estimated remaining: 3h 29m 21s. Rate: 7.2 symbols/min [2025-10-08T19:01:11.222721] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-08T19:01:11.276513] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:11.312811] [DEBUG] [LOCAL ] FSCO: Loaded 37940 existing records from primary storage. [2025-10-08T19:01:11.313115] [INFO ] [MAIN ] FSCO: Loaded 37940 existing records. [2025-10-08T19:01:11.492890] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:11.493187] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-08T19:01:11.493260] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-08T19:01:11.494286] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-08T19:01:11.494347] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-08T19:01:11.856247] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:11.869860] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:01:12.017519] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-08T19:01:12.661491] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:01:12.817556] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-08T19:01:13.503295] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:01:13.617541] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-08T19:01:14.102599] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T19:01:14.417554] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-08T19:01:15.121123] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T19:01:15.217531] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-08T19:01:16.017520] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-08T19:01:16.559896] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T19:01:16.679606] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T19:01:16.817543] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-08T19:01:17.231090] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T19:01:17.617706] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-08T19:01:18.181621] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T19:01:18.417568] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-08T19:01:18.681984] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T19:01:19.217617] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-08T19:01:19.377933] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T19:01:19.906091] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T19:01:20.017558] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-08T19:01:20.817547] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-08T19:01:20.855992] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T19:01:21.617548] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-08T19:01:22.408702] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T19:01:22.417512] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-08T19:01:22.452295] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:01:23.217552] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-08T19:01:23.916073] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:01:24.017563] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-08T19:01:24.817515] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-08T19:01:24.973100] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T19:01:25.148632] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T19:01:25.617544] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-08T19:01:25.901148] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T19:01:26.417563] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-08T19:01:26.519343] [DEBUG] [REMOTE ] FRGE: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T19:01:26.519716] [WARN ] [REMOTE ] FRGE: No data returned for month 2025-09 [2025-10-08T19:01:26.519834] [FATAL] [REMOTE ] FRGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:01:26.519958] [FATAL] [MAIN ] FRGE: Failed to fetch primary data. [2025-10-08T19:01:26.520048] [WARN ] [MAIN ] FRGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:01:26.520144] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-08T19:01:26.520229] [DEBUG] [LOCAL ] FRGE: No primary data file found to delete. [2025-10-08T19:01:26.520267] [INFO ] [LOCAL ] FRGE: Starting deletion of derivative data. [2025-10-08T19:01:26.520517] [DEBUG] [LOCAL ] FRGE: Deleted derivative data file. [2025-10-08T19:01:26.520607] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 33.6s. Estimated remaining: 3h 29m 25s. Rate: 7.2 symbols/min [2025-10-08T19:01:26.695720] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:26.742866] [DEBUG] [LOCAL ] FSK: Loaded 49404 existing records from primary storage. [2025-10-08T19:01:26.743191] [INFO ] [MAIN ] FSK: Loaded 49404 existing records. [2025-10-08T19:01:26.918261] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:26.918508] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-08T19:01:26.918567] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-08T19:01:26.920007] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-08T19:01:26.920071] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-08T19:01:27.222781] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-08T19:01:27.283058] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:27.602872] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T19:01:28.017523] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-08T19:01:28.817572] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-08T19:01:28.886756] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T19:01:29.617600] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-08T19:01:29.718423] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T19:01:29.962566] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T19:01:30.417617] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-08T19:01:31.164549] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T19:01:31.217535] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-08T19:01:31.626779] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T19:01:32.017608] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-08T19:01:32.360720] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:01:32.817542] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-08T19:01:33.535695] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:01:33.617573] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-08T19:01:34.417534] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-08T19:01:34.739826] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T19:01:35.202902] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:01:35.217506] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-08T19:01:35.782300] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:01:36.017626] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-08T19:01:36.817580] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-08T19:01:36.991172] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T19:01:37.040230] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T19:01:37.617549] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-08T19:01:38.056710] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T19:01:38.417545] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-08T19:01:38.853983] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T19:01:39.217618] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-08T19:01:39.784620] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:01:40.017569] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-08T19:01:40.764515] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:01:40.817577] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-08T19:01:41.268613] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:01:41.617576] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-08T19:01:42.194776] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:01:42.199601] [INFO ] [REMOTE ] FSCO: Full fetch complete (54724 records). [2025-10-08T19:01:42.199889] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-08T19:01:42.422713] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-08T19:01:42.623361] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-08T19:01:42.623451] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-08T19:01:42.624229] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-08T19:01:42.624294] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-08T19:01:42.625469] [DEBUG] [LOCAL ] FSCO: Trimmed 54724 records to 38029 (keeping 200 days of data) [2025-10-08T19:01:42.853532] [DEBUG] [LOCAL ] FSCO: Primary data saved (38029 records). [2025-10-08T19:01:42.853734] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-08T19:01:42.853835] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FSCO took 31.8s. Estimated remaining: 3h 29m 30s. Rate: 7.2 symbols/min [2025-10-08T19:01:43.024812] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:43.074304] [DEBUG] [LOCAL ] FSLY: Loaded 51244 existing records from primary storage. [2025-10-08T19:01:43.074629] [INFO ] [MAIN ] FSLY: Loaded 51244 existing records. [2025-10-08T19:01:43.227273] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-08T19:01:43.256828] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:43.257488] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-08T19:01:43.257541] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-08T19:01:43.259040] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-08T19:01:43.259100] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-08T19:01:43.390793] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-08T19:01:43.428770] [INFO ] [REMOTE ] FRO: Full fetch complete (75191 records). [2025-10-08T19:01:43.435224] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-08T19:01:43.870597] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:44.017298] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T19:01:44.017903] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-08T19:01:44.080835] [INFO ] [REMOTE ] FRT: Full fetch complete (60393 records). [2025-10-08T19:01:44.111308] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-08T19:01:44.135255] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-08T19:01:44.135415] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-08T19:01:44.137202] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-08T19:01:44.137424] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-08T19:01:44.242901] [DEBUG] [LOCAL ] FRO: Trimmed 75191 records to 51674 (keeping 200 days of data) [2025-10-08T19:01:44.652607] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-08T19:01:44.653006] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-08T19:01:44.654221] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-08T19:01:44.656032] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-08T19:01:44.660466] [DEBUG] [LOCAL ] FRT: Trimmed 60393 records to 41872 (keeping 200 days of data) [2025-10-08T19:01:44.792629] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T19:01:44.819398] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-08T19:01:45.089288] [DEBUG] [LOCAL ] FRT: Primary data saved (41872 records). [2025-10-08T19:01:45.090512] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-08T19:01:45.090673] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 35.9s. Estimated remaining: 3h 29m 11s. Rate: 7.2 symbols/min [2025-10-08T19:01:45.283784] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:45.380360] [DEBUG] [LOCAL ] FRO: Primary data saved (51674 records). [2025-10-08T19:01:45.380537] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-08T19:01:45.380632] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FRO took 50.8s. Estimated remaining: 3h 28m 49s. Rate: 7.2 symbols/min [2025-10-08T19:01:45.547149] [DEBUG] [LOCAL ] FSM: Loaded 53294 existing records from primary storage. [2025-10-08T19:01:45.585762] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:45.586137] [INFO ] [MAIN ] FSM: Loaded 53294 existing records. [2025-10-08T19:01:45.793237] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:45.804162] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-08T19:01:45.804955] [DEBUG] [LOCAL ] FSS: Loaded 33992 existing records from primary storage. [2025-10-08T19:01:45.805259] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-08T19:01:45.805429] [INFO ] [MAIN ] FSS: Loaded 33992 existing records. [2025-10-08T19:01:45.810793] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-08T19:01:45.812721] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-08T19:01:46.213459] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:46.279794] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-08T19:01:46.307501] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-08T19:01:46.332243] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-08T19:01:46.356727] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-08T19:01:46.363016] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-08T19:01:46.405531] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-08T19:01:46.505158] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:46.546671] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-08T19:01:46.878770] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T19:01:46.884158] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:47.217553] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-08T19:01:48.022681] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-08T19:01:48.050909] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T19:01:48.313531] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:01:48.404173] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T19:01:48.817550] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-08T19:01:49.617596] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-08T19:01:49.749584] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T19:01:50.251581] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T19:01:50.417561] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-08T19:01:50.837344] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T19:01:51.217560] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-08T19:01:52.017547] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-08T19:01:52.167562] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T19:01:52.547788] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T19:01:52.817594] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-08T19:01:53.372393] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T19:01:53.617560] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-08T19:01:54.402416] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T19:01:54.417511] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-08T19:01:55.197242] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T19:01:55.217499] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-08T19:01:56.017562] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-08T19:01:56.242348] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T19:01:56.754913] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T19:01:56.817493] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-08T19:01:57.494901] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:01:57.617580] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-08T19:01:58.193120] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:01:58.417571] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-08T19:01:59.217526] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-08T19:01:59.419344] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T19:01:59.876342] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T19:02:00.017570] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-08T19:02:00.822249] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-08T19:02:00.828881] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T19:02:01.385836] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T19:02:01.617563] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-08T19:02:02.417594] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-08T19:02:02.589490] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:02:03.226939] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-08T19:02:03.229901] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T19:02:04.017616] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-08T19:02:04.220147] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T19:02:04.225511] [INFO ] [REMOTE ] FSK: Full fetch complete (71662 records). [2025-10-08T19:02:04.225632] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-08T19:02:04.666673] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-08T19:02:04.666766] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-08T19:02:04.667619] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-08T19:02:04.667690] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-08T19:02:04.669069] [DEBUG] [LOCAL ] FSK: Trimmed 71662 records to 49404 (keeping 200 days of data) [2025-10-08T19:02:04.860637] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-08T19:02:04.996442] [DEBUG] [LOCAL ] FSK: Primary data saved (49404 records). [2025-10-08T19:02:04.996686] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-08T19:02:04.996854] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 38.5s. Estimated remaining: 3h 28m 60s. Rate: 7.2 symbols/min [2025-10-08T19:02:05.174109] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T19:02:05.218734] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:05.228081] [DEBUG] [LOCAL ] FT: Loaded 6560 existing records from primary storage. [2025-10-08T19:02:05.228336] [INFO ] [MAIN ] FT: Loaded 6560 existing records. [2025-10-08T19:02:05.411772] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:05.412140] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-08T19:02:05.412288] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-08T19:02:05.412885] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-08T19:02:05.412947] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-08T19:02:05.630285] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-08T19:02:05.815776] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T19:02:05.819318] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:05.894959] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T19:02:06.417540] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-08T19:02:07.075186] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T19:02:07.217555] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-08T19:02:07.500096] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T19:02:08.017602] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-08T19:02:08.428594] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T19:02:08.644819] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T19:02:08.817587] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-08T19:02:09.617629] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-08T19:02:10.417628] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-08T19:02:10.700616] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T19:02:11.017371] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T19:02:11.230478] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-08T19:02:11.241274] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T19:02:11.918609] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T19:02:12.017597] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-08T19:02:12.809588] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-08T19:02:12.817498] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-08T19:02:13.483395] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T19:02:13.617594] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-08T19:02:14.417566] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-08T19:02:15.102941] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:02:15.217611] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-08T19:02:15.763686] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T19:02:16.017618] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-08T19:02:16.605571] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:02:16.612213] [INFO ] [REMOTE ] FSLY: Full fetch complete (74873 records). [2025-10-08T19:02:16.612478] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-08T19:02:16.827500] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-08T19:02:17.064294] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-08T19:02:17.064542] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-08T19:02:17.066062] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-08T19:02:17.066183] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-08T19:02:17.085783] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:02:17.092126] [DEBUG] [LOCAL ] FSLY: Trimmed 74873 records to 51235 (keeping 200 days of data) [2025-10-08T19:02:17.445883] [DEBUG] [LOCAL ] FSLY: Primary data saved (51235 records). [2025-10-08T19:02:17.446134] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-08T19:02:17.446258] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 34.6s. Estimated remaining: 3h 28m 58s. Rate: 7.2 symbols/min [2025-10-08T19:02:17.622815] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-08T19:02:17.656196] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:17.672598] [DEBUG] [LOCAL ] FTHY: Loaded 12266 existing records from primary storage. [2025-10-08T19:02:17.673116] [INFO ] [MAIN ] FTHY: Loaded 12266 existing records. [2025-10-08T19:02:17.880107] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:17.880413] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-08T19:02:17.880467] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-08T19:02:17.881148] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-08T19:02:17.881214] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-08T19:02:18.341491] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:18.417612] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-08T19:02:18.657065] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:02:18.661411] [INFO ] [REMOTE ] FSS: Full fetch complete (48453 records). [2025-10-08T19:02:18.661576] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-08T19:02:18.945816] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-08T19:02:19.018633] [INFO ] [REMOTE ] FSM: Full fetch complete (76829 records). [2025-10-08T19:02:19.046162] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-08T19:02:19.157362] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-08T19:02:19.189323] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-08T19:02:19.223125] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-08T19:02:19.229475] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-08T19:02:19.235573] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-08T19:02:19.271711] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T19:02:19.321359] [DEBUG] [LOCAL ] FSS: Trimmed 48453 records to 33877 (keeping 200 days of data) [2025-10-08T19:02:19.773721] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-08T19:02:19.779329] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-08T19:02:19.786095] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-08T19:02:19.786283] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-08T19:02:19.861365] [DEBUG] [LOCAL ] FSM: Trimmed 76829 records to 53296 (keeping 200 days of data) [2025-10-08T19:02:19.931411] [DEBUG] [LOCAL ] FSS: Primary data saved (33877 records). [2025-10-08T19:02:19.943467] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-08T19:02:19.943779] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSS took 34.6s. Estimated remaining: 3h 28m 40s. Rate: 7.2 symbols/min [2025-10-08T19:02:19.981400] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T19:02:20.029535] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-08T19:02:20.208835] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:20.379422] [DEBUG] [LOCAL ] FTI: Loaded 53292 existing records from primary storage. [2025-10-08T19:02:20.386628] [INFO ] [MAIN ] FTI: Loaded 53292 existing records. [2025-10-08T19:02:20.612202] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:20.616089] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-08T19:02:20.616215] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-08T19:02:20.674266] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-08T19:02:20.675158] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-08T19:02:20.819580] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-08T19:02:20.859035] [DEBUG] [LOCAL ] FSM: Primary data saved (53296 records). [2025-10-08T19:02:20.865611] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-08T19:02:20.892800] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSM took 35.8s. Estimated remaining: 3h 28m 19s. Rate: 7.2 symbols/min [2025-10-08T19:02:21.081705] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T19:02:21.173893] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:21.617545] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-08T19:02:21.624777] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T19:02:22.417596] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-08T19:02:23.143190] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T19:02:23.217621] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-08T19:02:23.383486] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:02:23.851407] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T19:02:24.017569] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-08T19:02:24.817597] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-08T19:02:25.431940] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:02:25.452262] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T19:02:25.617549] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-08T19:02:26.211983] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T19:02:26.213416] [INFO ] [REMOTE ] FT: Full fetch complete (9186 records). [2025-10-08T19:02:26.213523] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-08T19:02:26.426686] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-08T19:02:26.611961] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-08T19:02:26.612075] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-08T19:02:26.612349] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-08T19:02:26.612390] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-08T19:02:26.613142] [DEBUG] [LOCAL ] FT: Trimmed 9186 records to 6607 (keeping 200 days of data) [2025-10-08T19:02:26.655854] [DEBUG] [LOCAL ] FT: Primary data saved (6607 records). [2025-10-08T19:02:26.655995] [INFO ] [MAIN ] FT: Full history saved. [2025-10-08T19:02:26.656083] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FT took 21.7s. Estimated remaining: 3h 28m 6s. Rate: 7.2 symbols/min [2025-10-08T19:02:26.888247] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T19:02:27.217588] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-08T19:02:28.017530] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-08T19:02:28.177099] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T19:02:28.817624] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-08T19:02:29.464586] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T19:02:29.511996] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T19:02:29.617613] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-08T19:02:30.417595] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-08T19:02:30.933228] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T19:02:31.217608] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-08T19:02:31.586968] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T19:02:32.017600] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-08T19:02:32.046702] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:02:32.817559] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-08T19:02:33.533760] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T19:02:33.617575] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-08T19:02:33.682855] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:02:34.191399] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T19:02:34.417613] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-08T19:02:35.217579] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-08T19:02:35.926000] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T19:02:35.928026] [INFO ] [REMOTE ] FTHY: Full fetch complete (17544 records). [2025-10-08T19:02:35.928135] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-08T19:02:36.362529] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-08T19:02:36.362697] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-08T19:02:36.363496] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-08T19:02:36.363598] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-08T19:02:36.364903] [DEBUG] [LOCAL ] FTHY: Trimmed 17544 records to 12273 (keeping 200 days of data) [2025-10-08T19:02:36.434486] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T19:02:36.468582] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-08T19:02:36.495564] [DEBUG] [LOCAL ] FTHY: Primary data saved (12273 records). [2025-10-08T19:02:36.495734] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-08T19:02:36.495832] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 19.0s. Estimated remaining: 3h 28m 0s. Rate: 7.2 symbols/min [2025-10-08T19:02:38.283031] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T19:02:38.294957] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-08T19:02:40.109568] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T19:02:40.121458] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-08T19:02:41.660951] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T19:02:41.673871] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-08T19:02:43.454485] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T19:02:43.466447] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-08T19:02:45.170477] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T19:02:45.175384] [INFO ] [REMOTE ] FTI: Full fetch complete (77125 records). [2025-10-08T19:02:45.175540] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-08T19:02:45.672027] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-08T19:02:45.672118] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-08T19:02:45.673083] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-08T19:02:45.673151] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-08T19:02:45.674687] [DEBUG] [LOCAL ] FTI: Trimmed 77125 records to 53294 (keeping 200 days of data) [2025-10-08T19:02:46.008294] [DEBUG] [LOCAL ] FTI: Primary data saved (53294 records). [2025-10-08T19:02:46.008777] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-08T19:02:46.008916] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 26.1s. Estimated remaining: 3h 27m 54s. Rate: 7.2 symbols/min [2025-10-08T19:02:46.630614] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:46.704277] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:46.757812] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:46.761041] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:46.766600] [DEBUG] [LOCAL ] FTWO: Loaded 1866 existing records from primary storage. [2025-10-08T19:02:46.766962] [INFO ] [MAIN ] FTWO: Loaded 1866 existing records. [2025-10-08T19:02:46.972375] [DEBUG] [LOCAL ] FTK: Loaded 32577 existing records from primary storage. [2025-10-08T19:02:47.011389] [INFO ] [MAIN ] FTK: Loaded 32577 existing records. [2025-10-08T19:02:47.010615] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:47.057821] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-08T19:02:47.107470] [DEBUG] [LOCAL ] FTS: Loaded 42398 existing records from primary storage. [2025-10-08T19:02:47.096248] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-08T19:02:47.123731] [INFO ] [MAIN ] FTS: Loaded 42398 existing records. [2025-10-08T19:02:47.175723] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-08T19:02:47.182841] [DEBUG] [LOCAL ] FTV: Loaded 52985 existing records from primary storage. [2025-10-08T19:02:47.176044] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-08T19:02:47.228259] [INFO ] [MAIN ] FTV: Loaded 52985 existing records. [2025-10-08T19:02:47.409467] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:47.499481] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-08T19:02:47.508078] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-08T19:02:47.571345] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-08T19:02:47.622921] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-08T19:02:47.728924] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:47.839301] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-08T19:02:47.838986] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:47.885249] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-08T19:02:47.919844] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-08T19:02:47.885096] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-08T19:02:47.981735] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-08T19:02:47.981885] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-08T19:02:47.966842] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-08T19:02:48.057185] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-08T19:02:48.793579] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:48.849837] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-08T19:02:49.037742] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:49.048682] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-08T19:02:49.149730] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:49.189477] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:49.190028] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-08T19:02:49.189756] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-08T19:02:49.557196] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T19:02:49.559690] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-08T19:02:50.102739] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T19:02:50.107901] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-08T19:02:50.146963] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T19:02:50.148685] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-08T19:02:50.614798] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:02:50.625545] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-08T19:02:50.705815] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T19:02:50.707281] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-08T19:02:50.739708] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T19:02:50.748685] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-08T19:02:50.815892] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T19:02:50.821571] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-08T19:02:51.073452] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-08T19:02:51.074669] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-08T19:02:51.467384] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T19:02:51.468532] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-08T19:02:51.815230] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-08T19:02:51.816323] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-08T19:02:52.093178] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:02:52.098319] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-08T19:02:52.374077] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T19:02:52.375528] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-08T19:02:52.410818] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T19:02:52.504927] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T19:02:52.817554] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-08T19:02:53.086168] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T19:02:53.166081] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T19:02:53.617693] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-08T19:02:53.936523] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T19:02:54.417771] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-08T19:02:55.217611] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-08T19:02:55.512270] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T19:02:55.735048] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T19:02:55.788631] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T19:02:56.017605] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-08T19:02:56.455954] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T19:02:56.817578] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-08T19:02:57.617583] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-08T19:02:57.877892] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T19:02:58.117339] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T19:02:58.118215] [INFO ] [REMOTE ] FTWO: Full fetch complete (3324 records). [2025-10-08T19:02:58.118284] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-08T19:02:58.422672] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-08T19:02:58.477743] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-08T19:02:58.477827] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-08T19:02:58.477952] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-08T19:02:58.477988] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-08T19:02:58.478355] [DEBUG] [LOCAL ] FTWO: Trimmed 3324 records to 1882 (keeping 200 days of data) [2025-10-08T19:02:58.490489] [DEBUG] [LOCAL ] FTWO: Primary data saved (1882 records). [2025-10-08T19:02:58.490592] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-08T19:02:58.490763] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 12.5s. Estimated remaining: 3h 27m 52s. Rate: 7.2 symbols/min [2025-10-08T19:02:58.661993] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:58.713033] [DEBUG] [LOCAL ] FUBO: Loaded 53701 existing records from primary storage. [2025-10-08T19:02:58.713403] [INFO ] [MAIN ] FUBO: Loaded 53701 existing records. [2025-10-08T19:02:58.899831] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:58.900050] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-08T19:02:58.900096] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-08T19:02:58.901375] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-08T19:02:58.901436] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-08T19:02:59.222773] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-08T19:02:59.280594] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:59.757276] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:03:00.017616] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-08T19:03:00.654467] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:03:00.817585] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-08T19:03:01.617582] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-08T19:03:01.777177] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T19:03:02.417689] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-08T19:03:02.606007] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:03:02.647320] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T19:03:03.217619] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-08T19:03:04.017598] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-08T19:03:04.380963] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T19:03:04.817544] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-08T19:03:05.007317] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-08T19:03:05.617615] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-08T19:03:05.862562] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T19:03:06.423321] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-08T19:03:06.444740] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T19:03:07.217577] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-08T19:03:07.637220] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T19:03:07.731246] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-08T19:03:08.017600] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-08T19:03:08.328130] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:03:08.817614] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-08T19:03:09.423099] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T19:03:09.617615] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-08T19:03:10.365623] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T19:03:10.417535] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-08T19:03:11.217706] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-08T19:03:11.511849] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T19:03:11.790155] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:03:12.017619] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-08T19:03:12.211891] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T19:03:12.215983] [INFO ] [REMOTE ] FTK: Full fetch complete (43747 records). [2025-10-08T19:03:12.216150] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-08T19:03:12.629421] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-08T19:03:12.629810] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-08T19:03:12.630532] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-08T19:03:12.630597] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-08T19:03:12.632835] [DEBUG] [LOCAL ] FTK: Trimmed 43747 records to 32569 (keeping 200 days of data) [2025-10-08T19:03:12.819504] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-08T19:03:12.831709] [DEBUG] [LOCAL ] FTK: Primary data saved (32569 records). [2025-10-08T19:03:12.831878] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-08T19:03:12.832014] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 26.8s. Estimated remaining: 3h 27m 54s. Rate: 7.2 symbols/min [2025-10-08T19:03:13.008840] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:13.042330] [DEBUG] [LOCAL ] FUL: Loaded 32878 existing records from primary storage. [2025-10-08T19:03:13.042737] [INFO ] [MAIN ] FUL: Loaded 32878 existing records. [2025-10-08T19:03:13.225029] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:13.225254] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-08T19:03:13.225301] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-08T19:03:13.226175] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-08T19:03:13.226237] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-08T19:03:13.597279] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:13.617515] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-08T19:03:13.768988] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:03:14.364829] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:03:14.420684] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-08T19:03:14.425235] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T19:03:15.217561] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-08T19:03:16.017538] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-08T19:03:16.075115] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T19:03:16.696382] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T19:03:16.817558] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-08T19:03:17.617556] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-08T19:03:17.878368] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T19:03:18.063823] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T19:03:18.417611] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-08T19:03:19.217572] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-08T19:03:19.416405] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T19:03:19.875268] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T19:03:19.879289] [INFO ] [REMOTE ] FTS: Full fetch complete (60234 records). [2025-10-08T19:03:19.879434] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-08T19:03:20.022691] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-08T19:03:20.292295] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-08T19:03:20.292404] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-08T19:03:20.293240] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-08T19:03:20.293315] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-08T19:03:20.294883] [DEBUG] [LOCAL ] FTS: Trimmed 60234 records to 42429 (keeping 200 days of data) [2025-10-08T19:03:20.551938] [DEBUG] [LOCAL ] FTS: Primary data saved (42429 records). [2025-10-08T19:03:20.552086] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-08T19:03:20.552176] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 34.5s. Estimated remaining: 3h 27m 45s. Rate: 7.2 symbols/min [2025-10-08T19:03:20.718685] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:20.768860] [DEBUG] [LOCAL ] FUN: Loaded 51731 existing records from primary storage. [2025-10-08T19:03:20.769272] [INFO ] [MAIN ] FUN: Loaded 51731 existing records. [2025-10-08T19:03:20.831185] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-08T19:03:20.948700] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:20.949001] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-08T19:03:20.949053] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-08T19:03:20.950352] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-08T19:03:20.950411] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-08T19:03:21.311206] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:21.342515] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T19:03:21.596705] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:03:21.617492] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-08T19:03:22.417515] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-08T19:03:22.658353] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T19:03:22.713438] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T19:03:23.217558] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-08T19:03:24.017568] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-08T19:03:24.615619] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-08T19:03:24.817537] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-08T19:03:24.932527] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T19:03:25.522312] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:03:25.617573] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-08T19:03:25.711140] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T19:03:26.417536] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-08T19:03:27.217624] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-08T19:03:27.354161] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T19:03:28.017562] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-08T19:03:28.347575] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T19:03:28.817785] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-08T19:03:28.842196] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T19:03:28.846163] [INFO ] [REMOTE ] FTV: Full fetch complete (76402 records). [2025-10-08T19:03:28.846265] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-08T19:03:29.256937] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-08T19:03:29.257055] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-08T19:03:29.258014] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-08T19:03:29.258096] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-08T19:03:29.260001] [DEBUG] [LOCAL ] FTV: Trimmed 76402 records to 52988 (keeping 200 days of data) [2025-10-08T19:03:29.389001] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T19:03:29.617682] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-08T19:03:29.621919] [DEBUG] [LOCAL ] FTV: Primary data saved (52988 records). [2025-10-08T19:03:29.621995] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-08T19:03:29.622070] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 43.6s. Estimated remaining: 3h 27m 37s. Rate: 7.2 symbols/min [2025-10-08T19:03:29.792451] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:29.814599] [DEBUG] [LOCAL ] FVR: Loaded 21680 existing records from primary storage. [2025-10-08T19:03:29.814875] [INFO ] [MAIN ] FVR: Loaded 21680 existing records. [2025-10-08T19:03:29.993828] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:29.994064] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-08T19:03:29.994136] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-08T19:03:29.994892] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-08T19:03:29.994954] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-08T19:03:30.291992] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T19:03:30.382419] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:30.417488] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-08T19:03:31.085155] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T19:03:31.217524] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-08T19:03:31.486673] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:03:32.017574] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-08T19:03:32.817560] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-08T19:03:32.891250] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:03:33.369295] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T19:03:33.581676] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T19:03:33.617599] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-08T19:03:34.417571] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-08T19:03:34.709806] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T19:03:35.217734] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-08T19:03:36.017567] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-08T19:03:36.537568] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:03:36.672577] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-08T19:03:36.817571] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-08T19:03:36.939698] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T19:03:37.617564] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-08T19:03:38.417545] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-08T19:03:39.130888] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-08T19:03:39.182717] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:03:39.217546] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-08T19:03:39.436904] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T19:03:40.017561] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-08T19:03:40.817559] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-08T19:03:41.315032] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T19:03:41.317796] [INFO ] [REMOTE ] FUL: Full fetch complete (47855 records). [2025-10-08T19:03:41.317920] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-08T19:03:41.620447] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-08T19:03:41.668598] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-08T19:03:41.721384] [INFO ] [REMOTE ] FUBO: Full fetch complete (77771 records). [2025-10-08T19:03:41.733078] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-08T19:03:41.849539] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-08T19:03:41.882226] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-08T19:03:41.898932] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-08T19:03:41.904164] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-08T19:03:42.057400] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T19:03:42.046779] [DEBUG] [LOCAL ] FUL: Trimmed 47855 records to 32850 (keeping 200 days of data) [2025-10-08T19:03:42.289988] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-08T19:03:42.290350] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-08T19:03:42.292170] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-08T19:03:42.292509] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-08T19:03:42.302370] [DEBUG] [LOCAL ] FUBO: Trimmed 77771 records to 53705 (keeping 200 days of data) [2025-10-08T19:03:42.420288] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-08T19:03:42.610996] [DEBUG] [LOCAL ] FUL: Primary data saved (32850 records). [2025-10-08T19:03:42.612952] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-08T19:03:42.615864] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUL took 29.8s. Estimated remaining: 3h 27m 37s. Rate: 7.2 symbols/min [2025-10-08T19:03:42.804896] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:42.906413] [DEBUG] [LOCAL ] FVRR: Loaded 40180 existing records from primary storage. [2025-10-08T19:03:42.908082] [INFO ] [MAIN ] FVRR: Loaded 40180 existing records. [2025-10-08T19:03:42.976272] [DEBUG] [LOCAL ] FUBO: Primary data saved (53705 records). [2025-10-08T19:03:42.998001] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-08T19:03:43.016141] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUBO took 44.5s. Estimated remaining: 3h 27m 15s. Rate: 7.2 symbols/min [2025-10-08T19:03:43.209797] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:43.225582] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-08T19:03:43.225792] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-08T19:03:43.246605] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-08T19:03:43.277771] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-08T19:03:43.281355] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:43.366494] [DEBUG] [LOCAL ] FXED: Loaded 1252 existing records from primary storage. [2025-10-08T19:03:43.366890] [INFO ] [MAIN ] FXED: Loaded 1252 existing records. [2025-10-08T19:03:43.741952] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:43.804564] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-08T19:03:43.858686] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-08T19:03:43.890168] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:03:43.888066] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:43.896948] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-08T19:03:43.899290] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-08T19:03:43.912148] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-08T19:03:43.915989] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-08T19:03:44.022752] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-08T19:03:44.299273] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:44.817581] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-08T19:03:45.030169] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T19:03:45.209851] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:03:45.617629] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-08T19:03:45.981271] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T19:03:46.417539] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-08T19:03:47.013802] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T19:03:47.217539] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-08T19:03:47.628995] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T19:03:48.017604] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-08T19:03:48.684244] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T19:03:48.817579] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-08T19:03:49.033477] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T19:03:49.617574] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-08T19:03:50.417513] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-08T19:03:50.530273] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T19:03:50.859845] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T19:03:51.121558] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T19:03:51.217552] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-08T19:03:52.017625] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-08T19:03:52.346387] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T19:03:52.696335] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:03:52.817559] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-08T19:03:53.617632] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-08T19:03:54.033231] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T19:03:54.417599] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-08T19:03:55.217593] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-08T19:03:55.403948] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T19:03:55.409102] [INFO ] [REMOTE ] FUN: Full fetch complete (72981 records). [2025-10-08T19:03:55.409287] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-08T19:03:55.877514] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-08T19:03:55.877745] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-08T19:03:55.878940] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-08T19:03:55.879430] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-08T19:03:55.882230] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T19:03:55.893181] [DEBUG] [LOCAL ] FUN: Trimmed 72981 records to 51776 (keeping 200 days of data) [2025-10-08T19:03:55.910488] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T19:03:56.018263] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-08T19:03:56.223690] [DEBUG] [LOCAL ] FUN: Primary data saved (51776 records). [2025-10-08T19:03:56.223837] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-08T19:03:56.223920] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FUN took 35.7s. Estimated remaining: 3h 27m 15s. Rate: 7.2 symbols/min [2025-10-08T19:03:56.391018] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:56.437127] [DEBUG] [LOCAL ] G: Loaded 49989 existing records from primary storage. [2025-10-08T19:03:56.437444] [INFO ] [MAIN ] G: Loaded 49989 existing records. [2025-10-08T19:03:56.616167] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:56.616747] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-08T19:03:56.616849] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-08T19:03:56.618839] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-08T19:03:56.618901] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-08T19:03:56.822741] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-08T19:03:56.991881] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:57.013694] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:03:57.214539] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T19:03:57.617634] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-08T19:03:57.913750] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-08T19:03:58.417576] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-08T19:03:59.170267] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T19:03:59.171984] [INFO ] [REMOTE ] FVR: Full fetch complete (29780 records). [2025-10-08T19:03:59.172062] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-08T19:03:59.227620] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-08T19:03:59.593362] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-08T19:03:59.593444] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-08T19:03:59.593982] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-08T19:03:59.594043] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-08T19:03:59.594885] [DEBUG] [LOCAL ] FVR: Trimmed 29780 records to 21569 (keeping 200 days of data) [2025-10-08T19:03:59.691563] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T19:03:59.741456] [DEBUG] [LOCAL ] FVR: Primary data saved (21569 records). [2025-10-08T19:03:59.741622] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-08T19:03:59.741770] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FVR took 30.1s. Estimated remaining: 3h 26m 58s. Rate: 7.2 symbols/min [2025-10-08T19:03:59.917680] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:59.945044] [DEBUG] [LOCAL ] GAB: Loaded 27802 existing records from primary storage. [2025-10-08T19:03:59.945379] [INFO ] [MAIN ] GAB: Loaded 27802 existing records. [2025-10-08T19:04:00.022757] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-08T19:04:00.125590] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:00.125822] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-08T19:04:00.125869] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-08T19:04:00.126774] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-08T19:04:00.126835] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-08T19:04:00.482023] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:00.817558] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-08T19:04:01.466017] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:04:01.617613] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-08T19:04:02.417545] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-08T19:04:02.457807] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T19:04:02.886582] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T19:04:03.217575] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-08T19:04:03.843921] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T19:04:03.908765] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T19:04:04.017586] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-08T19:04:04.287250] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-08T19:04:04.817591] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-08T19:04:05.617577] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-08T19:04:05.943927] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T19:04:06.068517] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T19:04:06.417583] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-08T19:04:06.843014] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T19:04:07.217563] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-08T19:04:08.017586] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-08T19:04:08.784015] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T19:04:08.817503] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-08T19:04:09.617560] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-08T19:04:09.656710] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T19:04:10.089618] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T19:04:10.209750] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T19:04:10.210494] [INFO ] [REMOTE ] FXED: Full fetch complete (1803 records). [2025-10-08T19:04:10.210565] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-08T19:04:10.423155] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-08T19:04:10.604358] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-08T19:04:10.604443] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-08T19:04:10.604561] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-08T19:04:10.604621] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-08T19:04:10.605033] [DEBUG] [LOCAL ] FXED: Trimmed 1803 records to 1252 (keeping 200 days of data) [2025-10-08T19:04:10.614737] [DEBUG] [LOCAL ] FXED: Primary data saved (1252 records). [2025-10-08T19:04:10.614874] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-08T19:04:10.614961] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 27.6s. Estimated remaining: 3h 26m 54s. Rate: 7.2 symbols/min [2025-10-08T19:04:10.858000] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:10.864013] [DEBUG] [LOCAL ] GAM: Loaded 4015 existing records from primary storage. [2025-10-08T19:04:10.864303] [INFO ] [MAIN ] GAM: Loaded 4015 existing records. [2025-10-08T19:04:11.112205] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:11.112517] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-08T19:04:11.112580] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-08T19:04:11.112954] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-08T19:04:11.113027] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-08T19:04:11.222787] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-08T19:04:11.694487] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:12.022263] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-08T19:04:12.028970] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T19:04:12.063739] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T19:04:12.817752] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-08T19:04:13.492272] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T19:04:13.497189] [INFO ] [REMOTE ] FVRR: Full fetch complete (59178 records). [2025-10-08T19:04:13.497318] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-08T19:04:13.622758] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-08T19:04:14.015861] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-08T19:04:14.015964] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-08T19:04:14.016937] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-08T19:04:14.017022] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-08T19:04:14.018539] [DEBUG] [LOCAL ] FVRR: Trimmed 59178 records to 40243 (keeping 200 days of data) [2025-10-08T19:04:14.318937] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T19:04:14.343047] [DEBUG] [LOCAL ] FVRR: Primary data saved (40243 records). [2025-10-08T19:04:14.343204] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-08T19:04:14.343294] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FVRR took 31.7s. Estimated remaining: 3h 26m 38s. Rate: 7.2 symbols/min [2025-10-08T19:04:14.422901] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-08T19:04:14.492859] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T19:04:14.560360] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:14.614314] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-08T19:04:14.614720] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-08T19:04:14.787318] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:14.787555] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-08T19:04:14.787604] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-08T19:04:14.789088] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-08T19:04:14.789151] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-08T19:04:15.133467] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:15.217497] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-08T19:04:15.882577] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:04:16.017571] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-08T19:04:16.822743] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-08T19:04:16.844982] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T19:04:17.467329] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T19:04:17.617558] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-08T19:04:17.832817] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T19:04:18.235403] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T19:04:18.417584] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-08T19:04:19.217530] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-08T19:04:19.552701] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T19:04:19.844471] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T19:04:20.017546] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-08T19:04:20.817575] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-08T19:04:21.293230] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:04:21.617560] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-08T19:04:22.340515] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:04:22.354467] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:04:22.417582] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-08T19:04:23.217691] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-08T19:04:23.641211] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T19:04:24.017594] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-08T19:04:24.621881] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T19:04:24.658035] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T19:04:24.817532] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-08T19:04:25.617577] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-08T19:04:26.384357] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T19:04:26.417507] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-08T19:04:26.722100] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T19:04:26.987946] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T19:04:27.217560] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-08T19:04:28.017561] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-08T19:04:28.500177] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T19:04:28.832802] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-08T19:04:28.857354] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T19:04:29.512638] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T19:04:29.617572] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-08T19:04:30.417559] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-08T19:04:30.856974] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T19:04:31.217563] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-08T19:04:31.860440] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T19:04:32.017551] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-08T19:04:32.817553] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-08T19:04:33.087343] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T19:04:33.617570] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-08T19:04:33.962152] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T19:04:33.979738] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T19:04:33.981783] [INFO ] [REMOTE ] GAB: Full fetch complete (39463 records). [2025-10-08T19:04:33.981883] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-08T19:04:34.374236] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-08T19:04:34.374329] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-08T19:04:34.375042] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-08T19:04:34.375107] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-08T19:04:34.376007] [DEBUG] [LOCAL ] GAB: Trimmed 39463 records to 27641 (keeping 200 days of data) [2025-10-08T19:04:34.425493] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-08T19:04:34.539448] [DEBUG] [LOCAL ] GAB: Primary data saved (27641 records). [2025-10-08T19:04:34.539584] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-08T19:04:34.539689] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. GAB took 34.8s. Estimated remaining: 3h 26m 49s. Rate: 7.2 symbols/min [2025-10-08T19:04:34.735298] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:34.756549] [DEBUG] [LOCAL ] GATX: Loaded 18153 existing records from primary storage. [2025-10-08T19:04:34.756858] [INFO ] [MAIN ] GATX: Loaded 18153 existing records. [2025-10-08T19:04:34.968178] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:34.968464] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-08T19:04:34.968537] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-08T19:04:34.969336] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-08T19:04:34.969405] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-08T19:04:35.217507] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-08T19:04:35.372445] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:35.400273] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T19:04:35.677826] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T19:04:36.017534] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-08T19:04:36.415618] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T19:04:36.817573] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-08T19:04:37.024937] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T19:04:37.319306] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T19:04:37.617534] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-08T19:04:38.198306] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T19:04:38.199371] [INFO ] [REMOTE ] GAM: Full fetch complete (6654 records). [2025-10-08T19:04:38.199469] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-08T19:04:38.422739] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-08T19:04:38.628048] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-08T19:04:38.628133] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-08T19:04:38.628331] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-08T19:04:38.628369] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-08T19:04:38.628821] [DEBUG] [LOCAL ] GAM: Trimmed 6654 records to 4028 (keeping 200 days of data) [2025-10-08T19:04:38.652076] [DEBUG] [LOCAL ] GAM: Primary data saved (4028 records). [2025-10-08T19:04:38.652163] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-08T19:04:38.652255] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAM took 28.0s. Estimated remaining: 3h 26m 34s. Rate: 7.2 symbols/min [2025-10-08T19:04:38.830416] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:38.845150] [DEBUG] [LOCAL ] GBAB: Loaded 13001 existing records from primary storage. [2025-10-08T19:04:38.845405] [INFO ] [MAIN ] GBAB: Loaded 13001 existing records. [2025-10-08T19:04:39.017009] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:39.017299] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-08T19:04:39.017351] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-08T19:04:39.017843] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-08T19:04:39.017902] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-08T19:04:39.221777] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-08T19:04:39.370478] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:39.380228] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T19:04:40.017565] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-08T19:04:40.822814] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-08T19:04:40.833107] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T19:04:41.182701] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T19:04:41.617561] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-08T19:04:42.100941] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T19:04:42.104884] [INFO ] [REMOTE ] G: Full fetch complete (71753 records). [2025-10-08T19:04:42.105010] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-08T19:04:42.417852] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-08T19:04:42.431563] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:04:42.519575] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-08T19:04:42.519691] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-08T19:04:42.520728] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-08T19:04:42.520808] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-08T19:04:42.522962] [DEBUG] [LOCAL ] G: Trimmed 71753 records to 49981 (keeping 200 days of data) [2025-10-08T19:04:42.833068] [DEBUG] [LOCAL ] G: Primary data saved (49981 records). [2025-10-08T19:04:42.833209] [INFO ] [MAIN ] G: Full history saved. [2025-10-08T19:04:42.833295] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. G took 46.6s. Estimated remaining: 3h 26m 18s. Rate: 7.2 symbols/min [2025-10-08T19:04:43.000735] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:43.043585] [DEBUG] [LOCAL ] GBCI: Loaded 40500 existing records from primary storage. [2025-10-08T19:04:43.043990] [INFO ] [MAIN ] GBCI: Loaded 40500 existing records. [2025-10-08T19:04:43.217568] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:43.217680] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-08T19:04:43.218002] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-08T19:04:43.218078] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-08T19:04:43.220254] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-08T19:04:43.220317] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-08T19:04:43.570060] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:44.017529] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-08T19:04:44.179925] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T19:04:44.359236] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T19:04:44.679715] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T19:04:44.817632] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-08T19:04:45.617572] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-08T19:04:45.632984] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T19:04:46.417598] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-08T19:04:47.217573] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-08T19:04:47.607472] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T19:04:47.635232] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T19:04:48.017892] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-08T19:04:48.347882] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T19:04:48.817589] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-08T19:04:49.036313] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T19:04:49.308510] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T19:04:49.617569] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-08T19:04:50.370330] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T19:04:50.417524] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-08T19:04:50.937550] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-08T19:04:51.217553] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-08T19:04:52.017556] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-08T19:04:52.817580] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-08T19:04:53.158045] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T19:04:53.386244] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T19:04:53.599240] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T19:04:53.617493] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-08T19:04:54.417547] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-08T19:04:54.993456] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:04:55.217608] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-08T19:04:55.945759] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T19:04:56.017509] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-08T19:04:56.216676] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:04:56.817524] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-08T19:04:57.617585] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-08T19:04:57.651895] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T19:04:57.656140] [INFO ] [REMOTE ] GAP: Full fetch complete (77632 records). [2025-10-08T19:04:57.656286] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-08T19:04:57.850273] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T19:04:58.066345] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-08T19:04:58.066437] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-08T19:04:58.067387] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-08T19:04:58.067452] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-08T19:04:58.069936] [DEBUG] [LOCAL ] GAP: Trimmed 77632 records to 53652 (keeping 200 days of data) [2025-10-08T19:04:58.406018] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T19:04:58.417722] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-08T19:04:58.428496] [DEBUG] [LOCAL ] GAP: Primary data saved (53652 records). [2025-10-08T19:04:58.428698] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-08T19:04:58.428825] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAP took 44.1s. Estimated remaining: 3h 26m 22s. Rate: 7.2 symbols/min [2025-10-08T19:04:58.611501] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:58.611737] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-08T19:04:58.611786] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-08T19:04:58.611917] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-08T19:04:58.611970] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-08T19:04:58.612037] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-08T19:04:58.612072] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-08T19:04:58.983744] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:59.217590] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-08T19:04:59.242162] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:05:00.017526] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-08T19:05:00.028163] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T19:05:00.817561] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-08T19:05:01.345928] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:05:01.617550] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-08T19:05:02.310504] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:05:02.417617] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-08T19:05:02.845371] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T19:05:02.847032] [INFO ] [REMOTE ] GATX: Full fetch complete (25061 records). [2025-10-08T19:05:02.847130] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-08T19:05:03.228069] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-08T19:05:03.413759] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-08T19:05:03.413889] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-08T19:05:03.414768] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-08T19:05:03.414834] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-08T19:05:03.415940] [DEBUG] [LOCAL ] GATX: Trimmed 25061 records to 18143 (keeping 200 days of data) [2025-10-08T19:05:03.555138] [DEBUG] [LOCAL ] GATX: Primary data saved (18143 records). [2025-10-08T19:05:03.555311] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-08T19:05:03.555421] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GATX took 29.0s. Estimated remaining: 3h 26m 8s. Rate: 7.2 symbols/min [2025-10-08T19:05:03.727933] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:03.766583] [DEBUG] [LOCAL ] GBTG: Loaded 40073 existing records from primary storage. [2025-10-08T19:05:03.766915] [INFO ] [MAIN ] GBTG: Loaded 40073 existing records. [2025-10-08T19:05:03.942543] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:03.942832] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-08T19:05:03.942894] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-08T19:05:03.943827] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-08T19:05:03.943888] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-08T19:05:04.027458] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-08T19:05:04.047117] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T19:05:04.354275] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:04.817566] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-08T19:05:05.295783] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T19:05:05.617583] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-08T19:05:05.806371] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T19:05:06.093051] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-08T19:05:06.094395] [INFO ] [REMOTE ] GBAB: Full fetch complete (19542 records). [2025-10-08T19:05:06.094469] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-08T19:05:06.422811] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-08T19:05:06.465981] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-08T19:05:06.466071] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-08T19:05:06.466536] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-08T19:05:06.466578] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-08T19:05:06.467198] [DEBUG] [LOCAL ] GBAB: Trimmed 19542 records to 13043 (keeping 200 days of data) [2025-10-08T19:05:06.554192] [DEBUG] [LOCAL ] GBAB: Primary data saved (13043 records). [2025-10-08T19:05:06.554362] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-08T19:05:06.554453] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBAB took 27.9s. Estimated remaining: 3h 25m 51s. Rate: 7.2 symbols/min [2025-10-08T19:05:06.734375] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:06.768260] [DEBUG] [LOCAL ] GBX: Loaded 29133 existing records from primary storage. [2025-10-08T19:05:06.768637] [INFO ] [MAIN ] GBX: Loaded 29133 existing records. [2025-10-08T19:05:06.948158] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:06.948388] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-08T19:05:06.948460] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-08T19:05:06.949454] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-08T19:05:06.949515] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-08T19:05:07.228707] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-08T19:05:07.234757] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:05:07.325054] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:07.350430] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T19:05:08.017615] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-08T19:05:08.310152] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-08T19:05:08.337119] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T19:05:08.817566] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-08T19:05:09.156185] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-08T19:05:09.617602] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-08T19:05:09.930117] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-08T19:05:10.417558] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-08T19:05:10.881680] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T19:05:11.217609] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-08T19:05:11.492544] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T19:05:12.017545] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-08T19:05:12.367604] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T19:05:12.817677] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-08T19:05:13.617558] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-08T19:05:14.124971] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T19:05:14.227398] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T19:05:14.417540] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-08T19:05:15.217621] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-08T19:05:15.395026] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T19:05:16.017561] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-08T19:05:16.805372] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T19:05:16.817483] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-08T19:05:17.589880] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:05:17.617507] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-08T19:05:18.089111] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T19:05:18.417548] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-08T19:05:19.118326] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T19:05:19.217563] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-08T19:05:19.356504] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T19:05:19.486367] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-08T19:05:20.017574] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-08T19:05:20.407062] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T19:05:20.408030] [INFO ] [REMOTE ] GBLI: Full fetch complete (1310 records). [2025-10-08T19:05:20.408119] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-08T19:05:20.600360] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-08T19:05:20.600593] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:05:20.600686] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:05:20.600757] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-08T19:05:20.600837] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-08T19:05:20.600892] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-08T19:05:20.600936] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-08T19:05:20.601010] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBLI took 22.2s. Estimated remaining: 3h 25m 52s. Rate: 7.2 symbols/min [2025-10-08T19:05:20.769491] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:20.812955] [DEBUG] [LOCAL ] GCI: Loaded 44112 existing records from primary storage. [2025-10-08T19:05:20.813377] [INFO ] [MAIN ] GCI: Loaded 44112 existing records. [2025-10-08T19:05:20.824167] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-08T19:05:20.996213] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:20.996435] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-08T19:05:20.996482] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-08T19:05:20.997909] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-08T19:05:20.997973] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-08T19:05:21.362809] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:21.617554] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-08T19:05:22.417542] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-08T19:05:22.653527] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T19:05:22.738917] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T19:05:23.217560] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-08T19:05:23.551406] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T19:05:24.017549] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-08T19:05:24.407166] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T19:05:24.817579] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-08T19:05:25.223552] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T19:05:25.617568] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-08T19:05:26.166920] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T19:05:26.417537] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-08T19:05:26.837545] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T19:05:27.217606] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-08T19:05:27.730999] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T19:05:28.017572] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-08T19:05:28.751264] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:05:28.817576] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-08T19:05:29.558638] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T19:05:29.562699] [INFO ] [REMOTE ] GBCI: Full fetch complete (58587 records). [2025-10-08T19:05:29.562841] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-08T19:05:29.629738] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-08T19:05:29.964126] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-08T19:05:29.964236] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-08T19:05:29.965211] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-08T19:05:29.965363] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-08T19:05:30.000935] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:05:29.999783] [DEBUG] [LOCAL ] GBCI: Trimmed 58587 records to 40512 (keeping 200 days of data) [2025-10-08T19:05:30.258956] [DEBUG] [LOCAL ] GBCI: Primary data saved (40512 records). [2025-10-08T19:05:30.259087] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-08T19:05:30.259164] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBCI took 47.4s. Estimated remaining: 3h 25m 46s. Rate: 7.2 symbols/min [2025-10-08T19:05:30.426711] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-08T19:05:30.430002] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:30.453915] [DEBUG] [LOCAL ] GCO: Loaded 24194 existing records from primary storage. [2025-10-08T19:05:30.454183] [INFO ] [MAIN ] GCO: Loaded 24194 existing records. [2025-10-08T19:05:30.628747] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:30.628983] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-08T19:05:30.629047] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-08T19:05:30.629844] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-08T19:05:30.629904] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-08T19:05:30.985143] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:31.217548] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-08T19:05:31.344001] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T19:05:31.412056] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T19:05:32.017555] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-08T19:05:32.447869] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T19:05:32.817549] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-08T19:05:33.047987] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:05:33.617609] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-08T19:05:34.040008] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T19:05:34.417511] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-08T19:05:34.743728] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T19:05:35.217602] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-08T19:05:36.017540] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-08T19:05:36.156491] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T19:05:36.250111] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T19:05:36.689373] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T19:05:36.817621] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-08T19:05:37.617555] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-08T19:05:38.195856] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T19:05:38.417555] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-08T19:05:39.061524] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T19:05:39.217523] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-08T19:05:39.474760] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T19:05:39.477874] [INFO ] [REMOTE ] GBTG: Full fetch complete (56533 records). [2025-10-08T19:05:39.477956] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-08T19:05:39.857582] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-08T19:05:39.857687] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-08T19:05:39.858465] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-08T19:05:39.858529] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-08T19:05:39.859672] [DEBUG] [LOCAL ] GBTG: Trimmed 56533 records to 40036 (keeping 200 days of data) [2025-10-08T19:05:40.025449] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-08T19:05:40.087551] [DEBUG] [LOCAL ] GBTG: Primary data saved (40036 records). [2025-10-08T19:05:40.087692] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-08T19:05:40.087814] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBTG took 36.5s. Estimated remaining: 3h 25m 40s. Rate: 7.2 symbols/min [2025-10-08T19:05:40.263488] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:40.284722] [DEBUG] [LOCAL ] GCTS: Loaded 20339 existing records from primary storage. [2025-10-08T19:05:40.284975] [INFO ] [MAIN ] GCTS: Loaded 20339 existing records. [2025-10-08T19:05:40.460566] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T19:05:40.509259] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:40.509713] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-08T19:05:40.510312] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-08T19:05:40.510948] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-08T19:05:40.511015] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-08T19:05:40.822779] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-08T19:05:40.862145] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:40.945681] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:05:41.617573] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-08T19:05:41.881898] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T19:05:42.417528] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-08T19:05:42.514498] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T19:05:43.217571] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-08T19:05:43.740937] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:05:44.017573] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-08T19:05:44.403484] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:05:44.405796] [INFO ] [REMOTE ] GBX: Full fetch complete (42716 records). [2025-10-08T19:05:44.405874] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-08T19:05:44.803766] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-08T19:05:44.803866] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-08T19:05:44.804539] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-08T19:05:44.804580] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-08T19:05:44.805461] [DEBUG] [LOCAL ] GBX: Trimmed 42716 records to 29122 (keeping 200 days of data) [2025-10-08T19:05:44.861144] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-08T19:05:44.984335] [DEBUG] [LOCAL ] GBX: Primary data saved (29122 records). [2025-10-08T19:05:44.984502] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-08T19:05:44.984603] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GBX took 38.4s. Estimated remaining: 3h 25m 26s. Rate: 7.2 symbols/min [2025-10-08T19:05:45.154151] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:45.162720] [DEBUG] [LOCAL ] GCV: Loaded 7535 existing records from primary storage. [2025-10-08T19:05:45.162948] [INFO ] [MAIN ] GCV: Loaded 7535 existing records. [2025-10-08T19:05:45.341068] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:45.341283] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-08T19:05:45.341330] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-08T19:05:45.341873] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-08T19:05:45.341933] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-08T19:05:45.623201] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-08T19:05:45.706341] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:45.733820] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T19:05:46.209588] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T19:05:46.321511] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T19:05:46.417564] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-08T19:05:47.217610] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-08T19:05:48.023069] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-08T19:05:48.035284] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:05:48.094284] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T19:05:48.449345] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-08T19:05:48.817638] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-08T19:05:49.282898] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T19:05:49.617583] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-08T19:05:50.417577] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-08T19:05:50.636400] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T19:05:51.217589] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-08T19:05:51.834738] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T19:05:52.017599] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-08T19:05:52.097428] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T19:05:52.798529] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T19:05:52.817504] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-08T19:05:53.617516] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-08T19:05:53.907977] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T19:05:54.121694] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T19:05:54.417551] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-08T19:05:54.930756] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T19:05:55.217567] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-08T19:05:56.017620] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-08T19:05:56.731873] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:05:56.817579] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-08T19:05:57.127307] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T19:05:57.617586] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-08T19:05:58.158245] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T19:05:58.161701] [INFO ] [REMOTE ] GCI: Full fetch complete (63239 records). [2025-10-08T19:05:58.161802] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-08T19:05:58.294016] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T19:05:58.422726] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-08T19:05:58.603597] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-08T19:05:58.603780] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-08T19:05:58.604783] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-08T19:05:58.604854] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-08T19:05:58.606337] [DEBUG] [LOCAL ] GCI: Trimmed 63239 records to 44080 (keeping 200 days of data) [2025-10-08T19:05:58.854594] [DEBUG] [LOCAL ] GCI: Primary data saved (44080 records). [2025-10-08T19:05:58.854774] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-08T19:05:58.854871] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCI took 38.3s. Estimated remaining: 3h 25m 26s. Rate: 7.2 symbols/min [2025-10-08T19:05:59.024900] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:59.068382] [DEBUG] [LOCAL ] GD: Loaded 46964 existing records from primary storage. [2025-10-08T19:05:59.068788] [INFO ] [MAIN ] GD: Loaded 46964 existing records. [2025-10-08T19:05:59.176946] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:05:59.223891] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-08T19:05:59.268769] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:59.268994] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-08T19:05:59.269042] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-08T19:05:59.270893] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-08T19:05:59.270977] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-08T19:05:59.629477] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:00.017628] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-08T19:06:00.429985] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T19:06:00.619010] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T19:06:00.817548] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-08T19:06:01.617521] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-08T19:06:01.635569] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T19:06:01.637889] [INFO ] [REMOTE ] GCO: Full fetch complete (35302 records). [2025-10-08T19:06:01.638017] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-08T19:06:02.103850] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-08T19:06:02.103971] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-08T19:06:02.104746] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-08T19:06:02.104811] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-08T19:06:02.105682] [DEBUG] [LOCAL ] GCO: Trimmed 35302 records to 24065 (keeping 200 days of data) [2025-10-08T19:06:02.253000] [DEBUG] [LOCAL ] GCO: Primary data saved (24065 records). [2025-10-08T19:06:02.253141] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-08T19:06:02.253224] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCO took 32.0s. Estimated remaining: 3h 25m 10s. Rate: 7.2 symbols/min [2025-10-08T19:06:02.420843] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:02.418097] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-08T19:06:02.468365] [DEBUG] [LOCAL ] GDDY: Loaded 49795 existing records from primary storage. [2025-10-08T19:06:02.468780] [INFO ] [MAIN ] GDDY: Loaded 49795 existing records. [2025-10-08T19:06:02.631764] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T19:06:02.666077] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:02.666728] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-08T19:06:02.666815] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-08T19:06:02.668176] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-08T19:06:02.668234] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-08T19:06:03.022122] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:03.183420] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T19:06:03.217551] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-08T19:06:03.811454] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T19:06:04.017556] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-08T19:06:04.817601] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-08T19:06:04.911468] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T19:06:05.617549] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-08T19:06:06.417520] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-08T19:06:06.688886] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T19:06:07.017810] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T19:06:07.217561] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-08T19:06:07.262162] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T19:06:08.017509] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-08T19:06:08.395314] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:06:08.817587] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-08T19:06:09.617532] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-08T19:06:09.974765] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-08T19:06:10.270435] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T19:06:10.372360] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T19:06:10.373682] [INFO ] [REMOTE ] GCV: Full fetch complete (9616 records). [2025-10-08T19:06:10.373757] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-08T19:06:10.427736] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-08T19:06:10.743041] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-08T19:06:10.743125] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-08T19:06:10.743362] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-08T19:06:10.743401] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-08T19:06:10.743863] [DEBUG] [LOCAL ] GCV: Trimmed 9616 records to 7565 (keeping 200 days of data) [2025-10-08T19:06:10.787435] [DEBUG] [LOCAL ] GCV: Primary data saved (7565 records). [2025-10-08T19:06:10.787558] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-08T19:06:10.787639] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 25.8s. Estimated remaining: 3h 25m 2s. Rate: 7.2 symbols/min [2025-10-08T19:06:10.959512] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:10.964619] [DEBUG] [LOCAL ] GDIV: Loaded 3613 existing records from primary storage. [2025-10-08T19:06:10.964809] [INFO ] [MAIN ] GDIV: Loaded 3613 existing records. [2025-10-08T19:06:11.149393] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:11.149759] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-08T19:06:11.149819] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-08T19:06:11.150138] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-08T19:06:11.150197] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-08T19:06:11.224507] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-08T19:06:11.502942] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:12.017577] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-08T19:06:12.203919] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:06:12.513603] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T19:06:12.817559] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-08T19:06:13.617521] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-08T19:06:13.788329] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T19:06:13.955054] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-08T19:06:14.206374] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T19:06:14.417552] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-08T19:06:15.217574] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-08T19:06:16.017601] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-08T19:06:16.121014] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T19:06:16.817548] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-08T19:06:16.977403] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T19:06:17.031191] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T19:06:17.138101] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-08T19:06:17.617570] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-08T19:06:18.417563] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-08T19:06:19.151211] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:06:19.217591] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-08T19:06:19.493823] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T19:06:20.017638] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-08T19:06:20.817590] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-08T19:06:20.882289] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T19:06:20.923906] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T19:06:21.267626] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T19:06:21.617536] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-08T19:06:22.191887] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T19:06:22.417545] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-08T19:06:23.217563] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-08T19:06:23.557859] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T19:06:23.560114] [INFO ] [REMOTE ] GCTS: Full fetch complete (27044 records). [2025-10-08T19:06:23.560190] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-08T19:06:23.967573] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-08T19:06:23.967936] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-08T19:06:23.968719] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-08T19:06:23.968785] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-08T19:06:23.969758] [DEBUG] [LOCAL ] GCTS: Trimmed 27044 records to 20353 (keeping 200 days of data) [2025-10-08T19:06:24.024064] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-08T19:06:24.087062] [DEBUG] [LOCAL ] GCTS: Primary data saved (20353 records). [2025-10-08T19:06:24.087194] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-08T19:06:24.087278] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCTS took 44.0s. Estimated remaining: 3h 25m 1s. Rate: 7.2 symbols/min [2025-10-08T19:06:24.255452] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:24.260277] [DEBUG] [LOCAL ] GDL: Loaded 2551 existing records from primary storage. [2025-10-08T19:06:24.260451] [INFO ] [MAIN ] GDL: Loaded 2551 existing records. [2025-10-08T19:06:24.445988] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:24.446288] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-08T19:06:24.446407] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-08T19:06:24.446883] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-08T19:06:24.446945] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-08T19:06:24.667170] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T19:06:24.830409] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-08T19:06:24.836790] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:24.896762] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T19:06:25.617603] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-08T19:06:26.057614] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T19:06:26.330334] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:06:26.417488] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-08T19:06:27.217606] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-08T19:06:27.906093] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T19:06:27.939139] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:06:28.017507] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-08T19:06:28.817551] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-08T19:06:29.617554] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-08T19:06:29.735432] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T19:06:30.214145] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T19:06:30.231594] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T19:06:30.417544] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-08T19:06:31.217575] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-08T19:06:31.697914] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T19:06:31.876084] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T19:06:32.017581] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-08T19:06:32.378283] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-08T19:06:32.817618] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-08T19:06:33.100685] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-08T19:06:33.617524] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-08T19:06:34.417561] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-08T19:06:35.225205] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-08T19:06:35.242041] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:06:35.741113] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T19:06:35.744466] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:06:36.017594] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-08T19:06:36.817563] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-08T19:06:37.617616] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-08T19:06:37.622414] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:06:38.059712] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T19:06:38.212509] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:06:38.218116] [INFO ] [REMOTE ] GDDY: Full fetch complete (71761 records). [2025-10-08T19:06:38.218465] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-08T19:06:38.425915] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-08T19:06:38.655041] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-08T19:06:38.655170] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-08T19:06:38.656464] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-08T19:06:38.656548] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-08T19:06:38.658666] [DEBUG] [LOCAL ] GDDY: Trimmed 71761 records to 49785 (keeping 200 days of data) [2025-10-08T19:06:38.986705] [DEBUG] [LOCAL ] GDDY: Primary data saved (49785 records). [2025-10-08T19:06:38.986890] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-08T19:06:38.987057] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDDY took 36.7s. Estimated remaining: 3h 25m 3s. Rate: 7.1 symbols/min [2025-10-08T19:06:39.155249] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:39.162875] [DEBUG] [LOCAL ] GDO: Loaded 5920 existing records from primary storage. [2025-10-08T19:06:39.163092] [INFO ] [MAIN ] GDO: Loaded 5920 existing records. [2025-10-08T19:06:39.224460] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-08T19:06:39.341032] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:39.341252] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-08T19:06:39.341299] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-08T19:06:39.341580] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-08T19:06:39.341639] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-08T19:06:39.697586] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:39.737791] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T19:06:40.017557] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-08T19:06:40.146731] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T19:06:40.151101] [INFO ] [REMOTE ] GD: Full fetch complete (69994 records). [2025-10-08T19:06:40.151252] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-08T19:06:40.479571] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T19:06:40.547580] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-08T19:06:40.547754] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-08T19:06:40.548807] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-08T19:06:40.548875] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-08T19:06:40.550418] [DEBUG] [LOCAL ] GD: Trimmed 69994 records to 46879 (keeping 200 days of data) [2025-10-08T19:06:40.824921] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-08T19:06:40.850747] [DEBUG] [LOCAL ] GD: Primary data saved (46879 records). [2025-10-08T19:06:40.850908] [INFO ] [MAIN ] GD: Full history saved. [2025-10-08T19:06:40.851015] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GD took 42.0s. Estimated remaining: 3h 24m 44s. Rate: 7.2 symbols/min [2025-10-08T19:06:41.019602] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:41.057765] [DEBUG] [LOCAL ] GDOT: Loaded 37959 existing records from primary storage. [2025-10-08T19:06:41.058114] [INFO ] [MAIN ] GDOT: Loaded 37959 existing records. [2025-10-08T19:06:41.244684] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:41.244903] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-08T19:06:41.244974] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-08T19:06:41.246249] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-08T19:06:41.246314] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-08T19:06:41.357514] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-08T19:06:41.621094] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-08T19:06:41.624929] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:42.417565] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-08T19:06:42.466088] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T19:06:42.880866] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T19:06:43.217559] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-08T19:06:43.758126] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T19:06:44.017573] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-08T19:06:44.486148] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-08T19:06:44.817571] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-08T19:06:45.372545] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T19:06:45.617525] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-08T19:06:46.093820] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T19:06:46.094556] [INFO ] [REMOTE ] GDL: Full fetch complete (3605 records). [2025-10-08T19:06:46.094680] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-08T19:06:46.422748] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-08T19:06:46.453193] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-08T19:06:46.453263] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-08T19:06:46.453384] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-08T19:06:46.453422] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-08T19:06:46.453818] [DEBUG] [LOCAL ] GDL: Trimmed 3605 records to 2553 (keeping 200 days of data) [2025-10-08T19:06:46.469424] [DEBUG] [LOCAL ] GDL: Primary data saved (2553 records). [2025-10-08T19:06:46.469487] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-08T19:06:46.469567] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 22.4s. Estimated remaining: 3h 24m 32s. Rate: 7.2 symbols/min [2025-10-08T19:06:46.637822] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:46.656435] [DEBUG] [LOCAL ] GDV: Loaded 19508 existing records from primary storage. [2025-10-08T19:06:46.656759] [INFO ] [MAIN ] GDV: Loaded 19508 existing records. [2025-10-08T19:06:46.842955] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:46.843154] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-08T19:06:46.843202] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-08T19:06:46.843844] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-08T19:06:46.843911] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-08T19:06:47.219149] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-08T19:06:47.219088] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:47.225470] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:06:47.723267] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T19:06:47.724151] [INFO ] [REMOTE ] GDIV: Full fetch complete (5469 records). [2025-10-08T19:06:47.724220] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-08T19:06:48.022678] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-08T19:06:48.077714] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-08T19:06:48.077809] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-08T19:06:48.078024] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-08T19:06:48.078071] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-08T19:06:48.078494] [DEBUG] [LOCAL ] GDIV: Trimmed 5469 records to 3609 (keeping 200 days of data) [2025-10-08T19:06:48.103821] [DEBUG] [LOCAL ] GDIV: Primary data saved (3609 records). [2025-10-08T19:06:48.103984] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-08T19:06:48.104076] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDIV took 37.3s. Estimated remaining: 3h 24m 12s. Rate: 7.2 symbols/min [2025-10-08T19:06:48.271710] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:48.329989] [DEBUG] [LOCAL ] GE: Loaded 53712 existing records from primary storage. [2025-10-08T19:06:48.330395] [INFO ] [MAIN ] GE: Loaded 53712 existing records. [2025-10-08T19:06:48.510547] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:48.510822] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-08T19:06:48.510870] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-08T19:06:48.512723] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-08T19:06:48.512788] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-08T19:06:48.827004] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-08T19:06:48.868863] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:49.381564] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T19:06:49.556717] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T19:06:49.617594] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-08T19:06:50.417608] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-08T19:06:50.841358] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T19:06:51.217531] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-08T19:06:51.265248] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T19:06:51.814080] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T19:06:52.017544] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-08T19:06:52.817576] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-08T19:06:52.946555] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T19:06:53.617558] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-08T19:06:54.081131] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:06:54.353634] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:06:54.417606] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-08T19:06:55.021240] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T19:06:55.217623] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-08T19:06:56.017549] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-08T19:06:56.514934] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:06:56.817580] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-08T19:06:57.147301] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T19:06:57.617578] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-08T19:06:57.906184] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T19:06:58.031695] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T19:06:58.417631] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-08T19:06:59.055992] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T19:06:59.217622] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-08T19:07:00.017559] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-08T19:07:00.628638] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T19:07:00.817522] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-08T19:07:01.265992] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T19:07:01.267700] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T19:07:01.617548] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-08T19:07:02.417561] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-08T19:07:03.217507] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-08T19:07:03.430723] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T19:07:03.711747] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-08T19:07:03.715577] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T19:07:04.017622] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-08T19:07:04.817861] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-08T19:07:05.305204] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:07:05.617553] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-08T19:07:06.407687] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:07:06.417697] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-08T19:07:06.815234] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-08T19:07:07.023409] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T19:07:07.217573] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-08T19:07:08.017554] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-08T19:07:08.583517] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:07:08.817520] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-08T19:07:09.551248] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T19:07:09.552322] [INFO ] [REMOTE ] GDO: Full fetch complete (8761 records). [2025-10-08T19:07:09.552416] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-08T19:07:09.626228] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-08T19:07:09.940195] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-08T19:07:09.940344] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-08T19:07:09.940791] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-08T19:07:09.940900] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-08T19:07:09.941499] [DEBUG] [LOCAL ] GDO: Trimmed 8761 records to 5927 (keeping 200 days of data) [2025-10-08T19:07:10.007129] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:07:10.027464] [DEBUG] [LOCAL ] GDO: Primary data saved (5927 records). [2025-10-08T19:07:10.027660] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-08T19:07:10.027780] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 31.0s. Estimated remaining: 3h 24m 26s. Rate: 7.2 symbols/min [2025-10-08T19:07:10.193532] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:10.214810] [DEBUG] [LOCAL ] GEF: Loaded 20741 existing records from primary storage. [2025-10-08T19:07:10.215079] [INFO ] [MAIN ] GEF: Loaded 20741 existing records. [2025-10-08T19:07:10.404243] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:10.414623] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-08T19:07:10.415158] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-08T19:07:10.415501] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T19:07:10.417045] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-08T19:07:10.420720] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-08T19:07:10.419623] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-08T19:07:10.785530] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:11.217569] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-08T19:07:12.017526] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-08T19:07:12.101988] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T19:07:12.789255] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T19:07:12.817502] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-08T19:07:13.058156] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T19:07:13.617592] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-08T19:07:14.358240] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T19:07:14.417503] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-08T19:07:15.102726] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-08T19:07:15.217599] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-08T19:07:15.541592] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T19:07:15.976849] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:07:16.017508] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-08T19:07:16.817588] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-08T19:07:17.073627] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T19:07:17.617623] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-08T19:07:18.386907] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:07:18.417522] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-08T19:07:18.546789] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T19:07:19.217523] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-08T19:07:19.598755] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:07:19.953483] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T19:07:19.955255] [INFO ] [REMOTE ] GDV: Full fetch complete (28483 records). [2025-10-08T19:07:19.955328] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-08T19:07:20.022973] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-08T19:07:20.338183] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-08T19:07:20.338279] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-08T19:07:20.339041] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-08T19:07:20.339110] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-08T19:07:20.340062] [DEBUG] [LOCAL ] GDV: Trimmed 28483 records to 19517 (keeping 200 days of data) [2025-10-08T19:07:20.466014] [DEBUG] [LOCAL ] GDV: Primary data saved (19517 records). [2025-10-08T19:07:20.466195] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-08T19:07:20.466352] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDV took 34.0s. Estimated remaining: 3h 24m 21s. Rate: 7.1 symbols/min [2025-10-08T19:07:20.645189] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:20.681778] [DEBUG] [LOCAL ] GEL: Loaded 32496 existing records from primary storage. [2025-10-08T19:07:20.682151] [INFO ] [MAIN ] GEL: Loaded 32496 existing records. [2025-10-08T19:07:20.831956] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-08T19:07:20.876348] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:20.876873] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-08T19:07:20.876946] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-08T19:07:20.877207] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-08T19:07:20.877267] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-08T19:07:21.250758] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:21.617530] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-08T19:07:21.957114] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T19:07:22.372999] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-08T19:07:22.417632] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-08T19:07:23.206274] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T19:07:23.217485] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-08T19:07:23.342634] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T19:07:24.017558] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-08T19:07:24.415823] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:07:24.420094] [INFO ] [REMOTE ] GDOT: Full fetch complete (53159 records). [2025-10-08T19:07:24.420305] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-08T19:07:24.817944] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-08T19:07:24.837763] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-08T19:07:24.837928] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-08T19:07:24.838766] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-08T19:07:24.838971] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-08T19:07:24.840571] [DEBUG] [LOCAL ] GDOT: Trimmed 53159 records to 37785 (keeping 200 days of data) [2025-10-08T19:07:24.952585] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T19:07:25.095531] [DEBUG] [LOCAL ] GDOT: Primary data saved (37785 records). [2025-10-08T19:07:25.095725] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-08T19:07:25.095840] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDOT took 44.2s. Estimated remaining: 3h 24m 6s. Rate: 7.2 symbols/min [2025-10-08T19:07:25.262871] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:25.312737] [DEBUG] [LOCAL ] GENI: Loaded 52945 existing records from primary storage. [2025-10-08T19:07:25.313086] [INFO ] [MAIN ] GENI: Loaded 52945 existing records. [2025-10-08T19:07:25.488418] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:25.488955] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-08T19:07:25.489005] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-08T19:07:25.489210] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-08T19:07:25.489267] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-08T19:07:25.628880] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-08T19:07:25.848190] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:26.417612] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-08T19:07:26.877293] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T19:07:27.125854] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-08T19:07:27.217503] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-08T19:07:27.243760] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:07:28.017529] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-08T19:07:28.522917] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:07:28.817585] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-08T19:07:29.617621] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-08T19:07:30.096672] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-08T19:07:30.417589] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-08T19:07:30.499013] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T19:07:30.534048] [DEBUG] [REMOTE ] GEL: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-08T19:07:30.534369] [WARN ] [REMOTE ] GEL: No data returned for month 2025-02 [2025-10-08T19:07:30.534462] [FATAL] [REMOTE ] GEL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:07:30.534544] [FATAL] [MAIN ] GEL: Failed to fetch primary data. [2025-10-08T19:07:30.534606] [WARN ] [MAIN ] GEL: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:07:30.534736] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-08T19:07:30.534827] [DEBUG] [LOCAL ] GEL: No primary data file found to delete. [2025-10-08T19:07:30.534883] [INFO ] [LOCAL ] GEL: Starting deletion of derivative data. [2025-10-08T19:07:30.535118] [DEBUG] [LOCAL ] GEL: Deleted derivative data file. [2025-10-08T19:07:30.535205] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEL took 10.1s. Estimated remaining: 3h 23m 53s. Rate: 7.2 symbols/min [2025-10-08T19:07:30.711683] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:30.777147] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T19:07:30.817425] [DEBUG] [LOCAL ] GEO: Loaded 51896 existing records from primary storage. [2025-10-08T19:07:30.817784] [INFO ] [MAIN ] GEO: Loaded 51896 existing records. [2025-10-08T19:07:30.992291] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:30.992527] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-08T19:07:30.992575] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-08T19:07:30.993959] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-08T19:07:30.994019] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-08T19:07:31.227034] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-08T19:07:31.345491] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:32.017710] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-08T19:07:32.817587] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-08T19:07:32.881350] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T19:07:33.313851] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-08T19:07:33.319452] [INFO ] [REMOTE ] GE: Full fetch complete (77771 records). [2025-10-08T19:07:33.319734] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-08T19:07:33.622769] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-08T19:07:33.753782] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-08T19:07:33.753917] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-08T19:07:33.755252] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-08T19:07:33.755322] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-08T19:07:33.757867] [DEBUG] [LOCAL ] GE: Trimmed 77771 records to 53706 (keeping 200 days of data) [2025-10-08T19:07:34.148734] [DEBUG] [LOCAL ] GE: Primary data saved (53706 records). [2025-10-08T19:07:34.149400] [INFO ] [MAIN ] GE: Full history saved. [2025-10-08T19:07:34.149664] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GE took 46.0s. Estimated remaining: 3h 23m 37s. Rate: 7.2 symbols/min [2025-10-08T19:07:34.348348] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:34.420417] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-08T19:07:34.418658] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T19:07:34.422714] [DEBUG] [LOCAL ] GES: Loaded 38833 existing records from primary storage. [2025-10-08T19:07:34.433499] [INFO ] [MAIN ] GES: Loaded 38833 existing records. [2025-10-08T19:07:34.554709] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T19:07:34.608485] [INFO ] [REMOTE ] GEF: Full fetch complete (29402 records). [2025-10-08T19:07:34.629491] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-08T19:07:34.629288] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:34.630299] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-08T19:07:34.630526] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-08T19:07:34.636906] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-08T19:07:34.696492] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-08T19:07:35.221128] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-08T19:07:35.417328] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-08T19:07:35.421199] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-08T19:07:35.421125] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:35.422270] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-08T19:07:35.422339] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-08T19:07:35.423430] [DEBUG] [LOCAL ] GEF: Trimmed 29402 records to 20665 (keeping 200 days of data) [2025-10-08T19:07:35.549359] [DEBUG] [LOCAL ] GEF: Primary data saved (20665 records). [2025-10-08T19:07:35.549518] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-08T19:07:35.549602] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEF took 25.5s. Estimated remaining: 3h 23m 18s. Rate: 7.2 symbols/min [2025-10-08T19:07:35.718788] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:35.754433] [DEBUG] [LOCAL ] GETY: Loaded 35311 existing records from primary storage. [2025-10-08T19:07:35.754859] [INFO ] [MAIN ] GETY: Loaded 35311 existing records. [2025-10-08T19:07:35.935124] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:35.935347] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-08T19:07:35.935394] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-08T19:07:35.936411] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-08T19:07:35.936473] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-08T19:07:36.032408] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-08T19:07:36.323719] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:36.468963] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T19:07:36.605103] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:07:36.817591] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-08T19:07:37.395103] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T19:07:37.617560] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-08T19:07:38.259194] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T19:07:38.417560] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-08T19:07:39.116877] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T19:07:39.217499] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-08T19:07:40.017506] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-08T19:07:40.208296] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:07:40.406520] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T19:07:40.817555] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-08T19:07:41.617565] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-08T19:07:41.943259] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T19:07:42.300997] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:07:42.417552] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-08T19:07:43.217600] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-08T19:07:43.373734] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T19:07:43.929598] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T19:07:44.017530] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-08T19:07:44.819977] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-08T19:07:44.825802] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:07:45.544379] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T19:07:45.617510] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-08T19:07:46.417606] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-08T19:07:46.539221] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T19:07:47.217518] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-08T19:07:47.411431] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:07:48.023532] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-08T19:07:48.045467] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T19:07:48.738059] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T19:07:48.817536] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-08T19:07:49.489822] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T19:07:49.617619] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-08T19:07:50.299804] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:07:50.417507] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-08T19:07:50.876396] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T19:07:51.217574] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-08T19:07:52.017679] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-08T19:07:52.312117] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T19:07:52.817576] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-08T19:07:52.957520] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T19:07:53.100988] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T19:07:53.617594] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-08T19:07:54.264136] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:07:54.417700] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-08T19:07:54.754866] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:07:55.217575] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-08T19:07:56.017567] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-08T19:07:56.262907] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T19:07:56.295022] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T19:07:56.817622] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-08T19:07:57.436545] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T19:07:57.617609] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-08T19:07:58.417511] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-08T19:07:58.474605] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T19:07:59.222726] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-08T19:07:59.236364] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:08:00.017607] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-08T19:08:00.246129] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T19:08:00.817546] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-08T19:08:01.106023] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:08:01.146688] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T19:08:01.617573] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-08T19:08:02.362181] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T19:08:02.417579] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-08T19:08:03.217564] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-08T19:08:03.520861] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T19:08:03.525347] [INFO ] [REMOTE ] GENI: Full fetch complete (75601 records). [2025-10-08T19:08:03.525531] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-08T19:08:03.833222] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:08:03.836466] [INFO ] [REMOTE ] GETY: Full fetch complete (55520 records). [2025-10-08T19:08:03.847161] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-08T19:08:04.018536] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-08T19:08:04.066789] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-08T19:08:04.114560] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-08T19:08:04.131266] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-08T19:08:04.133679] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-08T19:08:04.252993] [DEBUG] [LOCAL ] GENI: Trimmed 75601 records to 52944 (keeping 200 days of data) [2025-10-08T19:08:04.445501] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-08T19:08:04.447335] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-08T19:08:04.448146] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-08T19:08:04.448227] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-08T19:08:04.455026] [DEBUG] [LOCAL ] GETY: Trimmed 55520 records to 35367 (keeping 200 days of data) [2025-10-08T19:08:04.898234] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T19:08:04.922159] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-08T19:08:04.948375] [DEBUG] [LOCAL ] GENI: Primary data saved (52944 records). [2025-10-08T19:08:04.949713] [DEBUG] [LOCAL ] GETY: Primary data saved (35367 records). [2025-10-08T19:08:04.949909] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-08T19:08:04.949992] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-08T19:08:04.950113] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GETY took 29.4s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-08T19:08:04.961711] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GENI took 39.9s. Estimated remaining: 3h 23m 21s. Rate: 7.2 symbols/min [2025-10-08T19:08:05.262319] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:05.359785] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:05.358078] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T19:08:05.365136] [INFO ] [REMOTE ] GES: Full fetch complete (59014 records). [2025-10-08T19:08:05.365263] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-08T19:08:05.444214] [DEBUG] [LOCAL ] GF: Loaded 2801 existing records from primary storage. [2025-10-08T19:08:05.467439] [INFO ] [MAIN ] GF: Loaded 2801 existing records. [2025-10-08T19:08:05.846113] [DEBUG] [LOCAL ] GEV: Loaded 53018 existing records from primary storage. [2025-10-08T19:08:05.900367] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:05.903714] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-08T19:08:05.903924] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-08T19:08:05.904039] [INFO ] [MAIN ] GEV: Loaded 53018 existing records. [2025-10-08T19:08:05.925024] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-08T19:08:05.965210] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-08T19:08:06.221376] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-08T19:08:06.297442] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-08T19:08:06.297273] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:06.309053] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-08T19:08:06.314418] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-08T19:08:06.327988] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-08T19:08:06.338551] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-08T19:08:06.365984] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-08T19:08:06.381251] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-08T19:08:06.462144] [DEBUG] [LOCAL ] GES: Trimmed 59014 records to 38643 (keeping 200 days of data) [2025-10-08T19:08:06.777000] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:06.788617] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-08T19:08:07.084331] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:07.100620] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-08T19:08:07.105311] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-08T19:08:07.218413] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-08T19:08:07.245166] [DEBUG] [LOCAL ] GES: Primary data saved (38643 records). [2025-10-08T19:08:07.245288] [INFO ] [MAIN ] GES: Full history saved. [2025-10-08T19:08:07.245367] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GES took 33.1s. Estimated remaining: 3h 23m 3s. Rate: 7.2 symbols/min [2025-10-08T19:08:07.482094] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T19:08:08.017567] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-08T19:08:08.574714] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T19:08:08.817552] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-08T19:08:08.917223] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T19:08:09.175760] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-08T19:08:09.377417] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-08T19:08:09.617590] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-08T19:08:10.327677] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T19:08:10.417522] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-08T19:08:11.217547] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-08T19:08:11.923981] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T19:08:12.017707] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-08T19:08:12.624376] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-08T19:08:12.639514] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T19:08:12.817590] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-08T19:08:13.311675] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T19:08:13.617628] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-08T19:08:14.417589] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-08T19:08:14.812175] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-08T19:08:15.217555] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-08T19:08:15.709589] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-08T19:08:15.737803] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-08T19:08:16.017563] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-08T19:08:16.817693] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-08T19:08:17.617517] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-08T19:08:17.735745] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T19:08:17.898858] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-08T19:08:18.417559] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-08T19:08:18.807036] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:08:18.866708] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T19:08:18.867517] [INFO ] [REMOTE ] GF: Full fetch complete (5057 records). [2025-10-08T19:08:18.867586] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-08T19:08:19.219163] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-08T19:08:19.243117] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-08T19:08:19.243208] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-08T19:08:19.243371] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-08T19:08:19.243411] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-08T19:08:19.243831] [DEBUG] [LOCAL ] GF: Trimmed 5057 records to 2781 (keeping 200 days of data) [2025-10-08T19:08:19.261448] [DEBUG] [LOCAL ] GF: Primary data saved (2781 records). [2025-10-08T19:08:19.261703] [INFO ] [MAIN ] GF: Full history saved. [2025-10-08T19:08:19.261800] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GF took 14.3s. Estimated remaining: 3h 23m 0s. Rate: 7.2 symbols/min [2025-10-08T19:08:20.017584] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-08T19:08:21.160598] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T19:08:21.164943] [INFO ] [REMOTE ] GEO: Full fetch complete (75445 records). [2025-10-08T19:08:21.165065] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-08T19:08:21.632077] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-08T19:08:21.632169] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-08T19:08:21.633133] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-08T19:08:21.633199] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-08T19:08:21.634599] [DEBUG] [LOCAL ] GEO: Trimmed 75445 records to 51887 (keeping 200 days of data) [2025-10-08T19:08:21.945315] [DEBUG] [LOCAL ] GEO: Primary data saved (51887 records). [2025-10-08T19:08:21.945464] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-08T19:08:21.945550] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GEO took 51.4s. Estimated remaining: 3h 22m 43s. Rate: 7.2 symbols/min [2025-10-08T19:08:22.173577] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T19:08:22.185870] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-08T19:08:24.309105] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T19:08:24.322234] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-08T19:08:26.341997] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-08T19:08:26.354182] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-08T19:08:28.773274] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-08T19:08:28.785492] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-08T19:08:31.272193] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-08T19:08:31.283784] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-08T19:08:33.487968] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-08T19:08:33.499465] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-08T19:08:35.719730] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-08T19:08:35.723723] [INFO ] [REMOTE ] GEV: Full fetch complete (76904 records). [2025-10-08T19:08:35.723849] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-08T19:08:36.119422] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-08T19:08:36.119590] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-08T19:08:36.120541] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-08T19:08:36.120604] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-08T19:08:36.122061] [DEBUG] [LOCAL ] GEV: Trimmed 76904 records to 53015 (keeping 200 days of data) [2025-10-08T19:08:36.454032] [DEBUG] [LOCAL ] GEV: Primary data saved (53015 records). [2025-10-08T19:08:36.454180] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-08T19:08:36.455734] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 31.5s. Estimated remaining: 3h 22m 44s. Rate: 7.2 symbols/min [2025-10-08T19:08:37.045587] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:37.186862] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:37.148535] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:37.191193] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:37.210002] [DEBUG] [LOCAL ] GFR: Loaded 8002 existing records from primary storage. [2025-10-08T19:08:37.210551] [INFO ] [MAIN ] GFR: Loaded 8002 existing records. [2025-10-08T19:08:37.316091] [DEBUG] [LOCAL ] GFF: Loaded 30268 existing records from primary storage. [2025-10-08T19:08:37.342867] [INFO ] [MAIN ] GFF: Loaded 30268 existing records. [2025-10-08T19:08:37.439872] [DEBUG] [LOCAL ] GFL: Loaded 47875 existing records from primary storage. [2025-10-08T19:08:37.481215] [INFO ] [MAIN ] GFL: Loaded 47875 existing records. [2025-10-08T19:08:37.577064] [DEBUG] [LOCAL ] GFI: Loaded 53101 existing records from primary storage. [2025-10-08T19:08:37.670715] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:37.735712] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-08T19:08:37.680829] [INFO ] [MAIN ] GFI: Loaded 53101 existing records. [2025-10-08T19:08:37.741158] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-08T19:08:37.798801] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:37.856039] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-08T19:08:37.847775] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-08T19:08:37.869860] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-08T19:08:37.870041] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-08T19:08:37.905888] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-08T19:08:37.963755] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-08T19:08:38.283080] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:38.286867] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:38.318097] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-08T19:08:38.318279] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-08T19:08:38.380888] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-08T19:08:38.381412] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-08T19:08:38.394050] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-08T19:08:38.420663] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-08T19:08:38.420829] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-08T19:08:38.446020] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-08T19:08:39.254587] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:39.323129] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-08T19:08:39.306380] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:39.344774] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-08T19:08:39.591047] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:39.617353] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-08T19:08:39.644459] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:39.644881] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-08T19:08:40.243167] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T19:08:40.247164] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-08T19:08:40.671019] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T19:08:40.676926] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-08T19:08:40.848591] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T19:08:40.857419] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-08T19:08:41.046540] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:08:41.049351] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-08T19:08:41.300312] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T19:08:41.310421] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-08T19:08:41.595866] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T19:08:41.598253] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-08T19:08:41.684690] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T19:08:41.690852] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-08T19:08:42.091433] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T19:08:42.101318] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-08T19:08:42.111139] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-08T19:08:42.114099] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-08T19:08:42.839371] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T19:08:42.851006] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-08T19:08:42.946071] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:08:42.953847] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-08T19:08:43.000625] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T19:08:43.006072] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-08T19:08:43.309520] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T19:08:43.318682] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-08T19:08:43.514026] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-08T19:08:43.517378] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-08T19:08:43.913861] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T19:08:43.916110] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-08T19:08:44.058223] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T19:08:44.065712] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-08T19:08:44.289018] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-08T19:08:44.291342] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-08T19:08:44.647178] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T19:08:44.685074] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-08T19:08:44.688239] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T19:08:44.699458] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-08T19:08:44.955388] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T19:08:44.957399] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-08T19:08:45.279405] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:08:45.287456] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-08T19:08:45.467740] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T19:08:45.617590] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-08T19:08:46.137111] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T19:08:46.138265] [INFO ] [REMOTE ] GFR: Full fetch complete (12405 records). [2025-10-08T19:08:46.138337] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-08T19:08:46.521995] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-08T19:08:46.538156] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-08T19:08:46.551937] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:08:46.549898] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-08T19:08:46.562416] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-08T19:08:46.564331] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-08T19:08:46.565668] [DEBUG] [LOCAL ] GFR: Trimmed 12405 records to 7915 (keeping 200 days of data) [2025-10-08T19:08:46.646987] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T19:08:46.680744] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T19:08:46.696577] [DEBUG] [LOCAL ] GFR: Primary data saved (7915 records). [2025-10-08T19:08:46.696723] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-08T19:08:46.696901] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 10.2s. Estimated remaining: 3h 22m 39s. Rate: 7.2 symbols/min [2025-10-08T19:08:46.862365] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:46.915156] [DEBUG] [LOCAL ] GGB: Loaded 51168 existing records from primary storage. [2025-10-08T19:08:46.915512] [INFO ] [MAIN ] GGB: Loaded 51168 existing records. [2025-10-08T19:08:47.088822] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:47.089044] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-08T19:08:47.089090] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-08T19:08:47.089398] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-08T19:08:47.089454] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-08T19:08:47.225429] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-08T19:08:47.441327] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:48.017529] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-08T19:08:48.312883] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:08:48.560115] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T19:08:48.817609] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-08T19:08:49.617584] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-08T19:08:49.828543] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T19:08:50.417588] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-08T19:08:50.702785] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T19:08:51.118417] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T19:08:51.217531] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-08T19:08:51.555704] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:08:52.017561] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-08T19:08:52.526608] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T19:08:52.817557] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-08T19:08:53.119769] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T19:08:53.617620] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-08T19:08:54.345187] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:08:54.417590] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-08T19:08:55.217528] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-08T19:08:55.280665] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T19:08:56.017526] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-08T19:08:56.053688] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T19:08:56.265983] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T19:08:56.817621] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-08T19:08:57.617608] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-08T19:08:57.992342] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-08T19:08:58.417572] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-08T19:08:58.498418] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T19:08:59.163435] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:08:59.217501] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-08T19:08:59.537048] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T19:08:59.542322] [INFO ] [REMOTE ] GFF: Full fetch complete (44159 records). [2025-10-08T19:08:59.542401] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-08T19:08:59.910684] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-08T19:08:59.910801] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-08T19:08:59.911430] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-08T19:08:59.911492] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-08T19:08:59.912390] [DEBUG] [LOCAL ] GFF: Trimmed 44159 records to 30233 (keeping 200 days of data) [2025-10-08T19:09:00.017632] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-08T19:09:00.103592] [DEBUG] [LOCAL ] GFF: Primary data saved (30233 records). [2025-10-08T19:09:00.103758] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-08T19:09:00.103849] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 23.6s. Estimated remaining: 3h 22m 38s. Rate: 7.2 symbols/min [2025-10-08T19:09:00.270193] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:00.306814] [DEBUG] [LOCAL ] GGG: Loaded 40843 existing records from primary storage. [2025-10-08T19:09:00.307133] [INFO ] [MAIN ] GGG: Loaded 40843 existing records. [2025-10-08T19:09:00.482241] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:00.482444] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-08T19:09:00.482490] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-08T19:09:00.482731] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-08T19:09:00.482788] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-08T19:09:00.831471] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:00.825784] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-08T19:09:01.204799] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:09:01.617607] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-08T19:09:02.220944] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T19:09:02.417495] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-08T19:09:02.604942] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-08T19:09:02.609421] [INFO ] [REMOTE ] GFL: Full fetch complete (69245 records). [2025-10-08T19:09:02.609574] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-08T19:09:03.010917] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-08T19:09:03.011034] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-08T19:09:03.012042] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-08T19:09:03.012126] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-08T19:09:03.036068] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:09:03.034821] [DEBUG] [LOCAL ] GFL: Trimmed 69245 records to 47875 (keeping 200 days of data) [2025-10-08T19:09:03.250590] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-08T19:09:03.391050] [DEBUG] [LOCAL ] GFL: Primary data saved (47875 records). [2025-10-08T19:09:03.391230] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-08T19:09:03.391345] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 26.9s. Estimated remaining: 3h 22m 22s. Rate: 7.2 symbols/min [2025-10-08T19:09:03.609044] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:03.626134] [DEBUG] [LOCAL ] GGT: Loaded 14149 existing records from primary storage. [2025-10-08T19:09:03.626463] [INFO ] [MAIN ] GGT: Loaded 14149 existing records. [2025-10-08T19:09:03.835267] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:03.835481] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-08T19:09:03.835533] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-08T19:09:03.835776] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-08T19:09:03.835835] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-08T19:09:04.023437] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-08T19:09:04.197763] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:04.414002] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T19:09:04.564310] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:09:04.817523] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-08T19:09:05.617561] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-08T19:09:05.755543] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T19:09:06.009418] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T19:09:06.417536] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-08T19:09:07.177118] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T19:09:07.217512] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-08T19:09:07.953341] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:09:08.017505] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-08T19:09:08.292806] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T19:09:08.801539] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T19:09:08.817534] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-08T19:09:09.552854] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:09:09.617542] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-08T19:09:10.417630] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-08T19:09:11.217517] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-08T19:09:11.271220] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T19:09:11.297033] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T19:09:12.017569] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-08T19:09:12.802331] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T19:09:12.817489] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-08T19:09:13.158743] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T19:09:13.165425] [INFO ] [REMOTE ] GFI: Full fetch complete (76479 records). [2025-10-08T19:09:13.165589] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-08T19:09:13.631733] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-08T19:09:13.656539] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-08T19:09:13.656615] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-08T19:09:13.657562] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-08T19:09:13.657626] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-08T19:09:13.659289] [DEBUG] [LOCAL ] GFI: Trimmed 76479 records to 53098 (keeping 200 days of data) [2025-10-08T19:09:13.884161] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:09:14.001004] [DEBUG] [LOCAL ] GFI: Primary data saved (53098 records). [2025-10-08T19:09:14.001146] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-08T19:09:14.001238] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 37.5s. Estimated remaining: 3h 22m 17s. Rate: 7.2 symbols/min [2025-10-08T19:09:14.171551] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:14.176726] [DEBUG] [LOCAL ] GGZ: Loaded 2428 existing records from primary storage. [2025-10-08T19:09:14.176907] [INFO ] [MAIN ] GGZ: Loaded 2428 existing records. [2025-10-08T19:09:14.355096] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:14.355306] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-08T19:09:14.355353] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-08T19:09:14.355480] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-08T19:09:14.355518] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-08T19:09:14.422779] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-08T19:09:14.704686] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:15.199936] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:09:15.217491] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-08T19:09:16.017849] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-08T19:09:16.023885] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T19:09:16.684355] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T19:09:16.744352] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:09:16.817525] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-08T19:09:17.617548] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-08T19:09:17.883464] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:09:18.417548] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-08T19:09:18.992465] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T19:09:19.217502] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-08T19:09:19.267281] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T19:09:20.017549] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-08T19:09:20.794253] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:09:20.817511] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-08T19:09:20.837358] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:09:21.617567] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-08T19:09:22.226157] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:09:22.417543] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-08T19:09:23.099185] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:09:23.217557] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-08T19:09:23.826096] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T19:09:24.017610] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-08T19:09:24.613752] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T19:09:24.817551] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-08T19:09:25.442913] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:09:25.446277] [INFO ] [REMOTE ] GGG: Full fetch complete (59401 records). [2025-10-08T19:09:25.446410] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-08T19:09:25.625359] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-08T19:09:25.859249] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-08T19:09:25.859378] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-08T19:09:25.860930] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-08T19:09:25.861021] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-08T19:09:25.862574] [DEBUG] [LOCAL ] GGG: Trimmed 59401 records to 40765 (keeping 200 days of data) [2025-10-08T19:09:26.114070] [DEBUG] [LOCAL ] GGG: Primary data saved (40765 records). [2025-10-08T19:09:26.114204] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-08T19:09:26.114309] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGG took 26.0s. Estimated remaining: 3h 22m 14s. Rate: 7.1 symbols/min [2025-10-08T19:09:26.194722] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T19:09:26.326980] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:26.332148] [DEBUG] [LOCAL ] GHC: Loaded 2760 existing records from primary storage. [2025-10-08T19:09:26.332289] [INFO ] [MAIN ] GHC: Loaded 2760 existing records. [2025-10-08T19:09:26.421984] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-08T19:09:26.514846] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:26.515116] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-08T19:09:26.515326] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-08T19:09:26.515505] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-08T19:09:26.515581] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-08T19:09:26.654768] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T19:09:26.934137] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:27.217576] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-08T19:09:27.429818] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T19:09:27.608897] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-08T19:09:28.017551] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-08T19:09:28.817569] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-08T19:09:29.013590] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T19:09:29.015436] [INFO ] [REMOTE ] GGT: Full fetch complete (18775 records). [2025-10-08T19:09:29.015538] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-08T19:09:29.318752] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T19:09:29.412301] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-08T19:09:29.412422] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-08T19:09:29.413069] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-08T19:09:29.413139] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-08T19:09:29.414323] [DEBUG] [LOCAL ] GGT: Trimmed 18775 records to 14116 (keeping 200 days of data) [2025-10-08T19:09:29.506729] [DEBUG] [LOCAL ] GGT: Primary data saved (14116 records). [2025-10-08T19:09:29.506951] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-08T19:09:29.507058] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGT took 26.1s. Estimated remaining: 3h 21m 58s. Rate: 7.2 symbols/min [2025-10-08T19:09:29.621668] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-08T19:09:29.703907] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:29.711354] [DEBUG] [LOCAL ] GHG: Loaded 3190 existing records from primary storage. [2025-10-08T19:09:29.711685] [INFO ] [MAIN ] GHG: Loaded 3190 existing records. [2025-10-08T19:09:29.909726] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:29.910068] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-08T19:09:29.910120] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-08T19:09:29.910310] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-08T19:09:29.910401] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-08T19:09:30.324329] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:30.417599] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-08T19:09:30.894192] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T19:09:31.069025] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:09:31.073798] [INFO ] [REMOTE ] GGB: Full fetch complete (74110 records). [2025-10-08T19:09:31.073953] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-08T19:09:31.222816] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-08T19:09:31.563161] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-08T19:09:31.563296] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-08T19:09:31.564547] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-08T19:09:31.564635] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-08T19:09:31.566529] [DEBUG] [LOCAL ] GGB: Trimmed 74110 records to 51174 (keeping 200 days of data) [2025-10-08T19:09:31.818465] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-08T19:09:31.929724] [DEBUG] [LOCAL ] GGB: Primary data saved (51174 records). [2025-10-08T19:09:31.929943] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-08T19:09:31.930086] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGB took 45.2s. Estimated remaining: 3h 21m 40s. Rate: 7.2 symbols/min [2025-10-08T19:09:32.022732] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-08T19:09:32.143577] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:32.155765] [DEBUG] [LOCAL ] GHI: Loaded 7175 existing records from primary storage. [2025-10-08T19:09:32.156050] [INFO ] [MAIN ] GHI: Loaded 7175 existing records. [2025-10-08T19:09:32.347718] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:32.347977] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-08T19:09:32.348090] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-08T19:09:32.348306] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-08T19:09:32.348362] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-08T19:09:32.605594] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T19:09:32.730510] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:32.817603] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-08T19:09:33.155622] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T19:09:33.617567] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-08T19:09:34.152549] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T19:09:34.417550] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-08T19:09:34.732671] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-08T19:09:35.217571] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-08T19:09:35.844409] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T19:09:36.017591] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-08T19:09:36.817527] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-08T19:09:36.831497] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T19:09:37.112463] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-08T19:09:37.617553] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-08T19:09:38.213715] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T19:09:38.417569] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-08T19:09:38.890397] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T19:09:39.217552] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-08T19:09:39.677494] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-08T19:09:40.017611] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-08T19:09:40.470098] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T19:09:40.817557] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-08T19:09:41.388978] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T19:09:41.617638] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-08T19:09:42.418107] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-08T19:09:42.422571] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:09:42.760841] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T19:09:43.217554] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-08T19:09:43.693956] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T19:09:44.017548] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-08T19:09:44.504283] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T19:09:44.817549] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-08T19:09:45.422136] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:09:45.617559] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-08T19:09:46.204957] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T19:09:46.417600] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-08T19:09:46.958424] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T19:09:47.217559] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-08T19:09:47.776949] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T19:09:48.017559] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-08T19:09:48.454718] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T19:09:48.817557] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-08T19:09:49.396130] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T19:09:49.617616] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-08T19:09:50.088747] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T19:09:50.417566] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-08T19:09:51.031086] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T19:09:51.217595] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-08T19:09:51.963730] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:09:52.017569] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-08T19:09:52.755584] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T19:09:52.817517] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-08T19:09:53.290342] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T19:09:53.617590] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-08T19:09:54.246406] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T19:09:54.247330] [INFO ] [REMOTE ] GHC: Full fetch complete (3460 records). [2025-10-08T19:09:54.247399] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-08T19:09:54.418875] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-08T19:09:54.646637] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-08T19:09:54.646782] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-08T19:09:54.647061] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-08T19:09:54.647133] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-08T19:09:54.647582] [DEBUG] [LOCAL ] GHC: Trimmed 3460 records to 2780 (keeping 200 days of data) [2025-10-08T19:09:54.667054] [DEBUG] [LOCAL ] GHC: Primary data saved (2780 records). [2025-10-08T19:09:54.667145] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-08T19:09:54.667248] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GHC took 28.6s. Estimated remaining: 3h 21m 54s. Rate: 7.1 symbols/min [2025-10-08T19:09:54.849981] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:54.857789] [DEBUG] [LOCAL ] GHLD: Loaded 4186 existing records from primary storage. [2025-10-08T19:09:54.858029] [INFO ] [MAIN ] GHLD: Loaded 4186 existing records. [2025-10-08T19:09:54.966048] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T19:09:55.072327] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:55.072692] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-08T19:09:55.072800] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-08T19:09:55.073025] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-08T19:09:55.073087] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-08T19:09:55.232231] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-08T19:09:55.463461] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:55.819914] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-08T19:09:56.017515] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-08T19:09:56.613292] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T19:09:56.817557] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-08T19:09:57.226122] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-08T19:09:57.617528] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-08T19:09:58.358952] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T19:09:58.417575] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-08T19:09:59.192346] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T19:09:59.217511] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-08T19:09:59.739517] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T19:10:00.017548] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-08T19:10:00.583516] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T19:10:00.584409] [INFO ] [REMOTE ] GHG: Full fetch complete (4078 records). [2025-10-08T19:10:00.584478] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-08T19:10:00.822717] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-08T19:10:00.951456] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-08T19:10:00.951558] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-08T19:10:00.951742] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-08T19:10:00.951804] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-08T19:10:00.952165] [DEBUG] [LOCAL ] GHG: Trimmed 4078 records to 3211 (keeping 200 days of data) [2025-10-08T19:10:00.970942] [DEBUG] [LOCAL ] GHG: Primary data saved (3211 records). [2025-10-08T19:10:00.971037] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-08T19:10:00.971197] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHG took 31.5s. Estimated remaining: 3h 21m 43s. Rate: 7.1 symbols/min [2025-10-08T19:10:01.136485] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:01.152247] [DEBUG] [LOCAL ] GHM: Loaded 14153 existing records from primary storage. [2025-10-08T19:10:01.152502] [INFO ] [MAIN ] GHM: Loaded 14153 existing records. [2025-10-08T19:10:01.328483] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:01.328715] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-08T19:10:01.328773] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-08T19:10:01.328978] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-08T19:10:01.329036] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-08T19:10:01.405515] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T19:10:01.622712] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-08T19:10:01.689495] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:02.417566] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-08T19:10:02.620741] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T19:10:02.622020] [INFO ] [REMOTE ] GHI: Full fetch complete (11407 records). [2025-10-08T19:10:02.622101] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-08T19:10:02.988399] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-08T19:10:02.988545] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-08T19:10:02.988868] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-08T19:10:02.988929] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-08T19:10:02.989384] [DEBUG] [LOCAL ] GHI: Trimmed 11407 records to 7185 (keeping 200 days of data) [2025-10-08T19:10:03.035266] [DEBUG] [LOCAL ] GHI: Primary data saved (7185 records). [2025-10-08T19:10:03.035412] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-08T19:10:03.035498] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHI took 31.1s. Estimated remaining: 3h 21m 25s. Rate: 7.2 symbols/min [2025-10-08T19:10:03.211143] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:03.217531] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-08T19:10:03.238575] [DEBUG] [LOCAL ] GHY: Loaded 20933 existing records from primary storage. [2025-10-08T19:10:03.238873] [INFO ] [MAIN ] GHY: Loaded 20933 existing records. [2025-10-08T19:10:03.380207] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T19:10:03.437768] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:03.438041] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-08T19:10:03.438090] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-08T19:10:03.438406] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-08T19:10:03.438494] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-08T19:10:03.647877] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T19:10:03.836409] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:04.017562] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-08T19:10:04.817541] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-08T19:10:04.831673] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:10:05.341987] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T19:10:05.617546] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-08T19:10:06.417515] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-08T19:10:06.657517] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T19:10:06.706631] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-08T19:10:07.217566] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-08T19:10:08.017566] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-08T19:10:08.226000] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T19:10:08.500063] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T19:10:08.817551] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-08T19:10:09.348884] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T19:10:09.617581] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-08T19:10:10.275015] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T19:10:10.417560] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-08T19:10:11.034539] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T19:10:11.217575] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-08T19:10:12.017559] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-08T19:10:12.214781] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:10:12.433034] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T19:10:12.433863] [INFO ] [REMOTE ] GGZ: Full fetch complete (4077 records). [2025-10-08T19:10:12.433934] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-08T19:10:12.786665] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-08T19:10:12.786767] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-08T19:10:12.786915] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-08T19:10:12.786954] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-08T19:10:12.787298] [DEBUG] [LOCAL ] GGZ: Trimmed 4077 records to 2428 (keeping 200 days of data) [2025-10-08T19:10:12.802238] [DEBUG] [LOCAL ] GGZ: Primary data saved (2428 records). [2025-10-08T19:10:12.802307] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-08T19:10:12.802378] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GGZ took 58.8s. Estimated remaining: 3h 21m 18s. Rate: 7.2 symbols/min [2025-10-08T19:10:12.822731] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-08T19:10:12.972005] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:13.009892] [DEBUG] [LOCAL ] GIB: Loaded 31877 existing records from primary storage. [2025-10-08T19:10:13.010215] [INFO ] [MAIN ] GIB: Loaded 31877 existing records. [2025-10-08T19:10:13.182796] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:13.183026] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-08T19:10:13.183073] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-08T19:10:13.183289] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-08T19:10:13.183346] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-08T19:10:13.528697] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:13.617501] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-08T19:10:13.985301] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:10:14.417517] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-08T19:10:14.772499] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T19:10:14.934096] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T19:10:15.217560] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-08T19:10:16.017527] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-08T19:10:16.176102] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T19:10:16.817530] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-08T19:10:17.202711] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T19:10:17.591126] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T19:10:17.617525] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-08T19:10:18.422617] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-08T19:10:18.431755] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T19:10:19.217592] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-08T19:10:19.309163] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T19:10:20.017572] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-08T19:10:20.299921] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T19:10:20.817523] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-08T19:10:20.827722] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T19:10:21.235557] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T19:10:21.617542] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-08T19:10:22.417536] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-08T19:10:22.648750] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:10:23.006024] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T19:10:23.007252] [INFO ] [REMOTE ] GHLD: Full fetch complete (4859 records). [2025-10-08T19:10:23.007345] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-08T19:10:23.225425] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-08T19:10:23.406276] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-08T19:10:23.406354] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-08T19:10:23.406507] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-08T19:10:23.406545] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-08T19:10:23.406945] [DEBUG] [LOCAL ] GHLD: Trimmed 4859 records to 4184 (keeping 200 days of data) [2025-10-08T19:10:23.431849] [DEBUG] [LOCAL ] GHLD: Primary data saved (4184 records). [2025-10-08T19:10:23.431941] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-08T19:10:23.432019] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 28.8s. Estimated remaining: 3h 21m 13s. Rate: 7.2 symbols/min [2025-10-08T19:10:23.607945] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:23.625834] [DEBUG] [LOCAL ] GIC: Loaded 13473 existing records from primary storage. [2025-10-08T19:10:23.626124] [INFO ] [MAIN ] GIC: Loaded 13473 existing records. [2025-10-08T19:10:23.857484] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:23.857929] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-08T19:10:23.858012] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-08T19:10:23.866769] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-08T19:10:23.867803] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T19:10:23.867907] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-08T19:10:24.022569] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-08T19:10:24.231623] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:24.798199] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T19:10:24.817504] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-08T19:10:25.433041] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T19:10:25.617545] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-08T19:10:26.417513] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-08T19:10:26.681776] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T19:10:27.075518] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T19:10:27.217564] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-08T19:10:27.999574] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T19:10:28.017506] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-08T19:10:28.817527] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-08T19:10:29.062811] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T19:10:29.542912] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T19:10:29.617586] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-08T19:10:30.417605] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-08T19:10:30.820570] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T19:10:31.217536] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-08T19:10:31.386343] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:10:31.388522] [INFO ] [REMOTE ] GHY: Full fetch complete (32303 records). [2025-10-08T19:10:31.388603] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-08T19:10:31.757857] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-08T19:10:31.757939] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-08T19:10:31.758549] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-08T19:10:31.758610] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-08T19:10:31.759393] [DEBUG] [LOCAL ] GHY: Trimmed 32303 records to 20935 (keeping 200 days of data) [2025-10-08T19:10:31.889031] [DEBUG] [LOCAL ] GHY: Primary data saved (20935 records). [2025-10-08T19:10:31.889167] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-08T19:10:31.889247] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHY took 28.9s. Estimated remaining: 3h 21m 5s. Rate: 7.2 symbols/min [2025-10-08T19:10:32.017872] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-08T19:10:32.072847] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:32.114113] [DEBUG] [LOCAL ] GIL: Loaded 43629 existing records from primary storage. [2025-10-08T19:10:32.114430] [INFO ] [MAIN ] GIL: Loaded 43629 existing records. [2025-10-08T19:10:32.227383] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T19:10:32.311216] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:32.311437] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-08T19:10:32.311483] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-08T19:10:32.311740] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-08T19:10:32.311799] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-08T19:10:32.677630] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:32.817542] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-08T19:10:32.927838] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T19:10:33.617568] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-08T19:10:34.260946] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T19:10:34.417517] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-08T19:10:34.445265] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T19:10:35.217548] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-08T19:10:35.884325] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T19:10:35.886340] [INFO ] [REMOTE ] GHM: Full fetch complete (21850 records). [2025-10-08T19:10:35.908226] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-08T19:10:35.910298] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T19:10:36.022722] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-08T19:10:36.321995] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-08T19:10:36.322180] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-08T19:10:36.322906] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-08T19:10:36.322973] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-08T19:10:36.324236] [DEBUG] [LOCAL ] GHM: Trimmed 21850 records to 14150 (keeping 200 days of data) [2025-10-08T19:10:36.417974] [DEBUG] [LOCAL ] GHM: Primary data saved (14150 records). [2025-10-08T19:10:36.418207] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-08T19:10:36.418319] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHM took 35.4s. Estimated remaining: 3h 20m 51s. Rate: 7.2 symbols/min [2025-10-08T19:10:36.617380] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:36.679625] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-08T19:10:36.680131] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-08T19:10:36.822726] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-08T19:10:36.891412] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:36.891767] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-08T19:10:36.891845] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-08T19:10:36.892220] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-08T19:10:36.892285] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-08T19:10:37.034258] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T19:10:37.323596] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:37.617611] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-08T19:10:38.049372] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T19:10:38.417497] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-08T19:10:38.889418] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T19:10:39.217569] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-08T19:10:39.947113] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:10:40.017503] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-08T19:10:40.218298] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T19:10:40.817542] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-08T19:10:41.561870] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:10:41.603166] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T19:10:41.617485] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-08T19:10:42.390707] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T19:10:42.417511] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-08T19:10:43.217596] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-08T19:10:43.237041] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T19:10:44.017565] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-08T19:10:44.817523] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-08T19:10:45.110872] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-08T19:10:45.167111] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T19:10:45.617533] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-08T19:10:45.849844] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:10:46.417554] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-08T19:10:47.133402] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:10:47.217536] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-08T19:10:47.704634] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T19:10:48.017569] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-08T19:10:48.678632] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T19:10:48.817553] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-08T19:10:48.917200] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T19:10:49.311964] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T19:10:49.617599] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-08T19:10:50.417540] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-08T19:10:50.535177] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T19:10:50.536843] [INFO ] [REMOTE ] GIC: Full fetch complete (20210 records). [2025-10-08T19:10:50.536952] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-08T19:10:50.930341] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-08T19:10:50.930448] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-08T19:10:50.931183] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-08T19:10:50.931249] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-08T19:10:50.932092] [DEBUG] [LOCAL ] GIC: Trimmed 20210 records to 13439 (keeping 200 days of data) [2025-10-08T19:10:51.016735] [DEBUG] [LOCAL ] GIC: Primary data saved (13439 records). [2025-10-08T19:10:51.016878] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-08T19:10:51.016963] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIC took 27.6s. Estimated remaining: 3h 20m 52s. Rate: 7.1 symbols/min [2025-10-08T19:10:51.191742] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:51.217595] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-08T19:10:51.232246] [DEBUG] [LOCAL ] GKOS: Loaded 42637 existing records from primary storage. [2025-10-08T19:10:51.232566] [INFO ] [MAIN ] GKOS: Loaded 42637 existing records. [2025-10-08T19:10:51.428717] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:51.428990] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-08T19:10:51.429046] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-08T19:10:51.429271] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-08T19:10:51.429332] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-08T19:10:51.923552] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T19:10:52.022908] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-08T19:10:52.110343] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:52.817574] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-08T19:10:53.072610] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T19:10:53.229011] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T19:10:53.617590] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-08T19:10:54.360535] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:10:54.417519] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-08T19:10:55.147427] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:10:55.217609] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-08T19:10:55.609010] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T19:10:56.017571] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-08T19:10:56.771841] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T19:10:56.817525] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-08T19:10:57.417929] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:10:57.617571] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-08T19:10:58.253146] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:10:58.417609] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-08T19:10:59.213248] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T19:10:59.224289] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-08T19:10:59.924848] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T19:10:59.928392] [INFO ] [REMOTE ] GIL: Full fetch complete (61791 records). [2025-10-08T19:10:59.928532] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-08T19:11:00.024125] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-08T19:11:00.311840] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-08T19:11:00.311926] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-08T19:11:00.312749] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-08T19:11:00.312828] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-08T19:11:00.314181] [DEBUG] [LOCAL ] GIL: Trimmed 61791 records to 43687 (keeping 200 days of data) [2025-10-08T19:11:00.581524] [DEBUG] [LOCAL ] GIL: Primary data saved (43687 records). [2025-10-08T19:11:00.581694] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-08T19:11:00.581796] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIL took 28.7s. Estimated remaining: 3h 20m 45s. Rate: 7.1 symbols/min [2025-10-08T19:11:00.752703] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:00.796371] [DEBUG] [LOCAL ] GL: Loaded 37747 existing records from primary storage. [2025-10-08T19:11:00.796786] [INFO ] [MAIN ] GL: Loaded 37747 existing records. [2025-10-08T19:11:00.828490] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-08T19:11:00.982941] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:00.983276] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-08T19:11:00.983490] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-08T19:11:00.983877] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-08T19:11:00.983986] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-08T19:11:01.290951] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-08T19:11:01.388245] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:01.617518] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-08T19:11:02.063218] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T19:11:02.112769] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:11:02.417559] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-08T19:11:02.856227] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T19:11:03.217560] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-08T19:11:03.625914] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T19:11:03.629315] [INFO ] [REMOTE ] GIB: Full fetch complete (45765 records). [2025-10-08T19:11:03.629413] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-08T19:11:03.995254] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-08T19:11:03.995338] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-08T19:11:03.996026] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-08T19:11:03.996088] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-08T19:11:04.000450] [DEBUG] [LOCAL ] GIB: Trimmed 45765 records to 31842 (keeping 200 days of data) [2025-10-08T19:11:04.058894] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-08T19:11:04.209130] [DEBUG] [LOCAL ] GIB: Primary data saved (31842 records). [2025-10-08T19:11:04.209314] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-08T19:11:04.209416] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIB took 51.4s. Estimated remaining: 3h 20m 30s. Rate: 7.2 symbols/min [2025-10-08T19:11:04.374021] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:04.418004] [DEBUG] [LOCAL ] GLOB: Loaded 47732 existing records from primary storage. [2025-10-08T19:11:04.418332] [INFO ] [MAIN ] GLOB: Loaded 47732 existing records. [2025-10-08T19:11:04.593974] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:04.594370] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-08T19:11:04.594497] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-08T19:11:04.594806] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-08T19:11:04.594865] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-08T19:11:04.838308] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-08T19:11:04.961734] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:04.991755] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:11:05.617529] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-08T19:11:05.823071] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T19:11:06.417561] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-08T19:11:06.457536] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T19:11:06.654089] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T19:11:07.217553] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-08T19:11:07.692616] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:11:08.017575] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-08T19:11:08.434699] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T19:11:08.817610] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-08T19:11:09.193702] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:11:09.617612] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-08T19:11:10.274721] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T19:11:10.417564] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-08T19:11:11.217961] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-08T19:11:11.219450] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T19:11:11.942869] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T19:11:12.017520] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-08T19:11:12.817570] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-08T19:11:12.856613] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T19:11:13.201867] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T19:11:13.617558] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-08T19:11:14.417575] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-08T19:11:14.587875] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T19:11:15.140495] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:11:15.217511] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-08T19:11:15.535315] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T19:11:16.017556] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-08T19:11:16.658370] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T19:11:16.817524] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-08T19:11:17.617508] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-08T19:11:17.745246] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T19:11:18.368741] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T19:11:18.417493] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-08T19:11:19.047814] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:11:19.051021] [INFO ] [REMOTE ] GKOS: Full fetch complete (60065 records). [2025-10-08T19:11:19.051113] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-08T19:11:19.222938] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-08T19:11:19.437168] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-08T19:11:19.437247] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-08T19:11:19.438065] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-08T19:11:19.438128] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-08T19:11:19.441931] [DEBUG] [LOCAL ] GKOS: Trimmed 60065 records to 42550 (keeping 200 days of data) [2025-10-08T19:11:19.697848] [DEBUG] [LOCAL ] GKOS: Primary data saved (42550 records). [2025-10-08T19:11:19.697980] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-08T19:11:19.698063] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GKOS took 28.7s. Estimated remaining: 3h 20m 32s. Rate: 7.1 symbols/min [2025-10-08T19:11:19.867487] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:19.879043] [DEBUG] [LOCAL ] GLP: Loaded 9284 existing records from primary storage. [2025-10-08T19:11:19.879265] [INFO ] [MAIN ] GLP: Loaded 9284 existing records. [2025-10-08T19:11:20.021546] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-08T19:11:20.063447] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:20.063737] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-08T19:11:20.063863] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-08T19:11:20.064121] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-08T19:11:20.064212] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-08T19:11:20.464991] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:20.459370] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-08T19:11:20.817511] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-08T19:11:20.877950] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T19:11:21.595743] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T19:11:21.617507] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-08T19:11:21.729895] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T19:11:22.417562] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-08T19:11:23.217554] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-08T19:11:23.255115] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T19:11:24.017584] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-08T19:11:24.226526] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T19:11:24.562703] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T19:11:24.697572] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T19:11:24.817511] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-08T19:11:25.589545] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:11:25.617498] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-08T19:11:26.409793] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T19:11:26.417489] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-08T19:11:27.096250] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T19:11:27.217575] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-08T19:11:28.017574] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-08T19:11:28.817522] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-08T19:11:28.946369] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T19:11:29.435562] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T19:11:29.617517] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-08T19:11:29.703357] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T19:11:30.417609] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-08T19:11:31.217620] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-08T19:11:31.362903] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T19:11:32.017634] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-08T19:11:32.343552] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T19:11:32.347994] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-08T19:11:32.348180] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-08T19:11:32.779790] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-08T19:11:32.782616] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-08T19:11:32.783759] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-08T19:11:32.783874] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-08T19:11:32.785995] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:11:32.797011] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 53672 (keeping 200 days of data) [2025-10-08T19:11:32.853748] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-08T19:11:33.134384] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-10-08T19:11:33.134588] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-08T19:11:33.134727] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIS took 56.7s. Estimated remaining: 3h 20m 31s. Rate: 7.1 symbols/min [2025-10-08T19:11:33.305362] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:33.355328] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-08T19:11:33.355709] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-08T19:11:33.538900] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:33.539263] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-08T19:11:33.539344] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-08T19:11:33.539672] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-08T19:11:33.539741] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-08T19:11:33.620145] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-08T19:11:33.653961] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:11:33.670326] [INFO ] [REMOTE ] GLOB: Full fetch complete (64662 records). [2025-10-08T19:11:33.724594] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-08T19:11:33.717886] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T19:11:34.131734] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:34.339903] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-08T19:11:34.340025] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-08T19:11:34.340991] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-08T19:11:34.341058] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-08T19:11:34.342512] [DEBUG] [LOCAL ] GLOB: Trimmed 64662 records to 47776 (keeping 200 days of data) [2025-10-08T19:11:34.430987] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-08T19:11:34.631027] [DEBUG] [LOCAL ] GLOB: Primary data saved (47776 records). [2025-10-08T19:11:34.631158] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-08T19:11:34.631243] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GLOB took 30.4s. Estimated remaining: 3h 20m 12s. Rate: 7.1 symbols/min [2025-10-08T19:11:34.801237] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:34.856619] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-08T19:11:34.857054] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-08T19:11:35.038370] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:35.039068] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-08T19:11:35.039254] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-08T19:11:35.039530] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-08T19:11:35.039588] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-08T19:11:35.144204] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T19:11:35.228535] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-08T19:11:35.245683] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T19:11:35.455373] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:36.017574] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-08T19:11:36.076948] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T19:11:36.817612] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-08T19:11:37.398283] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T19:11:37.617559] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-08T19:11:38.417568] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-08T19:11:38.977814] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T19:11:38.999003] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:11:39.002188] [INFO ] [REMOTE ] GL: Full fetch complete (55254 records). [2025-10-08T19:11:39.002367] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-08T19:11:39.144197] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T19:11:39.227328] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-08T19:11:39.414791] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-08T19:11:39.414879] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-08T19:11:39.415630] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-08T19:11:39.415712] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-08T19:11:39.417005] [DEBUG] [LOCAL ] GL: Trimmed 55254 records to 37792 (keeping 200 days of data) [2025-10-08T19:11:39.663814] [DEBUG] [LOCAL ] GL: Primary data saved (37792 records). [2025-10-08T19:11:39.664002] [INFO ] [MAIN ] GL: Full history saved. [2025-10-08T19:11:39.665572] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GL took 39.1s. Estimated remaining: 3h 19m 59s. Rate: 7.2 symbols/min [2025-10-08T19:11:39.835478] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:39.895460] [DEBUG] [LOCAL ] GME: Loaded 53782 existing records from primary storage. [2025-10-08T19:11:39.895846] [INFO ] [MAIN ] GME: Loaded 53782 existing records. [2025-10-08T19:11:40.022735] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-08T19:11:40.079555] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:40.080245] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-08T19:11:40.080303] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-08T19:11:40.080504] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-08T19:11:40.080563] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-08T19:11:40.438459] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:40.817570] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-08T19:11:41.419413] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-08T19:11:41.471799] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T19:11:41.473064] [INFO ] [REMOTE ] GLP: Full fetch complete (14289 records). [2025-10-08T19:11:41.473133] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-08T19:11:41.622765] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-08T19:11:41.861666] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-08T19:11:41.861991] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-08T19:11:41.862605] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-08T19:11:41.862730] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-08T19:11:41.863560] [DEBUG] [LOCAL ] GLP: Trimmed 14289 records to 9242 (keeping 200 days of data) [2025-10-08T19:11:41.920883] [DEBUG] [LOCAL ] GLP: Primary data saved (9242 records). [2025-10-08T19:11:41.921021] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-08T19:11:41.921164] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLP took 22.2s. Estimated remaining: 3h 19m 41s. Rate: 7.2 symbols/min [2025-10-08T19:11:42.092175] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:42.124741] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-08T19:11:42.176145] [DEBUG] [LOCAL ] GMED: Loaded 48385 existing records from primary storage. [2025-10-08T19:11:42.176478] [INFO ] [MAIN ] GMED: Loaded 48385 existing records. [2025-10-08T19:11:42.350278] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:42.350525] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-08T19:11:42.350578] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-08T19:11:42.350819] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-08T19:11:42.350877] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-08T19:11:42.424815] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-08T19:11:42.749869] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:43.217618] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-08T19:11:44.017693] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-08T19:11:44.657916] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (3.04 seconds). [2025-10-08T19:11:44.817546] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-08T19:11:44.895539] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-08T19:11:45.265870] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T19:11:45.617625] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-08T19:11:46.417682] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-08T19:11:46.462497] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-08T19:11:47.217553] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-08T19:11:48.402955] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (3.59 seconds). [2025-10-08T19:11:48.414686] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-08T19:11:48.473175] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-10-08T19:11:48.554404] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T19:11:48.640380] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-08T19:11:48.817516] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-08T19:11:49.617556] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-08T19:11:50.417504] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-08T19:11:50.582412] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-08T19:11:50.863750] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T19:11:50.980518] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T19:11:51.217569] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-08T19:11:51.891971] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T19:11:52.017568] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-08T19:11:52.819094] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-08T19:11:52.821798] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T19:11:53.441894] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T19:11:53.617586] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-08T19:11:54.417704] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-08T19:11:54.920996] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T19:11:55.130775] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:11:55.217578] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-08T19:11:56.017600] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-08T19:11:56.679426] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-08T19:11:56.817590] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-08T19:11:56.946067] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T19:11:57.325375] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T19:11:57.617549] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-08T19:11:58.417553] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-08T19:11:59.126962] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-08T19:11:59.217565] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-08T19:11:59.602258] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-08T19:12:00.017534] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-08T19:12:00.329699] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T19:12:00.817587] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-08T19:12:01.617593] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-08T19:12:01.837474] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-08T19:12:01.882635] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T19:12:02.424553] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-08T19:12:02.434979] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:12:03.217561] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-08T19:12:03.600100] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T19:12:03.993810] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:12:04.017546] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-08T19:12:04.817584] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-08T19:12:04.935737] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T19:12:05.438251] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T19:12:05.617571] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-08T19:12:06.417627] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-08T19:12:06.775884] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T19:12:07.217609] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-08T19:12:07.424300] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T19:12:08.017590] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-08T19:12:08.630150] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T19:12:08.817572] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-08T19:12:09.617525] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-08T19:12:09.708115] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-08T19:12:09.767621] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T19:12:09.772554] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-08T19:12:09.772829] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-08T19:12:10.199489] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-08T19:12:10.199608] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-08T19:12:10.200709] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-08T19:12:10.200796] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-08T19:12:10.202719] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53729 (keeping 200 days of data) [2025-10-08T19:12:10.418532] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-08T19:12:10.541285] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-08T19:12:10.541427] [INFO ] [MAIN ] GM: Full history saved. [2025-10-08T19:12:10.541523] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GM took 35.9s. Estimated remaining: 3h 20m 4s. Rate: 7.1 symbols/min [2025-10-08T19:12:10.628403] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-08T19:12:10.665865] [INFO ] [REMOTE ] GLW: Full fetch complete (77622 records). [2025-10-08T19:12:10.681600] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-08T19:12:10.784214] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:11.087437] [DEBUG] [LOCAL ] GMRE: Loaded 37200 existing records from primary storage. [2025-10-08T19:12:11.098878] [INFO ] [MAIN ] GMRE: Loaded 37200 existing records. [2025-10-08T19:12:11.338762] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-08T19:12:11.344171] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-08T19:12:11.407343] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-08T19:12:11.413833] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:11.414314] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-08T19:12:11.414114] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-08T19:12:11.414844] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-08T19:12:11.415545] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-08T19:12:11.415724] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-08T19:12:11.459768] [DEBUG] [LOCAL ] GLW: Trimmed 77622 records to 53636 (keeping 200 days of data) [2025-10-08T19:12:11.771898] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-08T19:12:11.845271] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-08T19:12:11.972664] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:12.055963] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-08T19:12:12.218953] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-08T19:12:12.219096] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-08T19:12:12.219191] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GLW took 39.1s. Estimated remaining: 3h 19m 45s. Rate: 7.1 symbols/min [2025-10-08T19:12:12.388866] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:12.408807] [DEBUG] [LOCAL ] GNE: Loaded 17867 existing records from primary storage. [2025-10-08T19:12:12.409099] [INFO ] [MAIN ] GNE: Loaded 17867 existing records. [2025-10-08T19:12:12.604995] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:12.605462] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-08T19:12:12.605761] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-08T19:12:12.606221] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-08T19:12:12.606325] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-08T19:12:12.747324] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-08T19:12:12.822971] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-08T19:12:13.026422] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:13.409772] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T19:12:13.462515] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T19:12:13.617586] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-08T19:12:14.417613] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-08T19:12:15.078069] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T19:12:15.164445] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T19:12:15.197197] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-08T19:12:15.217503] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-08T19:12:16.017568] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-08T19:12:16.817606] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-08T19:12:17.454485] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-08T19:12:17.458678] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-08T19:12:17.458805] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-08T19:12:17.619164] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-08T19:12:17.779603] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T19:12:17.820181] [INFO ] [REMOTE ] GMED: Full fetch complete (69721 records). [2025-10-08T19:12:17.867433] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-08T19:12:18.005182] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-08T19:12:18.017290] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-08T19:12:18.023742] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-08T19:12:18.023913] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-08T19:12:18.045074] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:12:18.151958] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53783 (keeping 200 days of data) [2025-10-08T19:12:18.426153] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-08T19:12:18.451362] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-08T19:12:18.451511] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-08T19:12:18.452447] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-08T19:12:18.453293] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-08T19:12:18.459460] [DEBUG] [LOCAL ] GMED: Trimmed 69721 records to 48352 (keeping 200 days of data) [2025-10-08T19:12:18.564312] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T19:12:18.915680] [DEBUG] [LOCAL ] GMED: Primary data saved (48352 records). [2025-10-08T19:12:18.916366] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-08T19:12:18.916788] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 37.0s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-08T19:12:19.160048] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:19.208470] [DEBUG] [LOCAL ] GME: Primary data saved (53783 records). [2025-10-08T19:12:19.209353] [DEBUG] [LOCAL ] GNK: Loaded 40272 existing records from primary storage. [2025-10-08T19:12:19.209449] [INFO ] [MAIN ] GME: Full history saved. [2025-10-08T19:12:19.209560] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GME took 39.5s. Estimated remaining: 3h 19m 13s. Rate: 7.2 symbols/min [2025-10-08T19:12:19.221424] [INFO ] [MAIN ] GNK: Loaded 40272 existing records. [2025-10-08T19:12:19.221219] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-08T19:12:19.569265] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:19.573868] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:19.574915] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-08T19:12:19.575217] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-08T19:12:19.575773] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-08T19:12:19.575838] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-08T19:12:19.955429] [DEBUG] [LOCAL ] GNL: Loaded 46755 existing records from primary storage. [2025-10-08T19:12:19.972841] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T19:12:19.971226] [INFO ] [MAIN ] GNL: Loaded 46755 existing records. [2025-10-08T19:12:20.017729] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-08T19:12:20.112784] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:20.133120] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T19:12:20.231572] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:20.231761] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-08T19:12:20.231809] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-08T19:12:20.232014] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-08T19:12:20.232071] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-08T19:12:20.586420] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:20.817597] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-08T19:12:21.593070] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T19:12:21.617510] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-08T19:12:21.766439] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T19:12:22.417633] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-08T19:12:22.650157] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:12:23.217594] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-08T19:12:23.869727] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:12:24.017538] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-08T19:12:24.146268] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T19:12:24.817615] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-08T19:12:25.617558] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-08T19:12:25.891692] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T19:12:26.417524] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-08T19:12:26.728998] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T19:12:26.762475] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-08T19:12:27.217561] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-08T19:12:27.620440] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T19:12:28.017592] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-08T19:12:28.509200] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T19:12:28.817549] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-08T19:12:29.010088] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T19:12:29.617556] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-08T19:12:30.359818] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:12:30.417573] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-08T19:12:30.602636] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T19:12:31.217579] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-08T19:12:31.864495] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:12:32.017584] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-08T19:12:32.771260] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T19:12:32.817505] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-08T19:12:33.538904] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:12:33.617497] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-08T19:12:34.348847] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T19:12:34.417549] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-08T19:12:34.994261] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:12:35.217594] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-08T19:12:35.916232] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T19:12:36.017589] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-08T19:12:36.297229] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T19:12:36.817629] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-08T19:12:37.584558] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T19:12:37.617701] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-08T19:12:38.276091] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:12:38.417571] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-08T19:12:39.139166] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T19:12:39.217568] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-08T19:12:39.433967] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:12:39.436455] [INFO ] [REMOTE ] GMRE: Full fetch complete (53059 records). [2025-10-08T19:12:39.436559] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-08T19:12:39.819000] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-08T19:12:39.819093] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-08T19:12:39.819842] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-08T19:12:39.819904] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-08T19:12:39.821035] [DEBUG] [LOCAL ] GMRE: Trimmed 53059 records to 37133 (keeping 200 days of data) [2025-10-08T19:12:40.019689] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-08T19:12:40.051548] [DEBUG] [LOCAL ] GMRE: Primary data saved (37133 records). [2025-10-08T19:12:40.051734] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-08T19:12:40.051848] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GMRE took 29.5s. Estimated remaining: 3h 19m 24s. Rate: 7.1 symbols/min [2025-10-08T19:12:40.220905] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:40.262852] [DEBUG] [LOCAL ] GNRC: Loaded 45210 existing records from primary storage. [2025-10-08T19:12:40.263182] [INFO ] [MAIN ] GNRC: Loaded 45210 existing records. [2025-10-08T19:12:40.443064] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:40.443354] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-08T19:12:40.443456] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-08T19:12:40.451462] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-08T19:12:40.464698] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-08T19:12:40.531371] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T19:12:40.838224] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:40.832323] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-08T19:12:40.930109] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T19:12:41.617556] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-08T19:12:41.835133] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:12:42.417569] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-08T19:12:42.876449] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T19:12:43.217611] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-08T19:12:43.787289] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:12:44.017575] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-08T19:12:44.409431] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T19:12:44.817567] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-08T19:12:45.261005] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T19:12:45.617525] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-08T19:12:45.695174] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:12:46.417552] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-08T19:12:47.145462] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:12:47.217566] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-08T19:12:48.022764] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-08T19:12:48.040602] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T19:12:48.794806] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T19:12:48.817503] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-08T19:12:48.850262] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T19:12:49.617537] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-08T19:12:50.224250] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:12:50.227767] [INFO ] [REMOTE ] GNL: Full fetch complete (68151 records). [2025-10-08T19:12:50.227867] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-08T19:12:50.422738] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-08T19:12:50.615850] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-08T19:12:50.615978] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-08T19:12:50.616885] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-08T19:12:50.616949] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-08T19:12:50.618259] [DEBUG] [LOCAL ] GNL: Trimmed 68151 records to 46764 (keeping 200 days of data) [2025-10-08T19:12:50.889356] [DEBUG] [LOCAL ] GNL: Primary data saved (46764 records). [2025-10-08T19:12:50.889497] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-08T19:12:50.889582] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNL took 31.7s. Estimated remaining: 3h 19m 19s. Rate: 7.1 symbols/min [2025-10-08T19:12:51.069015] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:51.080982] [DEBUG] [LOCAL ] GNT: Loaded 8259 existing records from primary storage. [2025-10-08T19:12:51.081408] [INFO ] [MAIN ] GNT: Loaded 8259 existing records. [2025-10-08T19:12:51.233689] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-08T19:12:51.276995] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:51.277508] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-08T19:12:51.277591] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-08T19:12:51.287008] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-08T19:12:51.292313] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-08T19:12:51.387810] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T19:12:51.439472] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:12:51.484580] [INFO ] [REMOTE ] GNE: Full fetch complete (22478 records). [2025-10-08T19:12:51.486247] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-08T19:12:51.888715] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:52.022720] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-08T19:12:52.086060] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-08T19:12:52.086148] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-08T19:12:52.086637] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-08T19:12:52.086728] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-08T19:12:52.087513] [DEBUG] [LOCAL ] GNE: Trimmed 22478 records to 17869 (keeping 200 days of data) [2025-10-08T19:12:52.198832] [DEBUG] [LOCAL ] GNE: Primary data saved (17869 records). [2025-10-08T19:12:52.198982] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-08T19:12:52.199067] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNE took 40.0s. Estimated remaining: 3h 18m 60s. Rate: 7.1 symbols/min [2025-10-08T19:12:52.369636] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:52.417540] [DEBUG] [LOCAL ] GNW: Loaded 51367 existing records from primary storage. [2025-10-08T19:12:52.417927] [INFO ] [MAIN ] GNW: Loaded 51367 existing records. [2025-10-08T19:12:52.601722] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:52.602031] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-08T19:12:52.602078] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-08T19:12:52.602297] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-08T19:12:52.602355] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-08T19:12:52.820055] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-08T19:12:53.005123] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:53.007426] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T19:12:53.310593] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T19:12:53.355876] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:12:53.617586] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-08T19:12:54.417579] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-08T19:12:54.969202] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:12:55.217599] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-08T19:12:56.017518] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-08T19:12:56.114270] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T19:12:56.478997] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T19:12:56.801627] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:12:56.817494] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-08T19:12:57.617595] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-08T19:12:58.356363] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:12:58.417586] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-08T19:12:58.942150] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:12:59.217567] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-08T19:12:59.728729] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T19:13:00.017600] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-08T19:13:00.817554] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-08T19:13:00.982884] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T19:13:01.225267] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T19:13:01.388808] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T19:13:01.617553] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-08T19:13:02.417561] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-08T19:13:02.947626] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T19:13:02.951124] [INFO ] [REMOTE ] GNK: Full fetch complete (57208 records). [2025-10-08T19:13:02.951259] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-08T19:13:03.222801] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-08T19:13:03.351309] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-08T19:13:03.351392] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-08T19:13:03.352200] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-08T19:13:03.352266] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-08T19:13:03.353442] [DEBUG] [LOCAL ] GNK: Trimmed 57208 records to 40257 (keeping 200 days of data) [2025-10-08T19:13:03.600335] [DEBUG] [LOCAL ] GNK: Primary data saved (40257 records). [2025-10-08T19:13:03.600468] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-08T19:13:03.600551] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNK took 44.7s. Estimated remaining: 3h 18m 56s. Rate: 7.1 symbols/min [2025-10-08T19:13:03.798271] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:03.807897] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:13:03.812277] [INFO ] [REMOTE ] GNRC: Full fetch complete (65389 records). [2025-10-08T19:13:03.812407] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-08T19:13:03.921142] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T19:13:04.018093] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-08T19:13:04.144819] [DEBUG] [LOCAL ] GOF: Loaded 42499 existing records from primary storage. [2025-10-08T19:13:04.155989] [INFO ] [MAIN ] GOF: Loaded 42499 existing records. [2025-10-08T19:13:04.402280] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-08T19:13:04.421769] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-08T19:13:04.444803] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-08T19:13:04.444937] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-08T19:13:04.443842] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:04.445243] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-08T19:13:04.445301] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-08T19:13:04.446201] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-08T19:13:04.446313] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-08T19:13:04.548296] [DEBUG] [LOCAL ] GNRC: Trimmed 65389 records to 45257 (keeping 200 days of data) [2025-10-08T19:13:04.822836] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-08T19:13:04.931845] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:05.112191] [DEBUG] [LOCAL ] GNRC: Primary data saved (45257 records). [2025-10-08T19:13:05.112329] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-08T19:13:05.112417] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 25.1s. Estimated remaining: 3h 18m 37s. Rate: 7.1 symbols/min [2025-10-08T19:13:05.281785] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:05.312480] [DEBUG] [LOCAL ] GOLF: Loaded 31098 existing records from primary storage. [2025-10-08T19:13:05.312800] [INFO ] [MAIN ] GOLF: Loaded 31098 existing records. [2025-10-08T19:13:05.498356] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:05.505479] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T19:13:05.505629] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-08T19:13:05.508741] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-08T19:13:05.509158] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-08T19:13:05.509233] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-08T19:13:05.618000] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-08T19:13:05.926878] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T19:13:05.925409] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:06.373592] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:13:06.417604] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-08T19:13:07.217616] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-08T19:13:08.017522] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-08T19:13:08.275605] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T19:13:08.414897] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T19:13:08.817508] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-08T19:13:08.974385] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T19:13:09.617561] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-08T19:13:10.237873] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T19:13:10.417540] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-08T19:13:10.785276] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T19:13:11.217565] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-08T19:13:11.995950] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T19:13:12.001882] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:13:12.017499] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-08T19:13:12.817567] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-08T19:13:13.617636] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-08T19:13:13.762001] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:13:14.182469] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T19:13:14.417622] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-08T19:13:14.940901] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:13:15.217605] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-08T19:13:16.017533] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-08T19:13:16.085751] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:13:16.440807] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T19:13:16.738971] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T19:13:16.817602] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-08T19:13:17.617567] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-08T19:13:18.368544] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T19:13:18.417499] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-08T19:13:18.932787] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T19:13:19.217690] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-08T19:13:19.860912] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T19:13:20.017590] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-08T19:13:20.532533] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T19:13:20.817559] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-08T19:13:21.448634] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T19:13:21.617514] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-08T19:13:21.764364] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T19:13:22.273450] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T19:13:22.417555] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-08T19:13:23.217560] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-08T19:13:24.017514] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-08T19:13:24.087763] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:13:24.089801] [INFO ] [REMOTE ] GNT: Full fetch complete (11001 records). [2025-10-08T19:13:24.089891] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-08T19:13:24.374941] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T19:13:24.553504] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-08T19:13:24.553588] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-08T19:13:24.553870] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-08T19:13:24.553930] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-08T19:13:24.554377] [DEBUG] [LOCAL ] GNT: Trimmed 11001 records to 8298 (keeping 200 days of data) [2025-10-08T19:13:24.603479] [DEBUG] [LOCAL ] GNT: Primary data saved (8298 records). [2025-10-08T19:13:24.603665] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-08T19:13:24.603778] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNT took 33.7s. Estimated remaining: 3h 18m 46s. Rate: 7.1 symbols/min [2025-10-08T19:13:24.778923] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:24.823101] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-08T19:13:24.826318] [DEBUG] [LOCAL ] GOOS: Loaded 44748 existing records from primary storage. [2025-10-08T19:13:24.826720] [INFO ] [MAIN ] GOOS: Loaded 44748 existing records. [2025-10-08T19:13:25.016763] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:25.017016] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-08T19:13:25.017076] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-08T19:13:25.017318] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-08T19:13:25.017375] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-08T19:13:25.398872] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:25.415281] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T19:13:25.617518] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-08T19:13:26.417544] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-08T19:13:26.577433] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T19:13:26.581513] [INFO ] [REMOTE ] GNW: Full fetch complete (73662 records). [2025-10-08T19:13:26.581628] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-08T19:13:26.984453] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-08T19:13:26.984622] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-08T19:13:26.985742] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-08T19:13:26.985855] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-08T19:13:26.987838] [DEBUG] [LOCAL ] GNW: Trimmed 73662 records to 51342 (keeping 200 days of data) [2025-10-08T19:13:27.061260] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T19:13:27.240050] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-08T19:13:27.346638] [DEBUG] [LOCAL ] GNW: Primary data saved (51342 records). [2025-10-08T19:13:27.346834] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-08T19:13:27.346942] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNW took 35.1s. Estimated remaining: 3h 18m 29s. Rate: 7.1 symbols/min [2025-10-08T19:13:27.515742] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:27.550926] [DEBUG] [LOCAL ] GOTU: Loaded 37911 existing records from primary storage. [2025-10-08T19:13:27.551246] [INFO ] [MAIN ] GOTU: Loaded 37911 existing records. [2025-10-08T19:13:27.731902] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:27.732355] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-08T19:13:27.732524] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-08T19:13:27.732813] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-08T19:13:27.732903] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-08T19:13:27.872074] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T19:13:28.025387] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-08T19:13:28.139387] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:28.817635] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-08T19:13:28.920303] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:13:29.153478] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T19:13:29.617592] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-08T19:13:30.196513] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:13:30.417581] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-08T19:13:30.906818] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T19:13:31.217566] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-08T19:13:31.899134] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T19:13:32.017547] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-08T19:13:32.778098] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:13:32.817500] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-08T19:13:33.617524] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-08T19:13:34.073987] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-08T19:13:34.417522] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-08T19:13:34.723320] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T19:13:34.763414] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T19:13:35.217550] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-08T19:13:35.826705] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:13:36.017560] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-08T19:13:36.393899] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T19:13:36.396729] [INFO ] [REMOTE ] GOLF: Full fetch complete (45103 records). [2025-10-08T19:13:36.396814] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-08T19:13:36.769347] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-08T19:13:36.769437] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-08T19:13:36.770106] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-08T19:13:36.770168] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-08T19:13:36.773063] [DEBUG] [LOCAL ] GOLF: Trimmed 45103 records to 31026 (keeping 200 days of data) [2025-10-08T19:13:36.830142] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-08T19:13:36.972693] [DEBUG] [LOCAL ] GOLF: Primary data saved (31026 records). [2025-10-08T19:13:36.972808] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-08T19:13:36.972911] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOLF took 31.9s. Estimated remaining: 3h 18m 22s. Rate: 7.1 symbols/min [2025-10-08T19:13:37.139739] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:37.184891] [DEBUG] [LOCAL ] GPC: Loaded 46229 existing records from primary storage. [2025-10-08T19:13:37.185267] [INFO ] [MAIN ] GPC: Loaded 46229 existing records. [2025-10-08T19:13:37.372446] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:37.372794] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-08T19:13:37.372846] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-08T19:13:37.373406] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-08T19:13:37.373464] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-08T19:13:37.628166] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-08T19:13:37.741143] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:37.773092] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T19:13:38.314667] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:13:38.417610] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-08T19:13:38.893119] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T19:13:39.217580] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-08T19:13:40.028587] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-08T19:13:40.031624] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T19:13:40.431388] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:13:40.817607] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-08T19:13:41.617585] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-08T19:13:41.823158] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T19:13:42.048079] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:13:42.417565] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-08T19:13:43.049542] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:13:43.217526] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-08T19:13:43.733764] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T19:13:43.737812] [INFO ] [REMOTE ] GOF: Full fetch complete (62065 records). [2025-10-08T19:13:43.738102] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-08T19:13:44.022756] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-08T19:13:44.135926] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-08T19:13:44.136020] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-08T19:13:44.136938] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-08T19:13:44.137006] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-08T19:13:44.138236] [DEBUG] [LOCAL ] GOF: Trimmed 62065 records to 42523 (keeping 200 days of data) [2025-10-08T19:13:44.403695] [DEBUG] [LOCAL ] GOF: Primary data saved (42523 records). [2025-10-08T19:13:44.403833] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-08T19:13:44.403914] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOF took 40.8s. Estimated remaining: 3h 18m 12s. Rate: 7.1 symbols/min [2025-10-08T19:13:44.575005] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:44.590568] [DEBUG] [LOCAL ] GPI: Loaded 14631 existing records from primary storage. [2025-10-08T19:13:44.590812] [INFO ] [MAIN ] GPI: Loaded 14631 existing records. [2025-10-08T19:13:44.774867] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:44.775379] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-08T19:13:44.775467] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-08T19:13:44.775750] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-08T19:13:44.775812] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-08T19:13:44.832977] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-08T19:13:44.896619] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T19:13:45.170874] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:45.296974] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T19:13:45.617597] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-08T19:13:46.204200] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T19:13:46.417563] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-08T19:13:47.217536] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-08T19:13:47.390522] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T19:13:47.895557] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T19:13:48.017552] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-08T19:13:48.093083] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T19:13:48.817729] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-08T19:13:49.389314] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T19:13:49.617510] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-08T19:13:49.770810] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T19:13:50.417555] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-08T19:13:51.217525] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-08T19:13:51.317059] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T19:13:51.779583] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-08T19:13:52.017550] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-08T19:13:52.715256] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T19:13:52.817535] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-08T19:13:53.135345] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T19:13:53.617555] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-08T19:13:54.187888] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:13:54.417555] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-08T19:13:55.217572] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-08T19:13:55.347878] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T19:13:55.864413] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T19:13:56.017588] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-08T19:13:56.426825] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T19:13:56.817557] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-08T19:13:57.323809] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T19:13:57.327257] [INFO ] [REMOTE ] GOTU: Full fetch complete (58769 records). [2025-10-08T19:13:57.327367] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-08T19:13:57.622824] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-08T19:13:57.742404] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-08T19:13:57.742532] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-08T19:13:57.743394] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-08T19:13:57.743458] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-08T19:13:57.744673] [DEBUG] [LOCAL ] GOTU: Trimmed 58769 records to 37800 (keeping 200 days of data) [2025-10-08T19:13:57.958260] [DEBUG] [LOCAL ] GOTU: Primary data saved (37800 records). [2025-10-08T19:13:57.958406] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-08T19:13:57.958526] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOTU took 30.6s. Estimated remaining: 3h 18m 12s. Rate: 7.1 symbols/min [2025-10-08T19:13:58.131336] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:58.139050] [DEBUG] [LOCAL ] GPJA: Loaded 4266 existing records from primary storage. [2025-10-08T19:13:58.139253] [INFO ] [MAIN ] GPJA: Loaded 4266 existing records. [2025-10-08T19:13:58.272033] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:13:58.305604] [INFO ] [REMOTE ] GOOS: Full fetch complete (65185 records). [2025-10-08T19:13:58.315952] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-08T19:13:58.336777] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:58.337439] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-08T19:13:58.337540] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-08T19:13:58.337953] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-08T19:13:58.338032] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-08T19:13:58.424494] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-08T19:13:59.134318] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-08T19:13:59.130875] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:59.134786] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-08T19:13:59.136137] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-08T19:13:59.136204] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-08T19:13:59.138991] [DEBUG] [LOCAL ] GOOS: Trimmed 65185 records to 44801 (keeping 200 days of data) [2025-10-08T19:13:59.226624] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-08T19:13:59.413260] [DEBUG] [LOCAL ] GOOS: Primary data saved (44801 records). [2025-10-08T19:13:59.413481] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-08T19:13:59.413623] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOOS took 34.8s. Estimated remaining: 3h 17m 53s. Rate: 7.1 symbols/min [2025-10-08T19:13:59.475784] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:13:59.824795] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:13:59.894905] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T19:14:00.017594] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-08T19:14:00.817621] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-08T19:14:01.512621] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:14:01.617546] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-08T19:14:01.730429] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T19:14:02.417579] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-08T19:14:03.217560] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-08T19:14:03.389665] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T19:14:03.391032] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T19:14:04.017567] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-08T19:14:04.101848] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T19:14:04.817604] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-08T19:14:05.355185] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T19:14:05.556469] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:14:05.617497] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-08T19:14:06.417545] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-08T19:14:06.880267] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T19:14:07.208259] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T19:14:07.217755] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-08T19:14:08.017613] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-08T19:14:08.659045] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:14:08.794391] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T19:14:08.817503] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-08T19:14:09.482824] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-08T19:14:09.617566] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-08T19:14:10.190910] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T19:14:10.417601] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-08T19:14:10.897793] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T19:14:11.217593] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-08T19:14:12.017588] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-08T19:14:12.134427] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T19:14:12.817551] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-08T19:14:13.430953] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:14:13.434536] [INFO ] [REMOTE ] GPC: Full fetch complete (68792 records). [2025-10-08T19:14:13.434726] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-08T19:14:13.625553] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-08T19:14:13.755552] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T19:14:13.799199] [INFO ] [REMOTE ] GPI: Full fetch complete (21105 records). [2025-10-08T19:14:13.819627] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-08T19:14:13.836634] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-08T19:14:13.868787] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-08T19:14:13.908582] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-08T19:14:13.914418] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-08T19:14:13.968440] [DEBUG] [LOCAL ] GPC: Trimmed 68792 records to 46159 (keeping 200 days of data) [2025-10-08T19:14:14.322763] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-08T19:14:14.323867] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-08T19:14:14.324938] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-08T19:14:14.330435] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-08T19:14:14.330611] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T19:14:14.335700] [DEBUG] [LOCAL ] GPI: Trimmed 21105 records to 14622 (keeping 200 days of data) [2025-10-08T19:14:14.417909] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-08T19:14:14.550201] [DEBUG] [LOCAL ] GPI: Primary data saved (14622 records). [2025-10-08T19:14:14.551081] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-08T19:14:14.551219] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPI took 30.1s. Estimated remaining: 3h 17m 54s. Rate: 7.1 symbols/min [2025-10-08T19:14:14.621879] [DEBUG] [LOCAL ] GPC: Primary data saved (46159 records). [2025-10-08T19:14:14.622016] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-08T19:14:14.622099] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPC took 37.6s. Estimated remaining: 3h 17m 34s. Rate: 7.1 symbols/min [2025-10-08T19:14:14.994406] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T19:14:15.217597] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-08T19:14:15.790034] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T19:14:16.017623] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-08T19:14:16.599803] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T19:14:16.817635] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-08T19:14:17.341754] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T19:14:17.342914] [INFO ] [REMOTE ] GPJA: Full fetch complete (7237 records). [2025-10-08T19:14:17.342993] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-08T19:14:17.725568] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-08T19:14:17.725683] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-08T19:14:17.725892] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-08T19:14:17.725935] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-08T19:14:17.726329] [DEBUG] [LOCAL ] GPJA: Trimmed 7237 records to 4265 (keeping 200 days of data) [2025-10-08T19:14:17.752786] [DEBUG] [LOCAL ] GPJA: Primary data saved (4265 records). [2025-10-08T19:14:17.752897] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-08T19:14:17.752988] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPJA took 19.8s. Estimated remaining: 3h 17m 18s. Rate: 7.2 symbols/min [2025-10-08T19:14:18.411600] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:18.330593] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:18.515451] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:18.513969] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:18.562269] [DEBUG] [LOCAL ] GPMT: Loaded 25876 existing records from primary storage. [2025-10-08T19:14:18.575729] [INFO ] [MAIN ] GPMT: Loaded 25876 existing records. [2025-10-08T19:14:18.575227] [DEBUG] [LOCAL ] GPOR: Loaded 23208 existing records from primary storage. [2025-10-08T19:14:18.581319] [INFO ] [MAIN ] GPOR: Loaded 23208 existing records. [2025-10-08T19:14:18.814569] [DEBUG] [LOCAL ] GPN: Loaded 52045 existing records from primary storage. [2025-10-08T19:14:18.867578] [DEBUG] [LOCAL ] GPK: Loaded 52658 existing records from primary storage. [2025-10-08T19:14:18.892426] [INFO ] [MAIN ] GPN: Loaded 52045 existing records. [2025-10-08T19:14:18.950869] [INFO ] [MAIN ] GPK: Loaded 52658 existing records. [2025-10-08T19:14:19.014670] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:19.048415] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:19.070282] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-08T19:14:19.080681] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-08T19:14:19.114307] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-08T19:14:19.119682] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-08T19:14:19.124895] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-08T19:14:19.181987] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-08T19:14:19.192525] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-08T19:14:19.197939] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-08T19:14:19.689367] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:19.802811] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-08T19:14:19.798338] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:19.883394] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-08T19:14:19.904161] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-08T19:14:19.907101] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-08T19:14:19.978606] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-08T19:14:19.952431] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-08T19:14:20.063390] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-08T19:14:20.052615] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-08T19:14:20.485522] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:20.491866] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-08T19:14:20.583790] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:20.584945] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-08T19:14:21.220191] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:21.246466] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-08T19:14:21.250293] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:21.252614] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-08T19:14:21.826307] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T19:14:21.832810] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-08T19:14:21.983635] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T19:14:21.989404] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-08T19:14:22.573586] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T19:14:22.591306] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-08T19:14:22.601066] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:14:22.662996] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:14:23.219324] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-08T19:14:23.221584] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T19:14:23.923219] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T19:14:24.017514] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-08T19:14:24.224463] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:14:24.817602] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-08T19:14:25.075465] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T19:14:25.617540] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-08T19:14:26.418532] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-08T19:14:26.424325] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:14:26.658132] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:14:27.217601] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-08T19:14:27.733286] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T19:14:28.017609] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-08T19:14:28.817592] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-08T19:14:28.985358] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T19:14:29.617523] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-08T19:14:29.669966] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T19:14:29.740719] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T19:14:30.417531] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-08T19:14:30.729313] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T19:14:31.217518] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-08T19:14:32.017534] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-08T19:14:32.077905] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T19:14:32.393928] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:14:32.817629] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-08T19:14:33.155248] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:14:33.617541] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-08T19:14:34.417518] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-08T19:14:34.805354] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:14:35.217525] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-08T19:14:35.313305] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:14:35.707994] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:14:36.017557] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-08T19:14:36.256453] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T19:14:36.817601] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-08T19:14:37.617593] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-08T19:14:37.694946] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T19:14:37.759739] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T19:14:38.417558] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-08T19:14:38.755737] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:14:39.217590] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-08T19:14:40.017565] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-08T19:14:40.219811] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T19:14:40.244432] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:14:40.817554] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-08T19:14:41.202001] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T19:14:41.617561] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-08T19:14:42.417572] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-08T19:14:42.495990] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T19:14:42.554358] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T19:14:43.217560] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-08T19:14:44.017562] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-08T19:14:44.108718] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T19:14:44.358576] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T19:14:44.817607] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-08T19:14:45.263509] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T19:14:45.617554] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-08T19:14:46.417563] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-08T19:14:47.002530] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-08T19:14:47.141534] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T19:14:47.146299] [INFO ] [REMOTE ] GPK: Full fetch complete (75618 records). [2025-10-08T19:14:47.146478] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-08T19:14:47.224570] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-08T19:14:47.350253] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T19:14:47.607862] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-08T19:14:47.607959] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-08T19:14:47.608927] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-08T19:14:47.608992] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-08T19:14:47.610503] [DEBUG] [LOCAL ] GPK: Trimmed 75618 records to 52672 (keeping 200 days of data) [2025-10-08T19:14:47.946737] [DEBUG] [LOCAL ] GPK: Primary data saved (52672 records). [2025-10-08T19:14:47.946900] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-08T19:14:47.947006] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPK took 30.2s. Estimated remaining: 3h 17m 41s. Rate: 7.1 symbols/min [2025-10-08T19:14:48.022701] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-08T19:14:48.121505] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:48.159030] [DEBUG] [LOCAL ] GPRK: Loaded 39388 existing records from primary storage. [2025-10-08T19:14:48.159365] [INFO ] [MAIN ] GPRK: Loaded 39388 existing records. [2025-10-08T19:14:48.336683] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:48.336897] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-08T19:14:48.336944] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-08T19:14:48.337171] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-08T19:14:48.337228] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-08T19:14:48.696250] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:48.817539] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-08T19:14:48.893137] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:14:48.895076] [INFO ] [REMOTE ] GPMT: Full fetch complete (37116 records). [2025-10-08T19:14:48.895153] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-08T19:14:49.221339] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-08T19:14:49.313901] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-08T19:14:49.313987] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-08T19:14:49.314701] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-08T19:14:49.314764] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-08T19:14:49.315623] [DEBUG] [LOCAL ] GPMT: Trimmed 37116 records to 25869 (keeping 200 days of data) [2025-10-08T19:14:49.470174] [DEBUG] [LOCAL ] GPMT: Primary data saved (25869 records). [2025-10-08T19:14:49.470327] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-08T19:14:49.470414] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 31.7s. Estimated remaining: 3h 17m 23s. Rate: 7.1 symbols/min [2025-10-08T19:14:49.623435] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-08T19:14:49.642115] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:49.669627] [DEBUG] [LOCAL ] GRBK: Loaded 26976 existing records from primary storage. [2025-10-08T19:14:49.669941] [INFO ] [MAIN ] GRBK: Loaded 26976 existing records. [2025-10-08T19:14:49.845106] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:49.845351] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-08T19:14:49.845397] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-08T19:14:49.845676] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-08T19:14:49.845735] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-08T19:14:50.241157] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:50.265903] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:14:50.417549] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-08T19:14:51.144977] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T19:14:51.217552] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-08T19:14:51.479947] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T19:14:52.017621] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-08T19:14:52.536209] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:14:52.817578] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-08T19:14:53.206281] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:14:53.208761] [INFO ] [REMOTE ] GPOR: Full fetch complete (35003 records). [2025-10-08T19:14:53.208845] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-08T19:14:53.620896] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-08T19:14:53.620602] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-08T19:14:53.621810] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-08T19:14:53.622435] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-08T19:14:53.622478] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-08T19:14:53.623551] [DEBUG] [LOCAL ] GPOR: Trimmed 35003 records to 23230 (keeping 200 days of data) [2025-10-08T19:14:53.771616] [DEBUG] [LOCAL ] GPOR: Primary data saved (23230 records). [2025-10-08T19:14:53.771828] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-08T19:14:53.771931] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPOR took 36.0s. Estimated remaining: 3h 17m 8s. Rate: 7.1 symbols/min [2025-10-08T19:14:53.937732] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:53.948395] [DEBUG] [LOCAL ] GRC: Loaded 9198 existing records from primary storage. [2025-10-08T19:14:53.948674] [INFO ] [MAIN ] GRC: Loaded 9198 existing records. [2025-10-08T19:14:54.127410] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:54.127672] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-08T19:14:54.127744] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-08T19:14:54.128073] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-08T19:14:54.128141] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-08T19:14:54.420537] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-08T19:14:54.530634] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:54.545128] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T19:14:54.584292] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T19:14:55.217602] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-08T19:14:55.462131] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T19:14:55.996011] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T19:14:56.017504] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-08T19:14:56.684015] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T19:14:56.817588] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-08T19:14:57.560075] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T19:14:57.617500] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-08T19:14:58.254208] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T19:14:58.417540] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-08T19:14:59.092864] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T19:14:59.217561] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-08T19:14:59.968391] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:15:00.017546] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-08T19:15:00.817719] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-08T19:15:01.617551] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-08T19:15:01.654498] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T19:15:01.703425] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:15:02.417567] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-08T19:15:03.136692] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T19:15:03.217564] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-08T19:15:03.348222] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:15:03.353069] [INFO ] [REMOTE ] GPN: Full fetch complete (74914 records). [2025-10-08T19:15:03.353201] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-08T19:15:03.768333] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-08T19:15:03.768578] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-08T19:15:03.769683] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-08T19:15:03.769765] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-08T19:15:03.771174] [DEBUG] [LOCAL ] GPN: Trimmed 74914 records to 52027 (keeping 200 days of data) [2025-10-08T19:15:03.869301] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T19:15:04.017613] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-08T19:15:04.104131] [DEBUG] [LOCAL ] GPN: Primary data saved (52027 records). [2025-10-08T19:15:04.104283] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-08T19:15:04.104371] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 46.4s. Estimated remaining: 3h 17m 3s. Rate: 7.1 symbols/min [2025-10-08T19:15:04.271559] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:04.292105] [DEBUG] [LOCAL ] GRDN: Loaded 20854 existing records from primary storage. [2025-10-08T19:15:04.292360] [INFO ] [MAIN ] GRDN: Loaded 20854 existing records. [2025-10-08T19:15:04.467484] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:04.467689] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-08T19:15:04.467747] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-08T19:15:04.468037] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-08T19:15:04.468095] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-08T19:15:04.817524] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:04.817730] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-08T19:15:05.252791] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T19:15:05.617590] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-08T19:15:05.769838] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T19:15:06.417599] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-08T19:15:07.217524] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-08T19:15:07.311595] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:15:07.374524] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T19:15:07.926887] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T19:15:08.017512] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-08T19:15:08.815019] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:15:08.818345] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-08T19:15:09.617599] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-08T19:15:09.739540] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T19:15:10.417604] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-08T19:15:11.217573] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-08T19:15:11.254244] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T19:15:11.749713] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:15:11.833074] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T19:15:12.017573] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-08T19:15:12.817614] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-08T19:15:13.350319] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:15:13.452563] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T19:15:13.454244] [INFO ] [REMOTE ] GRC: Full fetch complete (13282 records). [2025-10-08T19:15:13.454336] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-08T19:15:13.621201] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-08T19:15:13.849906] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-08T19:15:13.850008] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-08T19:15:13.850348] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-08T19:15:13.850389] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-08T19:15:13.850897] [DEBUG] [LOCAL ] GRC: Trimmed 13282 records to 9202 (keeping 200 days of data) [2025-10-08T19:15:13.908824] [DEBUG] [LOCAL ] GRC: Primary data saved (9202 records). [2025-10-08T19:15:13.908977] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-08T19:15:13.909067] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GRC took 20.1s. Estimated remaining: 3h 16m 56s. Rate: 7.1 symbols/min [2025-10-08T19:15:14.076095] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:14.114974] [DEBUG] [LOCAL ] GRMN: Loaded 40786 existing records from primary storage. [2025-10-08T19:15:14.115280] [INFO ] [MAIN ] GRMN: Loaded 40786 existing records. [2025-10-08T19:15:14.291008] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:14.291271] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-08T19:15:14.291317] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-08T19:15:14.291571] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-08T19:15:14.291628] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-08T19:15:14.430158] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-08T19:15:14.657503] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:14.853139] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T19:15:14.954481] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T19:15:15.217574] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-08T19:15:16.017581] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-08T19:15:16.199299] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T19:15:16.817567] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-08T19:15:17.217528] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T19:15:17.512209] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T19:15:17.617508] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-08T19:15:18.417620] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-08T19:15:18.962536] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T19:15:19.217610] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-08T19:15:19.777476] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:15:20.017548] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-08T19:15:20.726811] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:15:20.817512] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-08T19:15:20.949596] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T19:15:21.617597] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-08T19:15:22.226391] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:15:22.229833] [INFO ] [REMOTE ] GPRK: Full fetch complete (57687 records). [2025-10-08T19:15:22.229935] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-08T19:15:22.428594] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-08T19:15:22.621760] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-08T19:15:22.621845] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-08T19:15:22.622627] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-08T19:15:22.622716] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-08T19:15:22.624046] [DEBUG] [LOCAL ] GPRK: Trimmed 57687 records to 39463 (keeping 200 days of data) [2025-10-08T19:15:22.859996] [DEBUG] [LOCAL ] GPRK: Primary data saved (39463 records). [2025-10-08T19:15:22.860146] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-08T19:15:22.860232] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPRK took 34.9s. Estimated remaining: 3h 16m 49s. Rate: 7.1 symbols/min [2025-10-08T19:15:23.072595] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:23.097024] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:15:23.152405] [DEBUG] [LOCAL ] GRND: Loaded 49989 existing records from primary storage. [2025-10-08T19:15:23.152779] [INFO ] [MAIN ] GRND: Loaded 49989 existing records. [2025-10-08T19:15:23.222820] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-08T19:15:23.356990] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:23.357248] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-08T19:15:23.357336] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-08T19:15:23.358079] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-08T19:15:23.358142] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-08T19:15:23.753519] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:23.754870] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:15:24.017566] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-08T19:15:24.406810] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:15:24.817569] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-08T19:15:25.270569] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T19:15:25.617574] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-08T19:15:26.421023] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-08T19:15:26.426494] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:15:26.478796] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T19:15:27.217573] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-08T19:15:27.736957] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:15:28.017565] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-08T19:15:28.476688] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:15:28.817540] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-08T19:15:29.595200] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:15:29.617590] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-08T19:15:30.411068] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T19:15:30.424956] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-08T19:15:30.480126] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T19:15:30.484680] [INFO ] [REMOTE ] GRBK: Full fetch complete (40523 records). [2025-10-08T19:15:30.484872] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-08T19:15:30.879278] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-08T19:15:30.879375] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-08T19:15:30.880109] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-08T19:15:30.880171] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-08T19:15:30.882083] [DEBUG] [LOCAL ] GRBK: Trimmed 40523 records to 26912 (keeping 200 days of data) [2025-10-08T19:15:31.047699] [DEBUG] [LOCAL ] GRBK: Primary data saved (26912 records). [2025-10-08T19:15:31.047855] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-08T19:15:31.048001] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRBK took 41.6s. Estimated remaining: 3h 16m 40s. Rate: 7.1 symbols/min [2025-10-08T19:15:31.221593] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-08T19:15:31.223299] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:31.257125] [DEBUG] [LOCAL ] GRNT: Loaded 33812 existing records from primary storage. [2025-10-08T19:15:31.257485] [INFO ] [MAIN ] GRNT: Loaded 33812 existing records. [2025-10-08T19:15:31.441062] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:31.441349] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-08T19:15:31.441413] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-08T19:15:31.442329] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-08T19:15:31.442391] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-08T19:15:31.806069] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:31.877295] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:15:32.017547] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-08T19:15:32.108012] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T19:15:32.817677] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-08T19:15:33.277208] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T19:15:33.617575] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-08T19:15:33.892703] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T19:15:34.417600] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-08T19:15:35.222675] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-08T19:15:35.243200] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T19:15:35.271877] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T19:15:36.017548] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-08T19:15:36.554081] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T19:15:36.817549] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-08T19:15:37.101440] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:15:37.104385] [INFO ] [REMOTE ] GRDN: Full fetch complete (26327 records). [2025-10-08T19:15:37.104480] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-08T19:15:37.473291] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-08T19:15:37.473381] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-08T19:15:37.474003] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-08T19:15:37.474067] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-08T19:15:37.474891] [DEBUG] [LOCAL ] GRDN: Trimmed 26327 records to 20937 (keeping 200 days of data) [2025-10-08T19:15:37.607231] [DEBUG] [LOCAL ] GRDN: Primary data saved (20937 records). [2025-10-08T19:15:37.607405] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-08T19:15:37.607575] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRDN took 33.5s. Estimated remaining: 3h 16m 29s. Rate: 7.1 symbols/min [2025-10-08T19:15:37.622798] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-08T19:15:37.783749] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:37.794391] [DEBUG] [LOCAL ] GROV: Loaded 8861 existing records from primary storage. [2025-10-08T19:15:37.794686] [INFO ] [MAIN ] GROV: Loaded 8861 existing records. [2025-10-08T19:15:37.972152] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:37.972411] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-08T19:15:37.972458] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-08T19:15:37.972873] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-08T19:15:37.972934] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-08T19:15:38.369186] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:38.397554] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:15:38.417511] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-08T19:15:39.217601] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-08T19:15:39.431570] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T19:15:39.737974] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:15:39.767993] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T19:15:40.017628] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-08T19:15:40.817580] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-08T19:15:40.887009] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T19:15:41.617542] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-08T19:15:42.165931] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T19:15:42.417564] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-08T19:15:42.468520] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T19:15:43.217575] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-08T19:15:43.722175] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T19:15:44.017551] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-08T19:15:44.067519] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T19:15:44.817560] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-08T19:15:45.622845] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-08T19:15:45.641277] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T19:15:46.017329] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T19:15:46.188609] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T19:15:46.417568] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-08T19:15:47.217707] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-08T19:15:47.925930] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T19:15:47.988630] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:15:48.017504] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-08T19:15:48.778068] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:15:48.817560] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-08T19:15:49.395071] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T19:15:49.617587] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-08T19:15:50.326411] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T19:15:50.417559] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-08T19:15:51.165592] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T19:15:51.217495] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-08T19:15:51.826873] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T19:15:52.017597] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-08T19:15:52.645193] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T19:15:52.646326] [INFO ] [REMOTE ] GROV: Full fetch complete (14295 records). [2025-10-08T19:15:52.646426] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-08T19:15:52.825464] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-08T19:15:53.043684] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-08T19:15:53.043772] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-08T19:15:53.044128] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-08T19:15:53.044166] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-08T19:15:53.044663] [DEBUG] [LOCAL ] GROV: Trimmed 14295 records to 8857 (keeping 200 days of data) [2025-10-08T19:15:53.097147] [DEBUG] [LOCAL ] GROV: Primary data saved (8857 records). [2025-10-08T19:15:53.097280] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-08T19:15:53.097380] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GROV took 15.5s. Estimated remaining: 3h 16m 31s. Rate: 7.1 symbols/min [2025-10-08T19:15:53.286813] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:53.294031] [DEBUG] [LOCAL ] GRX: Loaded 4786 existing records from primary storage. [2025-10-08T19:15:53.294251] [INFO ] [MAIN ] GRX: Loaded 4786 existing records. [2025-10-08T19:15:53.485524] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:53.485771] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-08T19:15:53.485833] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-08T19:15:53.486142] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-08T19:15:53.486201] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-08T19:15:53.622700] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-08T19:15:53.870918] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:54.095990] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:15:54.417544] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-08T19:15:55.035443] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T19:15:55.075932] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:15:55.079721] [INFO ] [REMOTE ] GRND: Full fetch complete (71100 records). [2025-10-08T19:15:55.079832] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-08T19:15:55.222706] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-08T19:15:55.489582] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-08T19:15:55.489744] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-08T19:15:55.490782] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-08T19:15:55.490847] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-08T19:15:55.493124] [DEBUG] [LOCAL ] GRND: Trimmed 71100 records to 49969 (keeping 200 days of data) [2025-10-08T19:15:55.799624] [DEBUG] [LOCAL ] GRND: Primary data saved (49969 records). [2025-10-08T19:15:55.799766] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-08T19:15:55.799868] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRND took 32.9s. Estimated remaining: 3h 16m 14s. Rate: 7.1 symbols/min [2025-10-08T19:15:55.905272] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T19:15:56.020438] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:56.020505] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-08T19:15:56.075396] [DEBUG] [LOCAL ] GS: Loaded 51792 existing records from primary storage. [2025-10-08T19:15:56.075751] [INFO ] [MAIN ] GS: Loaded 51792 existing records. [2025-10-08T19:15:56.256673] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:56.257044] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-08T19:15:56.257113] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-08T19:15:56.258755] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-08T19:15:56.258818] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-08T19:15:56.610812] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T19:15:56.616036] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:56.817531] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-08T19:15:57.617609] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-08T19:15:58.175057] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T19:15:58.417520] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-08T19:15:58.557506] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:15:58.983877] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T19:15:59.217553] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-08T19:15:59.581631] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-08T19:16:00.017565] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-08T19:16:00.817591] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-08T19:16:01.308956] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T19:16:01.376151] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T19:16:01.617562] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-08T19:16:02.417637] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-08T19:16:03.026354] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T19:16:03.217550] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-08T19:16:03.694186] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T19:16:04.017540] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-08T19:16:04.369107] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T19:16:04.817515] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-08T19:16:05.286261] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T19:16:05.437800] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T19:16:05.617626] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-08T19:16:06.143920] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-08T19:16:06.417630] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-08T19:16:07.217564] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-08T19:16:07.988087] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T19:16:07.989239] [INFO ] [REMOTE ] GRX: Full fetch complete (6622 records). [2025-10-08T19:16:07.989312] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-08T19:16:08.022720] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-08T19:16:08.365266] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-08T19:16:08.365350] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-08T19:16:08.365540] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-08T19:16:08.365577] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-08T19:16:08.366010] [DEBUG] [LOCAL ] GRX: Trimmed 6622 records to 4764 (keeping 200 days of data) [2025-10-08T19:16:08.394818] [DEBUG] [LOCAL ] GRX: Primary data saved (4764 records). [2025-10-08T19:16:08.394996] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-08T19:16:08.395125] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRX took 15.3s. Estimated remaining: 3h 16m 12s. Rate: 7.1 symbols/min [2025-10-08T19:16:08.583514] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:08.624412] [DEBUG] [LOCAL ] GSBD: Loaded 39246 existing records from primary storage. [2025-10-08T19:16:08.624935] [INFO ] [MAIN ] GSBD: Loaded 39246 existing records. [2025-10-08T19:16:08.826808] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-08T19:16:08.840360] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:08.853770] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-08T19:16:08.853843] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-08T19:16:08.856363] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-08T19:16:08.856294] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-08T19:16:08.856849] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-08T19:16:09.232135] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:09.257332] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:16:09.617571] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-08T19:16:10.235956] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:16:10.417617] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-08T19:16:10.828095] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T19:16:11.217577] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-08T19:16:11.561832] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T19:16:12.017577] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-08T19:16:12.324760] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:16:12.327772] [INFO ] [REMOTE ] GRMN: Full fetch complete (59807 records). [2025-10-08T19:16:12.327892] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-08T19:16:12.774967] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-08T19:16:12.775061] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-08T19:16:12.775969] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-08T19:16:12.776038] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-08T19:16:12.777440] [DEBUG] [LOCAL ] GRMN: Trimmed 59807 records to 40656 (keeping 200 days of data) [2025-10-08T19:16:12.860562] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-08T19:16:13.105002] [DEBUG] [LOCAL ] GRMN: Primary data saved (40656 records). [2025-10-08T19:16:13.105286] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-08T19:16:13.105502] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRMN took 59.2s. Estimated remaining: 3h 15m 58s. Rate: 7.1 symbols/min [2025-10-08T19:16:13.315751] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:13.370992] [DEBUG] [LOCAL ] GSK: Loaded 53502 existing records from primary storage. [2025-10-08T19:16:13.371362] [INFO ] [MAIN ] GSK: Loaded 53502 existing records. [2025-10-08T19:16:13.548787] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:13.549174] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-08T19:16:13.549293] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-08T19:16:13.550838] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-08T19:16:13.550900] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-08T19:16:13.624781] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-08T19:16:13.916541] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T19:16:13.947279] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:13.980836] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:16:14.417611] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-08T19:16:15.218156] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-08T19:16:15.423730] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T19:16:16.008705] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:16:16.017494] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-08T19:16:16.681502] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:16:16.817557] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-08T19:16:17.617553] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-08T19:16:17.671872] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T19:16:18.417607] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-08T19:16:19.217542] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-08T19:16:19.341151] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-08T19:16:19.512364] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T19:16:19.626512] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T19:16:20.017586] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-08T19:16:20.817546] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-08T19:16:20.896352] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:16:21.617550] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-08T19:16:21.863634] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T19:16:22.417639] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-08T19:16:22.612968] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:16:22.686733] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T19:16:23.217524] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-08T19:16:23.585245] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T19:16:24.017581] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-08T19:16:24.817614] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-08T19:16:25.032273] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T19:16:25.180536] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T19:16:25.183911] [INFO ] [REMOTE ] GRNT: Full fetch complete (48437 records). [2025-10-08T19:16:25.184021] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-08T19:16:25.622771] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-08T19:16:25.626185] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-08T19:16:25.626240] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-08T19:16:25.627151] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-08T19:16:25.627315] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-08T19:16:25.628603] [DEBUG] [LOCAL ] GRNT: Trimmed 48437 records to 33908 (keeping 200 days of data) [2025-10-08T19:16:25.833700] [DEBUG] [LOCAL ] GRNT: Primary data saved (33908 records). [2025-10-08T19:16:25.833865] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-08T19:16:25.833972] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRNT took 54.8s. Estimated remaining: 3h 15m 56s. Rate: 7.1 symbols/min [2025-10-08T19:16:26.020963] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:26.054169] [DEBUG] [LOCAL ] GSL: Loaded 33185 existing records from primary storage. [2025-10-08T19:16:26.054518] [INFO ] [MAIN ] GSL: Loaded 33185 existing records. [2025-10-08T19:16:26.240089] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:26.240447] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-08T19:16:26.240520] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-08T19:16:26.241683] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-08T19:16:26.241748] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-08T19:16:26.418202] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-08T19:16:26.656967] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:26.690601] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T19:16:27.217631] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-08T19:16:27.764875] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:16:27.895151] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-08T19:16:28.017556] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-08T19:16:28.729591] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:16:28.817531] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-08T19:16:29.374443] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T19:16:29.617567] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-08T19:16:30.417561] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-08T19:16:30.725394] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T19:16:30.919237] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T19:16:31.217610] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-08T19:16:31.743444] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T19:16:32.017553] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-08T19:16:32.762100] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:16:32.817563] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-08T19:16:33.060122] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T19:16:33.617572] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-08T19:16:34.417621] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-08T19:16:34.943427] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-08T19:16:34.996303] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T19:16:35.217554] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-08T19:16:35.626577] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T19:16:36.017632] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-08T19:16:36.602054] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:16:36.817582] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-08T19:16:37.617550] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-08T19:16:38.031041] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T19:16:38.208636] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T19:16:38.417563] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-08T19:16:38.684017] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T19:16:39.217599] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-08T19:16:39.855169] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:16:39.858782] [INFO ] [REMOTE ] GSBD: Full fetch complete (58478 records). [2025-10-08T19:16:39.858893] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-08T19:16:40.035722] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-08T19:16:40.253818] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-08T19:16:40.253919] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-08T19:16:40.254741] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-08T19:16:40.254807] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-08T19:16:40.256155] [DEBUG] [LOCAL ] GSBD: Trimmed 58478 records to 39374 (keeping 200 days of data) [2025-10-08T19:16:40.509055] [DEBUG] [LOCAL ] GSBD: Primary data saved (39374 records). [2025-10-08T19:16:40.509224] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-08T19:16:40.509340] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GSBD took 32.1s. Estimated remaining: 3h 15m 56s. Rate: 7.1 symbols/min [2025-10-08T19:16:40.697077] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:40.742585] [DEBUG] [LOCAL ] GTES: Loaded 50458 existing records from primary storage. [2025-10-08T19:16:40.742970] [INFO ] [MAIN ] GTES: Loaded 50458 existing records. [2025-10-08T19:16:40.822478] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-08T19:16:40.926670] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:40.926940] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-08T19:16:40.928029] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-08T19:16:40.929469] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-08T19:16:40.929532] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-08T19:16:41.298808] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:41.320783] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T19:16:41.358452] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T19:16:41.617552] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-08T19:16:42.417616] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-08T19:16:42.753040] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T19:16:43.217573] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-08T19:16:43.345763] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:16:43.349520] [INFO ] [REMOTE ] GS: Full fetch complete (75647 records). [2025-10-08T19:16:43.349625] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-08T19:16:43.741126] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-08T19:16:43.741242] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-08T19:16:43.742244] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-08T19:16:43.742327] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-08T19:16:43.743988] [DEBUG] [LOCAL ] GS: Trimmed 75647 records to 51771 (keeping 200 days of data) [2025-10-08T19:16:43.864256] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T19:16:44.017522] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-08T19:16:44.107841] [DEBUG] [LOCAL ] GS: Primary data saved (51771 records). [2025-10-08T19:16:44.108004] [INFO ] [MAIN ] GS: Full history saved. [2025-10-08T19:16:44.109066] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GS took 48.3s. Estimated remaining: 3h 15m 41s. Rate: 7.1 symbols/min [2025-10-08T19:16:44.273411] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:44.316417] [DEBUG] [LOCAL ] GTLS: Loaded 42987 existing records from primary storage. [2025-10-08T19:16:44.316756] [INFO ] [MAIN ] GTLS: Loaded 42987 existing records. [2025-10-08T19:16:44.495841] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:44.496083] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-08T19:16:44.496128] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-08T19:16:44.497425] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-08T19:16:44.497489] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-08T19:16:44.821161] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-08T19:16:44.883229] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:44.943512] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T19:16:45.279599] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T19:16:45.617551] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-08T19:16:46.417506] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-08T19:16:46.619553] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T19:16:46.735512] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T19:16:47.217565] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-08T19:16:47.620311] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T19:16:48.017561] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-08T19:16:48.817536] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-08T19:16:48.838512] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T19:16:48.843012] [INFO ] [REMOTE ] GSK: Full fetch complete (77475 records). [2025-10-08T19:16:48.843141] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-08T19:16:49.247519] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-08T19:16:49.247663] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-08T19:16:49.249466] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-08T19:16:49.249738] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-08T19:16:49.251458] [DEBUG] [LOCAL ] GSK: Trimmed 77475 records to 53500 (keeping 200 days of data) [2025-10-08T19:16:49.631391] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-08T19:16:49.634841] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T19:16:49.661008] [DEBUG] [LOCAL ] GSK: Primary data saved (53500 records). [2025-10-08T19:16:49.661132] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-08T19:16:49.661229] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSK took 36.6s. Estimated remaining: 3h 15m 29s. Rate: 7.1 symbols/min [2025-10-08T19:16:49.852007] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:49.901625] [DEBUG] [LOCAL ] GTN: Loaded 45327 existing records from primary storage. [2025-10-08T19:16:49.902022] [INFO ] [MAIN ] GTN: Loaded 45327 existing records. [2025-10-08T19:16:50.077998] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:50.078230] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-08T19:16:50.078279] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-08T19:16:50.079521] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-08T19:16:50.079581] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-08T19:16:50.432358] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-08T19:16:50.438187] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:50.465023] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T19:16:50.740319] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:16:50.743033] [INFO ] [REMOTE ] GSL: Full fetch complete (47956 records). [2025-10-08T19:16:50.743126] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-08T19:16:51.161352] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-08T19:16:51.161431] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-08T19:16:51.162140] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-08T19:16:51.162202] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-08T19:16:51.163181] [DEBUG] [LOCAL ] GSL: Trimmed 47956 records to 33224 (keeping 200 days of data) [2025-10-08T19:16:51.224097] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-08T19:16:51.368083] [DEBUG] [LOCAL ] GSL: Primary data saved (33224 records). [2025-10-08T19:16:51.368247] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-08T19:16:51.368336] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSL took 25.5s. Estimated remaining: 3h 15m 11s. Rate: 7.1 symbols/min [2025-10-08T19:16:51.536627] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:51.573112] [DEBUG] [LOCAL ] GTY: Loaded 30174 existing records from primary storage. [2025-10-08T19:16:51.573635] [INFO ] [MAIN ] GTY: Loaded 30174 existing records. [2025-10-08T19:16:51.762505] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:51.762823] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-08T19:16:51.762872] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-08T19:16:51.763979] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-08T19:16:51.764041] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-08T19:16:52.020832] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-08T19:16:52.158718] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:52.171195] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T19:16:52.438128] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T19:16:52.817560] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-08T19:16:53.396604] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:16:53.617561] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-08T19:16:54.427479] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-08T19:16:54.453716] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T19:16:55.217570] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-08T19:16:55.293750] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T19:16:55.364049] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T19:16:56.017541] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-08T19:16:56.644031] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T19:16:56.817472] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-08T19:16:57.617583] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-08T19:16:57.664148] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T19:16:58.296059] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:16:58.417495] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-08T19:16:59.071103] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T19:16:59.217493] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-08T19:16:59.746148] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:17:00.017547] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-08T19:17:00.723234] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T19:17:00.817499] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-08T19:17:01.283541] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T19:17:01.617546] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-08T19:17:02.417607] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-08T19:17:02.527299] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T19:17:03.075822] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T19:17:03.217615] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-08T19:17:03.701307] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:17:04.017550] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-08T19:17:04.118448] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T19:17:04.817607] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-08T19:17:05.319991] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T19:17:05.617549] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-08T19:17:05.813828] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T19:17:06.417567] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-08T19:17:07.217555] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-08T19:17:07.345828] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T19:17:07.828333] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:17:08.017638] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-08T19:17:08.616894] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:17:08.817573] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-08T19:17:09.357031] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T19:17:09.617545] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-08T19:17:10.101399] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:17:10.417552] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-08T19:17:10.437692] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T19:17:11.217635] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-08T19:17:11.815445] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T19:17:11.819559] [INFO ] [REMOTE ] GTLS: Full fetch complete (61427 records). [2025-10-08T19:17:11.819706] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-08T19:17:12.026588] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-08T19:17:12.212942] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-08T19:17:12.213035] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-08T19:17:12.213891] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-08T19:17:12.213959] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-08T19:17:12.215520] [DEBUG] [LOCAL ] GTLS: Trimmed 61427 records to 42973 (keeping 200 days of data) [2025-10-08T19:17:12.486670] [DEBUG] [LOCAL ] GTLS: Primary data saved (42973 records). [2025-10-08T19:17:12.486809] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-08T19:17:12.486907] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GTLS took 28.4s. Estimated remaining: 3h 15m 20s. Rate: 7.1 symbols/min [2025-10-08T19:17:12.653453] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:17:12.672500] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:12.676428] [INFO ] [REMOTE ] GTES: Full fetch complete (73800 records). [2025-10-08T19:17:12.676515] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-08T19:17:12.839410] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-08T19:17:12.886888] [DEBUG] [LOCAL ] GUG: Loaded 12172 existing records from primary storage. [2025-10-08T19:17:12.933415] [INFO ] [MAIN ] GUG: Loaded 12172 existing records. [2025-10-08T19:17:13.265862] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-08T19:17:13.286121] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-08T19:17:13.286060] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:13.287444] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-08T19:17:13.287611] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-08T19:17:13.287703] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-08T19:17:13.287765] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-08T19:17:13.288295] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-08T19:17:13.288619] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-08T19:17:13.375444] [DEBUG] [LOCAL ] GTES: Trimmed 73800 records to 50433 (keeping 200 days of data) [2025-10-08T19:17:13.788848] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:13.790325] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-08T19:17:13.836739] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T19:17:14.057164] [DEBUG] [LOCAL ] GTES: Primary data saved (50433 records). [2025-10-08T19:17:14.057371] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-08T19:17:14.057487] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 33.5s. Estimated remaining: 3h 15m 2s. Rate: 7.1 symbols/min [2025-10-08T19:17:14.313791] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:14.318448] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:17:14.366384] [DEBUG] [LOCAL ] GUT: Loaded 15453 existing records from primary storage. [2025-10-08T19:17:14.366822] [INFO ] [MAIN ] GUT: Loaded 15453 existing records. [2025-10-08T19:17:14.420022] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-08T19:17:14.677185] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:14.677519] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-08T19:17:14.677602] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-08T19:17:14.678380] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-08T19:17:14.678495] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-08T19:17:14.903807] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T19:17:15.184774] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:15.217581] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-08T19:17:15.794879] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:17:16.017577] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-08T19:17:16.034471] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T19:17:16.817595] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-08T19:17:17.622614] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-08T19:17:17.627373] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T19:17:17.701154] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:17:18.227757] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T19:17:18.417691] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-08T19:17:19.217716] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-08T19:17:19.781017] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T19:17:20.017593] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-08T19:17:20.163079] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T19:17:20.817600] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-08T19:17:21.453979] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:17:21.617597] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-08T19:17:21.683972] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T19:17:22.417568] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-08T19:17:22.661395] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:17:23.217580] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-08T19:17:24.017600] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-08T19:17:24.118046] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T19:17:24.143226] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T19:17:24.817606] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-08T19:17:24.982791] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T19:17:25.431241] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-08T19:17:25.617617] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-08T19:17:26.417577] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-08T19:17:26.538504] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T19:17:27.217567] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-08T19:17:27.831798] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:17:28.017567] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-08T19:17:28.235912] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T19:17:28.817563] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-08T19:17:29.230544] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T19:17:29.617559] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-08T19:17:29.655961] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T19:17:30.417545] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-08T19:17:30.810395] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:17:30.813031] [INFO ] [REMOTE ] GTY: Full fetch complete (43733 records). [2025-10-08T19:17:30.813129] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-08T19:17:31.226080] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-08T19:17:31.246772] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-08T19:17:31.246868] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-08T19:17:31.247905] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-08T19:17:31.248104] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-08T19:17:31.253102] [DEBUG] [LOCAL ] GTY: Trimmed 43733 records to 30191 (keeping 200 days of data) [2025-10-08T19:17:31.459813] [DEBUG] [LOCAL ] GTY: Primary data saved (30191 records). [2025-10-08T19:17:31.459978] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-08T19:17:31.460130] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTY took 40.1s. Estimated remaining: 3h 15m 7s. Rate: 7.1 symbols/min [2025-10-08T19:17:31.654786] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:31.689809] [DEBUG] [LOCAL ] GVA: Loaded 32996 existing records from primary storage. [2025-10-08T19:17:31.690127] [INFO ] [MAIN ] GVA: Loaded 32996 existing records. [2025-10-08T19:17:31.875450] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:31.875773] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-08T19:17:31.875860] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-08T19:17:31.885666] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-08T19:17:31.885853] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-08T19:17:31.892779] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T19:17:31.962572] [INFO ] [REMOTE ] GTN: Full fetch complete (66265 records). [2025-10-08T19:17:31.981158] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-08T19:17:32.033977] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T19:17:32.022624] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-08T19:17:32.601531] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:32.705109] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-08T19:17:32.705201] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-08T19:17:32.706102] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-08T19:17:32.706169] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-08T19:17:32.707522] [DEBUG] [LOCAL ] GTN: Trimmed 66265 records to 45251 (keeping 200 days of data) [2025-10-08T19:17:32.823794] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-08T19:17:32.978411] [DEBUG] [LOCAL ] GTN: Primary data saved (45251 records). [2025-10-08T19:17:32.978582] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-08T19:17:32.978717] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTN took 43.3s. Estimated remaining: 3h 14m 48s. Rate: 7.1 symbols/min [2025-10-08T19:17:33.092964] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:17:33.167955] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:33.185542] [DEBUG] [LOCAL ] GWH: Loaded 16885 existing records from primary storage. [2025-10-08T19:17:33.185865] [INFO ] [MAIN ] GWH: Loaded 16885 existing records. [2025-10-08T19:17:33.360900] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:33.361156] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-08T19:17:33.361204] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-08T19:17:33.361788] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-08T19:17:33.361848] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-08T19:17:33.618261] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-08T19:17:33.738032] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:33.739403] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T19:17:34.417591] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-08T19:17:35.069050] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:17:35.160931] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T19:17:35.217558] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-08T19:17:36.017547] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-08T19:17:36.189773] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T19:17:36.720570] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T19:17:36.817580] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-08T19:17:37.410040] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T19:17:37.617572] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-08T19:17:38.417575] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-08T19:17:38.479149] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T19:17:38.480691] [INFO ] [REMOTE ] GUT: Full fetch complete (22659 records). [2025-10-08T19:17:38.480783] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-08T19:17:38.850306] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-08T19:17:38.850374] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-08T19:17:38.850874] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-08T19:17:38.850936] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-08T19:17:38.851595] [DEBUG] [LOCAL ] GUT: Trimmed 22659 records to 15479 (keeping 200 days of data) [2025-10-08T19:17:38.943065] [DEBUG] [LOCAL ] GUT: Primary data saved (15479 records). [2025-10-08T19:17:38.943207] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-08T19:17:38.943292] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUT took 24.9s. Estimated remaining: 3h 14m 37s. Rate: 7.1 symbols/min [2025-10-08T19:17:39.125791] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:39.163701] [DEBUG] [LOCAL ] GWRE: Loaded 40202 existing records from primary storage. [2025-10-08T19:17:39.164060] [INFO ] [MAIN ] GWRE: Loaded 40202 existing records. [2025-10-08T19:17:39.222697] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-08T19:17:39.363584] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T19:17:39.367636] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:39.371331] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-08T19:17:39.371414] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-08T19:17:39.372626] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-08T19:17:39.372711] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-08T19:17:39.755846] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:40.017531] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-08T19:17:40.101849] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:17:40.817553] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-08T19:17:41.617517] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-08T19:17:41.752628] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:17:41.873776] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T19:17:42.088990] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T19:17:42.417547] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-08T19:17:43.012678] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T19:17:43.217553] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-08T19:17:44.017606] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-08T19:17:44.626058] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:17:44.817504] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-08T19:17:44.839232] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T19:17:44.840669] [INFO ] [REMOTE ] GUG: Full fetch complete (19574 records). [2025-10-08T19:17:44.840746] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-08T19:17:45.200204] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-08T19:17:45.200291] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-08T19:17:45.200714] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-08T19:17:45.200773] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-08T19:17:45.201300] [DEBUG] [LOCAL ] GUG: Trimmed 19574 records to 12241 (keeping 200 days of data) [2025-10-08T19:17:45.277170] [DEBUG] [LOCAL ] GUG: Primary data saved (12241 records). [2025-10-08T19:17:45.277319] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-08T19:17:45.277410] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GUG took 32.8s. Estimated remaining: 3h 14m 25s. Rate: 7.1 symbols/min [2025-10-08T19:17:45.443733] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:45.467818] [DEBUG] [LOCAL ] GWW: Loaded 19466 existing records from primary storage. [2025-10-08T19:17:45.468235] [INFO ] [MAIN ] GWW: Loaded 19466 existing records. [2025-10-08T19:17:45.622457] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-08T19:17:45.647695] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:45.648064] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-08T19:17:45.648131] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-08T19:17:45.648974] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-08T19:17:45.649037] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-08T19:17:46.041197] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:46.325632] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T19:17:46.417539] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-08T19:17:46.520839] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T19:17:47.217535] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-08T19:17:47.464737] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T19:17:48.017553] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-08T19:17:48.520842] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T19:17:48.778393] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T19:17:48.817599] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-08T19:17:49.617553] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-08T19:17:49.911170] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T19:17:50.417572] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-08T19:17:50.899250] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:17:51.217608] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-08T19:17:51.700289] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:17:51.977187] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T19:17:52.017567] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-08T19:17:52.817547] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-08T19:17:53.617748] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T19:17:53.618017] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-08T19:17:53.674614] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T19:17:54.264019] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T19:17:54.417561] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-08T19:17:55.217564] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-08T19:17:55.475559] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T19:17:56.017525] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-08T19:17:56.337129] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T19:17:56.817563] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-08T19:17:57.577402] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:17:57.617539] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-08T19:17:57.737625] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T19:17:58.417700] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-08T19:17:58.679396] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:17:59.217601] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-08T19:17:59.566885] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T19:18:00.017544] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-08T19:18:00.119774] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T19:18:00.817581] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-08T19:18:01.070011] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T19:18:01.617559] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-08T19:18:01.865960] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T19:18:02.417557] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-08T19:18:02.657592] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T19:18:03.217551] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-08T19:18:03.432520] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T19:18:03.435200] [INFO ] [REMOTE ] GVA: Full fetch complete (48485 records). [2025-10-08T19:18:03.435301] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-08T19:18:03.827772] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-08T19:18:03.827866] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-08T19:18:03.828675] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-08T19:18:03.828744] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-08T19:18:03.829832] [DEBUG] [LOCAL ] GVA: Trimmed 48485 records to 32831 (keeping 200 days of data) [2025-10-08T19:18:04.017692] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-08T19:18:04.041846] [DEBUG] [LOCAL ] GVA: Primary data saved (32831 records). [2025-10-08T19:18:04.041993] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-08T19:18:04.042096] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GVA took 32.6s. Estimated remaining: 3h 14m 31s. Rate: 7.1 symbols/min [2025-10-08T19:18:04.234584] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:04.249186] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:18:04.304471] [DEBUG] [LOCAL ] GXO: Loaded 47159 existing records from primary storage. [2025-10-08T19:18:04.304961] [INFO ] [MAIN ] GXO: Loaded 47159 existing records. [2025-10-08T19:18:04.540671] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:04.540959] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-08T19:18:04.541018] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-08T19:18:04.542247] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-08T19:18:04.542308] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-08T19:18:04.822761] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-08T19:18:05.011129] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:05.197400] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:18:05.617596] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-08T19:18:06.417520] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-08T19:18:06.530439] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T19:18:06.753254] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T19:18:06.755914] [INFO ] [REMOTE ] GWH: Full fetch complete (21997 records). [2025-10-08T19:18:06.756005] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-08T19:18:07.124381] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-08T19:18:07.124460] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-08T19:18:07.124942] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-08T19:18:07.125003] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-08T19:18:07.125588] [DEBUG] [LOCAL ] GWH: Trimmed 21997 records to 17046 (keeping 200 days of data) [2025-10-08T19:18:07.221057] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-08T19:18:07.224907] [DEBUG] [LOCAL ] GWH: Primary data saved (17046 records). [2025-10-08T19:18:07.226283] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-08T19:18:07.226430] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GWH took 34.2s. Estimated remaining: 3h 14m 16s. Rate: 7.1 symbols/min [2025-10-08T19:18:07.401086] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:07.413536] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:18:07.419940] [DEBUG] [LOCAL ] GYLD: Loaded 1538 existing records from primary storage. [2025-10-08T19:18:07.420110] [INFO ] [MAIN ] GYLD: Loaded 1538 existing records. [2025-10-08T19:18:07.592361] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:07.592565] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-08T19:18:07.592629] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-08T19:18:07.592871] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-08T19:18:07.592929] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-08T19:18:07.950798] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:08.017513] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-08T19:18:08.312449] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-08T19:18:08.735309] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T19:18:08.817514] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-08T19:18:09.617597] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-08T19:18:10.417534] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-08T19:18:10.464360] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T19:18:10.545929] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:18:10.702077] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-08T19:18:11.217579] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-08T19:18:12.017550] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-08T19:18:12.380760] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-08T19:18:12.629586] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:18:12.817535] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-08T19:18:13.617560] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-08T19:18:13.896439] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T19:18:14.417565] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-08T19:18:14.497374] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:18:14.845807] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-08T19:18:15.217590] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-08T19:18:16.017629] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-08T19:18:16.791785] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T19:18:16.817528] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-08T19:18:16.926328] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:18:17.594904] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T19:18:17.597221] [INFO ] [REMOTE ] GWW: Full fetch complete (29145 records). [2025-10-08T19:18:17.597323] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-08T19:18:17.627675] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-08T19:18:17.993756] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-08T19:18:17.993846] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-08T19:18:17.994384] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-08T19:18:17.994424] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-08T19:18:17.995146] [DEBUG] [LOCAL ] GWW: Trimmed 29145 records to 19426 (keeping 200 days of data) [2025-10-08T19:18:18.120486] [DEBUG] [LOCAL ] GWW: Primary data saved (19426 records). [2025-10-08T19:18:18.120611] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-08T19:18:18.120737] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWW took 32.8s. Estimated remaining: 3h 14m 11s. Rate: 7.1 symbols/min [2025-10-08T19:18:18.288046] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:18.334320] [DEBUG] [LOCAL ] H: Loaded 44572 existing records from primary storage. [2025-10-08T19:18:18.334629] [INFO ] [MAIN ] H: Loaded 44572 existing records. [2025-10-08T19:18:18.423221] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-08T19:18:18.513074] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:18.513263] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-08T19:18:18.513308] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-08T19:18:18.514999] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-08T19:18:18.515060] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-08T19:18:18.864562] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:19.217616] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-08T19:18:19.392910] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T19:18:19.955452] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T19:18:20.017562] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-08T19:18:20.407367] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T19:18:20.817613] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-08T19:18:21.617519] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-08T19:18:21.866999] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:18:21.904198] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T19:18:22.092104] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-08T19:18:22.417554] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-08T19:18:23.217638] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-08T19:18:23.539550] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T19:18:23.943288] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:18:24.017582] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-08T19:18:24.817568] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-08T19:18:25.620349] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-08T19:18:25.628172] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T19:18:26.072597] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T19:18:26.102967] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T19:18:26.417570] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-08T19:18:27.217538] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-08T19:18:27.689125] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T19:18:27.900275] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T19:18:27.903244] [INFO ] [REMOTE ] GWRE: Full fetch complete (60580 records). [2025-10-08T19:18:27.903348] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-08T19:18:28.022811] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-08T19:18:28.280325] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-08T19:18:28.280408] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-08T19:18:28.281206] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-08T19:18:28.281268] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-08T19:18:28.282486] [DEBUG] [LOCAL ] GWRE: Trimmed 60580 records to 40142 (keeping 200 days of data) [2025-10-08T19:18:28.521538] [DEBUG] [LOCAL ] GWRE: Primary data saved (40142 records). [2025-10-08T19:18:28.521706] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-08T19:18:28.521803] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWRE took 49.6s. Estimated remaining: 3h 14m 5s. Rate: 7.1 symbols/min [2025-10-08T19:18:28.689912] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:28.725766] [DEBUG] [LOCAL ] HAE: Loaded 39434 existing records from primary storage. [2025-10-08T19:18:28.726059] [INFO ] [MAIN ] HAE: Loaded 39434 existing records. [2025-10-08T19:18:28.822814] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-08T19:18:28.905191] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:28.905398] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-08T19:18:28.905444] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-08T19:18:28.906544] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-08T19:18:28.906604] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-08T19:18:29.244289] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-08T19:18:29.268342] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:29.617541] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-08T19:18:29.712992] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:18:30.417567] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-08T19:18:31.155304] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:18:31.217492] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-08T19:18:31.934316] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:18:32.017598] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-08T19:18:32.817544] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-08T19:18:32.897147] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:18:33.185939] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:18:33.617559] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-08T19:18:34.157764] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:18:34.417571] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-08T19:18:34.882292] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-08T19:18:34.971138] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:18:35.217548] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-08T19:18:35.944688] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T19:18:35.945399] [INFO ] [REMOTE ] GYLD: Full fetch complete (2072 records). [2025-10-08T19:18:35.945468] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-08T19:18:36.022670] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-08T19:18:36.305706] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-08T19:18:36.305796] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-08T19:18:36.305897] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-08T19:18:36.305937] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-08T19:18:36.306275] [DEBUG] [LOCAL ] GYLD: Trimmed 2072 records to 1535 (keeping 200 days of data) [2025-10-08T19:18:36.316006] [DEBUG] [LOCAL ] GYLD: Primary data saved (1535 records). [2025-10-08T19:18:36.316085] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-08T19:18:36.316166] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GYLD took 29.1s. Estimated remaining: 3h 13m 56s. Rate: 7.1 symbols/min [2025-10-08T19:18:36.486023] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:36.527834] [DEBUG] [LOCAL ] HAFN: Loaded 43197 existing records from primary storage. [2025-10-08T19:18:36.528140] [INFO ] [MAIN ] HAFN: Loaded 43197 existing records. [2025-10-08T19:18:36.709512] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:36.709829] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-08T19:18:36.709889] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-08T19:18:36.711164] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-08T19:18:36.711226] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-08T19:18:36.822711] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-08T19:18:37.080836] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:37.572755] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T19:18:37.617556] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-08T19:18:38.371422] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:18:38.417499] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-08T19:18:39.158625] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T19:18:39.217531] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-08T19:18:40.017576] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-08T19:18:40.051667] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T19:18:40.817569] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-08T19:18:41.005383] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T19:18:41.617564] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-08T19:18:41.648406] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T19:18:41.948588] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T19:18:42.417554] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-08T19:18:43.110574] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:18:43.217544] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-08T19:18:43.817694] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T19:18:44.017563] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-08T19:18:44.817534] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-08T19:18:44.949134] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T19:18:45.548758] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T19:18:45.553316] [INFO ] [REMOTE ] GXO: Full fetch complete (69797 records). [2025-10-08T19:18:45.553694] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-08T19:18:45.622845] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-08T19:18:45.944465] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-08T19:18:45.944544] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-08T19:18:45.945429] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-08T19:18:45.945493] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-08T19:18:45.946858] [DEBUG] [LOCAL ] GXO: Trimmed 69797 records to 47078 (keeping 200 days of data) [2025-10-08T19:18:46.217490] [DEBUG] [LOCAL ] GXO: Primary data saved (47078 records). [2025-10-08T19:18:46.217630] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-08T19:18:46.217757] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GXO took 42.2s. Estimated remaining: 3h 13m 49s. Rate: 7.1 symbols/min [2025-10-08T19:18:46.392426] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:46.419966] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-08T19:18:46.444869] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:18:46.470381] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-08T19:18:46.470747] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-08T19:18:46.647092] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:46.647336] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-08T19:18:46.647382] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-08T19:18:46.648966] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-08T19:18:46.649028] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-08T19:18:46.994578] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:47.217541] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-08T19:18:47.244971] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:18:47.903360] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:18:48.017579] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-08T19:18:48.642779] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T19:18:48.817559] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-08T19:18:49.066615] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T19:18:49.617551] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-08T19:18:50.417633] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-08T19:18:50.548270] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:18:51.217584] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-08T19:18:51.254542] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:18:51.641703] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T19:18:52.017559] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-08T19:18:52.572469] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:18:52.817549] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-08T19:18:53.461440] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:18:53.464905] [INFO ] [REMOTE ] H: Full fetch complete (62565 records). [2025-10-08T19:18:53.465001] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-08T19:18:53.626385] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-08T19:18:53.853709] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-08T19:18:53.853795] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-08T19:18:53.854594] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-08T19:18:53.854635] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-08T19:18:53.855956] [DEBUG] [LOCAL ] H: Trimmed 62565 records to 44514 (keeping 200 days of data) [2025-10-08T19:18:54.136704] [DEBUG] [LOCAL ] H: Primary data saved (44514 records). [2025-10-08T19:18:54.136850] [INFO ] [MAIN ] H: Full history saved. [2025-10-08T19:18:54.137928] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. H took 36.0s. Estimated remaining: 3h 13m 40s. Rate: 7.1 symbols/min [2025-10-08T19:18:54.336674] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:18:54.375334] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:54.424866] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-08T19:18:54.429774] [DEBUG] [LOCAL ] HASI: Loaded 47253 existing records from primary storage. [2025-10-08T19:18:54.430064] [INFO ] [MAIN ] HASI: Loaded 47253 existing records. [2025-10-08T19:18:54.607009] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:54.607231] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-08T19:18:54.607277] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-08T19:18:54.608693] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-08T19:18:54.608757] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-08T19:18:54.954929] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:55.217558] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-08T19:18:55.529167] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T19:18:56.022677] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-08T19:18:56.039272] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:18:56.439264] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T19:18:56.817597] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-08T19:18:57.617569] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-08T19:18:58.098758] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-08T19:18:58.249869] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T19:18:58.417560] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-08T19:18:58.892816] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:18:59.217521] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-08T19:18:59.981528] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T19:19:00.017507] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-08T19:19:00.804455] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:19:00.817491] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-08T19:19:01.617614] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-08T19:19:02.132838] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-08T19:19:02.198990] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T19:19:02.417559] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-08T19:19:03.034606] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T19:19:03.217621] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-08T19:19:04.017541] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-08T19:19:04.616663] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T19:19:04.817693] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-08T19:19:04.829874] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T19:19:05.617522] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-08T19:19:05.723506] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T19:19:06.417560] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-08T19:19:06.575982] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:19:06.684397] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T19:19:07.217577] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-08T19:19:07.713994] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T19:19:07.717282] [INFO ] [REMOTE ] HAFN: Full fetch complete (65245 records). [2025-10-08T19:19:07.717401] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-08T19:19:08.020311] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-08T19:19:08.114916] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-08T19:19:08.115000] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-08T19:19:08.115900] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-08T19:19:08.115966] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-08T19:19:08.117255] [DEBUG] [LOCAL ] HAFN: Trimmed 65245 records to 43141 (keeping 200 days of data) [2025-10-08T19:19:08.377133] [DEBUG] [LOCAL ] HAFN: Primary data saved (43141 records). [2025-10-08T19:19:08.377540] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-08T19:19:08.377667] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. HAFN took 32.1s. Estimated remaining: 3h 13m 40s. Rate: 7.1 symbols/min [2025-10-08T19:19:08.544775] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:08.588938] [DEBUG] [LOCAL ] HAYW: Loaded 48748 existing records from primary storage. [2025-10-08T19:19:08.589249] [INFO ] [MAIN ] HAYW: Loaded 48748 existing records. [2025-10-08T19:19:08.772779] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:08.773103] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-08T19:19:08.773173] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-08T19:19:08.774893] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-08T19:19:08.774980] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-08T19:19:08.826923] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-08T19:19:09.240826] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:09.287971] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-08T19:19:09.617572] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-08T19:19:09.796266] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T19:19:10.120059] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T19:19:10.124228] [INFO ] [REMOTE ] HAE: Full fetch complete (58547 records). [2025-10-08T19:19:10.124347] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-08T19:19:10.422777] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-08T19:19:10.500934] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-08T19:19:10.501144] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-08T19:19:10.501993] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-08T19:19:10.502056] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-08T19:19:10.503369] [DEBUG] [LOCAL ] HAE: Trimmed 58547 records to 39439 (keeping 200 days of data) [2025-10-08T19:19:10.744921] [DEBUG] [LOCAL ] HAE: Primary data saved (39439 records). [2025-10-08T19:19:10.745108] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-08T19:19:10.745212] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 42.2s. Estimated remaining: 3h 13m 23s. Rate: 7.1 symbols/min [2025-10-08T19:19:10.918750] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:10.927402] [DEBUG] [LOCAL ] HBB: Loaded 6499 existing records from primary storage. [2025-10-08T19:19:10.927686] [INFO ] [MAIN ] HBB: Loaded 6499 existing records. [2025-10-08T19:19:11.139957] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:11.140427] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-08T19:19:11.140550] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-08T19:19:11.140957] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-08T19:19:11.141019] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-08T19:19:11.217544] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-08T19:19:11.515713] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:11.547630] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T19:19:11.913985] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T19:19:12.017553] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-08T19:19:12.465185] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:19:12.555097] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T19:19:12.817588] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-08T19:19:13.617592] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-08T19:19:14.417596] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-08T19:19:14.879026] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T19:19:15.169588] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:19:15.217589] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-08T19:19:15.826087] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T19:19:16.017588] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-08T19:19:16.817530] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-08T19:19:17.038292] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T19:19:17.043322] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-08T19:19:17.043522] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-08T19:19:17.501020] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-08T19:19:17.501148] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-08T19:19:17.502229] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-08T19:19:17.502417] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-08T19:19:17.504264] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-10-08T19:19:17.621961] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-08T19:19:17.636983] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:19:17.888519] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-08T19:19:17.888845] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-08T19:19:17.888979] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAL took 31.7s. Estimated remaining: 3h 13m 13s. Rate: 7.1 symbols/min [2025-10-08T19:19:18.068726] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:18.101712] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:19:18.118679] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T19:19:18.160283] [DEBUG] [LOCAL ] HBI: Loaded 52991 existing records from primary storage. [2025-10-08T19:19:18.160710] [INFO ] [MAIN ] HBI: Loaded 52991 existing records. [2025-10-08T19:19:18.340208] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:18.340460] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-08T19:19:18.340508] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-08T19:19:18.341844] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-08T19:19:18.341905] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-08T19:19:18.422746] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-08T19:19:18.699513] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:19.071178] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T19:19:19.217572] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-08T19:19:19.953293] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:19:20.017580] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-08T19:19:20.817634] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-08T19:19:21.392497] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:19:21.617526] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-08T19:19:22.419328] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-08T19:19:22.422880] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T19:19:22.521532] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T19:19:23.217605] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-08T19:19:24.017551] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-08T19:19:24.063312] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T19:19:24.610226] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T19:19:24.768904] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:19:24.817563] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-08T19:19:25.617591] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-08T19:19:26.417522] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-08T19:19:26.485954] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-08T19:19:26.489715] [INFO ] [REMOTE ] HASI: Full fetch complete (68049 records). [2025-10-08T19:19:26.489856] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-08T19:19:26.896733] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-08T19:19:26.896934] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-08T19:19:26.897986] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-08T19:19:26.898065] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-08T19:19:26.900279] [DEBUG] [LOCAL ] HASI: Trimmed 68049 records to 47306 (keeping 200 days of data) [2025-10-08T19:19:27.042862] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T19:19:27.048369] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:19:27.223238] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-08T19:19:27.248989] [DEBUG] [LOCAL ] HASI: Primary data saved (47306 records). [2025-10-08T19:19:27.249136] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-08T19:19:27.249237] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HASI took 33.1s. Estimated remaining: 3h 13m 6s. Rate: 7.1 symbols/min [2025-10-08T19:19:27.416797] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:27.467322] [DEBUG] [LOCAL ] HBM: Loaded 52924 existing records from primary storage. [2025-10-08T19:19:27.467722] [INFO ] [MAIN ] HBM: Loaded 52924 existing records. [2025-10-08T19:19:27.659721] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:27.659975] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-08T19:19:27.660022] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-08T19:19:27.661427] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-08T19:19:27.661490] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-08T19:19:27.949499] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T19:19:28.022935] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-08T19:19:28.022870] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:28.817607] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-08T19:19:29.571668] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T19:19:29.617534] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-08T19:19:30.417521] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-08T19:19:30.543804] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T19:19:31.023182] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T19:19:31.217511] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-08T19:19:31.277239] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T19:19:32.017552] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-08T19:19:32.817514] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-08T19:19:32.996124] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T19:19:33.617545] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-08T19:19:33.681398] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T19:19:34.417561] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-08T19:19:35.225433] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-08T19:19:35.249619] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T19:19:35.489445] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-08T19:19:35.808214] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T19:19:36.017561] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-08T19:19:36.396446] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T19:19:36.605850] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T19:19:36.606761] [INFO ] [REMOTE ] HBB: Full fetch complete (9444 records). [2025-10-08T19:19:36.606833] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-08T19:19:36.823617] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-08T19:19:36.988605] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-08T19:19:36.988715] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-08T19:19:36.988976] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-08T19:19:36.989016] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-08T19:19:36.989435] [DEBUG] [LOCAL ] HBB: Trimmed 9444 records to 6485 (keeping 200 days of data) [2025-10-08T19:19:37.031011] [DEBUG] [LOCAL ] HBB: Primary data saved (6485 records). [2025-10-08T19:19:37.031155] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-08T19:19:37.031245] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HBB took 26.3s. Estimated remaining: 3h 12m 59s. Rate: 7.1 symbols/min [2025-10-08T19:19:37.199247] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:37.245374] [DEBUG] [LOCAL ] HCA: Loaded 46862 existing records from primary storage. [2025-10-08T19:19:37.245730] [INFO ] [MAIN ] HCA: Loaded 46862 existing records. [2025-10-08T19:19:37.435047] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:37.435355] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-08T19:19:37.435421] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-08T19:19:37.435695] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-08T19:19:37.435752] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-08T19:19:37.624110] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-08T19:19:37.807163] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:38.391995] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T19:19:38.417507] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-08T19:19:39.217546] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-08T19:19:39.278855] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T19:19:39.282508] [INFO ] [REMOTE ] HAYW: Full fetch complete (70783 records). [2025-10-08T19:19:39.282625] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-08T19:19:39.687003] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-08T19:19:39.687189] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-08T19:19:39.688549] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-08T19:19:39.688708] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-08T19:19:39.691235] [DEBUG] [LOCAL ] HAYW: Trimmed 70783 records to 48747 (keeping 200 days of data) [2025-10-08T19:19:39.991527] [DEBUG] [LOCAL ] HAYW: Primary data saved (48747 records). [2025-10-08T19:19:39.991709] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-08T19:19:39.991851] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HAYW took 31.6s. Estimated remaining: 3h 12m 43s. Rate: 7.1 symbols/min [2025-10-08T19:19:40.029928] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-08T19:19:40.186805] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:40.213374] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T19:19:40.264639] [DEBUG] [LOCAL ] HCC: Loaded 45348 existing records from primary storage. [2025-10-08T19:19:40.265014] [INFO ] [MAIN ] HCC: Loaded 45348 existing records. [2025-10-08T19:19:40.439426] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:40.439728] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-08T19:19:40.439787] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-08T19:19:40.440510] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-08T19:19:40.440568] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-08T19:19:40.829101] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-08T19:19:40.835517] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:40.908168] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T19:19:41.617564] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-08T19:19:41.743372] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:19:42.417580] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-08T19:19:42.622535] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:19:43.076156] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:19:43.217584] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-08T19:19:43.890729] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T19:19:44.017581] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-08T19:19:44.464790] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T19:19:44.817577] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-08T19:19:45.404591] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T19:19:45.617525] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-08T19:19:46.407070] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:19:46.417484] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-08T19:19:47.121180] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:19:47.217530] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-08T19:19:47.600871] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:19:48.017564] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-08T19:19:48.817525] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-08T19:19:49.039158] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T19:19:49.394255] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:19:49.617548] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-08T19:19:50.132694] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T19:19:50.417609] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-08T19:19:51.217531] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-08T19:19:51.472471] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:19:52.017719] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-08T19:19:52.100151] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:19:52.712898] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:19:52.817548] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-08T19:19:53.617573] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-08T19:19:53.730781] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:19:54.268247] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T19:19:54.417607] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-08T19:19:55.217575] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-08T19:19:55.260228] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T19:19:56.017519] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-08T19:19:56.137405] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T19:19:56.817544] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-08T19:19:56.897014] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:19:57.400476] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T19:19:57.617562] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-08T19:19:58.329774] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T19:19:58.417551] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-08T19:19:59.217591] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-08T19:19:59.285625] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:20:00.017538] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-08T19:20:00.273609] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T19:20:00.819700] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-08T19:20:00.825805] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:20:01.617574] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-08T19:20:02.163334] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T19:20:02.417521] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-08T19:20:02.450243] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T19:20:03.222687] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-08T19:20:03.242400] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:20:04.017520] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-08T19:20:04.243373] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T19:20:04.569888] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T19:20:04.573864] [INFO ] [REMOTE ] HCC: Full fetch complete (64622 records). [2025-10-08T19:20:04.573981] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-08T19:20:04.827137] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-08T19:20:04.969136] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-08T19:20:04.969223] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-08T19:20:04.970081] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-08T19:20:04.970145] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-08T19:20:04.971485] [DEBUG] [LOCAL ] HCC: Trimmed 64622 records to 45290 (keeping 200 days of data) [2025-10-08T19:20:05.250980] [DEBUG] [LOCAL ] HCC: Primary data saved (45290 records). [2025-10-08T19:20:05.251136] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-08T19:20:05.251236] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HCC took 25.3s. Estimated remaining: 3h 12m 58s. Rate: 7.1 symbols/min [2025-10-08T19:20:05.617516] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-08T19:20:05.766894] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T19:20:06.417573] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-08T19:20:06.816588] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-08T19:20:06.986537] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T19:20:07.217612] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-08T19:20:07.676602] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:20:08.017587] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-08T19:20:08.822735] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-08T19:20:08.837116] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T19:20:08.844249] [INFO ] [REMOTE ] HBI: Full fetch complete (76878 records). [2025-10-08T19:20:08.844526] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-08T19:20:09.467258] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:20:09.471150] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-08T19:20:09.474230] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-08T19:20:09.475755] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-08T19:20:09.475837] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-08T19:20:09.476734] [INFO ] [REMOTE ] HCA: Full fetch complete (68729 records). [2025-10-08T19:20:09.476927] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-08T19:20:09.483062] [DEBUG] [LOCAL ] HBI: Trimmed 76878 records to 52987 (keeping 200 days of data) [2025-10-08T19:20:09.988315] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-08T19:20:09.991389] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-08T19:20:09.993570] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-08T19:20:09.995865] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-08T19:20:10.011486] [DEBUG] [LOCAL ] HCA: Trimmed 68729 records to 46889 (keeping 200 days of data) [2025-10-08T19:20:10.305675] [DEBUG] [LOCAL ] HBI: Primary data saved (52987 records). [2025-10-08T19:20:10.306769] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-08T19:20:10.307357] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 52.4s. Estimated remaining: 3h 12m 45s. Rate: 7.1 symbols/min [2025-10-08T19:20:10.505937] [DEBUG] [LOCAL ] HCA: Primary data saved (46889 records). [2025-10-08T19:20:10.506273] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-08T19:20:10.506429] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HCA took 33.5s. Estimated remaining: 3h 12m 26s. Rate: 7.1 symbols/min [2025-10-08T19:20:10.669342] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T19:20:10.674081] [INFO ] [REMOTE ] HBM: Full fetch complete (76335 records). [2025-10-08T19:20:10.674262] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-08T19:20:11.077028] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-08T19:20:11.077112] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-08T19:20:11.078078] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-08T19:20:11.078143] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-08T19:20:11.079671] [DEBUG] [LOCAL ] HBM: Trimmed 76335 records to 52928 (keeping 200 days of data) [2025-10-08T19:20:11.398704] [DEBUG] [LOCAL ] HBM: Primary data saved (52928 records). [2025-10-08T19:20:11.398863] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-08T19:20:11.398951] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HBM took 44.1s. Estimated remaining: 3h 12m 7s. Rate: 7.1 symbols/min [2025-10-08T19:20:12.044000] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:12.069089] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:12.112833] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-08T19:20:12.112979] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-08T19:20:12.113938] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:12.147166] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:12.147328] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-08T19:20:12.148023] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-08T19:20:12.148092] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-08T19:20:12.148128] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-08T19:20:12.289669] [DEBUG] [LOCAL ] HCI: Loaded 14035 existing records from primary storage. [2025-10-08T19:20:12.312485] [INFO ] [MAIN ] HCI: Loaded 14035 existing records. [2025-10-08T19:20:12.704037] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-08T19:20:12.738283] [INFO ] [MAIN ] HD: Loaded 53492 existing records. [2025-10-08T19:20:12.761588] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:12.733550] [DEBUG] [LOCAL ] HDB: Loaded 51936 existing records from primary storage. [2025-10-08T19:20:12.765211] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:12.770988] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-08T19:20:12.789708] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-08T19:20:12.790974] [INFO ] [MAIN ] HDB: Loaded 51936 existing records. [2025-10-08T19:20:12.790882] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-08T19:20:12.913323] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-08T19:20:12.936595] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-08T19:20:13.207834] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:13.269096] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-08T19:20:13.258310] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:13.273586] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-08T19:20:13.274844] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-08T19:20:13.273895] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-08T19:20:13.275172] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-08T19:20:13.290875] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-08T19:20:13.314407] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-08T19:20:13.387110] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-08T19:20:13.410544] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-08T19:20:13.410491] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-08T19:20:13.656829] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-08T19:20:13.763606] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-08T19:20:13.767034] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:13.834435] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-08T19:20:14.101390] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T19:20:14.122235] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-08T19:20:14.240253] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:14.263579] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-08T19:20:14.292866] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:14.417525] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-08T19:20:14.545494] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T19:20:14.995128] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T19:20:15.217604] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-08T19:20:15.637447] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T19:20:15.866823] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:20:16.017552] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-08T19:20:16.461148] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-08T19:20:16.813584] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:20:16.817488] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-08T19:20:17.617535] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-08T19:20:17.852336] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-08T19:20:18.417528] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-08T19:20:18.863187] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T19:20:19.217574] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-08T19:20:19.309536] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T19:20:19.460107] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-08T19:20:20.017693] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-08T19:20:20.286629] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-08T19:20:20.817544] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-08T19:20:21.069263] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-08T19:20:21.617565] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-08T19:20:21.859856] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-08T19:20:22.417548] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-08T19:20:23.217601] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-08T19:20:23.965568] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:20:24.017575] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-08T19:20:24.817550] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-08T19:20:25.256853] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T19:20:25.260937] [INFO ] [REMOTE ] HCXY: Full fetch complete (536 records). [2025-10-08T19:20:25.261155] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-08T19:20:25.269096] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T19:20:25.484142] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-08T19:20:25.487407] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:20:25.487734] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:20:25.488242] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-08T19:20:25.489606] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-08T19:20:25.489856] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-08T19:20:25.500189] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-08T19:20:25.500606] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-08T19:20:25.500738] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 14.1s. Estimated remaining: 3h 12m 6s. Rate: 7.1 symbols/min [2025-10-08T19:20:25.622741] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-08T19:20:25.667552] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:25.714951] [DEBUG] [LOCAL ] HE: Loaded 48998 existing records from primary storage. [2025-10-08T19:20:25.715269] [INFO ] [MAIN ] HE: Loaded 48998 existing records. [2025-10-08T19:20:25.890126] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:25.890373] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-08T19:20:25.890420] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-08T19:20:25.890626] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-08T19:20:25.890718] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-08T19:20:26.242793] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:26.374521] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:20:26.417536] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-08T19:20:27.217551] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-08T19:20:28.017525] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-08T19:20:28.300864] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T19:20:28.494856] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-08T19:20:28.817553] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-08T19:20:29.617568] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-08T19:20:29.659307] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T19:20:29.679029] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T19:20:30.417565] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-08T19:20:31.217568] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-08T19:20:31.495032] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T19:20:32.017543] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-08T19:20:32.328436] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T19:20:32.817568] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-08T19:20:33.029600] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T19:20:33.512994] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:20:33.617521] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-08T19:20:34.417523] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-08T19:20:34.590067] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:20:35.066406] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T19:20:35.217546] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-08T19:20:35.538012] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-08T19:20:36.017518] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-08T19:20:36.177829] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:20:36.817599] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-08T19:20:37.466020] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:20:37.617519] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-08T19:20:37.810871] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T19:20:38.417602] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-08T19:20:39.217527] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-08T19:20:39.548938] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T19:20:39.826279] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T19:20:39.913169] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:20:40.017559] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-08T19:20:40.817632] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-08T19:20:41.617541] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-08T19:20:42.306928] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-08T19:20:42.396865] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T19:20:42.417519] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-08T19:20:43.000778] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:20:43.217537] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-08T19:20:44.017612] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-08T19:20:44.315333] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T19:20:44.460058] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T19:20:44.817519] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-08T19:20:44.880011] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T19:20:44.881865] [INFO ] [REMOTE ] HCI: Full fetch complete (19519 records). [2025-10-08T19:20:44.881941] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-08T19:20:45.284974] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-08T19:20:45.285073] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-08T19:20:45.285502] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-08T19:20:45.285542] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-08T19:20:45.286109] [DEBUG] [LOCAL ] HCI: Trimmed 19519 records to 14077 (keeping 200 days of data) [2025-10-08T19:20:45.374303] [DEBUG] [LOCAL ] HCI: Primary data saved (14077 records). [2025-10-08T19:20:45.374442] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-08T19:20:45.374524] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 34.0s. Estimated remaining: 3h 12m 13s. Rate: 7.1 symbols/min [2025-10-08T19:20:45.553512] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:45.587084] [DEBUG] [LOCAL ] HEI: Loaded 31750 existing records from primary storage. [2025-10-08T19:20:45.587373] [INFO ] [MAIN ] HEI: Loaded 31750 existing records. [2025-10-08T19:20:45.622707] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-08T19:20:45.776119] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:45.776381] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-08T19:20:45.776430] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-08T19:20:45.776687] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-08T19:20:45.776749] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-08T19:20:46.155036] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:46.417521] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-08T19:20:46.914192] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T19:20:46.970286] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:20:47.217607] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-08T19:20:47.980661] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T19:20:48.017540] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-08T19:20:48.549805] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T19:20:48.817638] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-08T19:20:49.364562] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T19:20:49.617566] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-08T19:20:50.417514] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-08T19:20:50.759809] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T19:20:50.764146] [INFO ] [REMOTE ] HD: Full fetch complete (77447 records). [2025-10-08T19:20:50.764282] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-08T19:20:51.162549] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-08T19:20:51.162772] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-08T19:20:51.163721] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-08T19:20:51.163849] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-08T19:20:51.165528] [DEBUG] [LOCAL ] HD: Trimmed 77447 records to 53492 (keeping 200 days of data) [2025-10-08T19:20:51.275138] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-08T19:20:51.318116] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T19:20:51.574615] [DEBUG] [LOCAL ] HD: Primary data saved (53492 records). [2025-10-08T19:20:51.574783] [INFO ] [MAIN ] HD: Full history saved. [2025-10-08T19:20:51.574872] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HD took 40.2s. Estimated remaining: 3h 12m 2s. Rate: 7.1 symbols/min [2025-10-08T19:20:51.751823] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:51.761405] [DEBUG] [LOCAL ] HEQ: Loaded 6524 existing records from primary storage. [2025-10-08T19:20:51.761694] [INFO ] [MAIN ] HEQ: Loaded 6524 existing records. [2025-10-08T19:20:51.992165] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:51.992455] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-08T19:20:51.992854] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-08T19:20:51.995455] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-08T19:20:51.995377] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:20:51.995571] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-08T19:20:52.029312] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-08T19:20:52.406863] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:52.625505] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T19:20:52.817526] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-08T19:20:53.612198] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:20:53.621882] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-08T19:20:54.237264] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T19:20:54.303461] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T19:20:54.417555] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-08T19:20:55.217543] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-08T19:20:55.859893] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:20:56.017533] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-08T19:20:56.729305] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:20:56.817548] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-08T19:20:57.617567] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-08T19:20:57.745698] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:20:57.749698] [INFO ] [REMOTE ] HDB: Full fetch complete (75320 records). [2025-10-08T19:20:57.749815] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-08T19:20:58.135041] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-08T19:20:58.135125] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-08T19:20:58.136122] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-08T19:20:58.136185] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-08T19:20:58.137683] [DEBUG] [LOCAL ] HDB: Trimmed 75320 records to 51940 (keeping 200 days of data) [2025-10-08T19:20:58.384244] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T19:20:58.417523] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-08T19:20:58.498969] [DEBUG] [LOCAL ] HDB: Primary data saved (51940 records). [2025-10-08T19:20:58.499112] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-08T19:20:58.500163] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HDB took 47.0s. Estimated remaining: 3h 11m 51s. Rate: 7.1 symbols/min [2025-10-08T19:20:58.670297] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:58.715989] [DEBUG] [LOCAL ] HESM: Loaded 48284 existing records from primary storage. [2025-10-08T19:20:58.716303] [INFO ] [MAIN ] HESM: Loaded 48284 existing records. [2025-10-08T19:20:58.901158] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:58.901537] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-08T19:20:58.901639] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-08T19:20:58.902106] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-08T19:20:58.902178] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-08T19:20:59.187404] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:20:59.230136] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-08T19:20:59.315240] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:59.310886] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:21:00.017565] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-08T19:21:00.817600] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-08T19:21:01.273780] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-08T19:21:01.284392] [INFO ] [REMOTE ] HE: Full fetch complete (72241 records). [2025-10-08T19:21:01.284764] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-08T19:21:01.623467] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-08T19:21:01.913441] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T19:21:01.918334] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-08T19:21:01.918763] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-08T19:21:01.927366] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-08T19:21:01.927934] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-08T19:21:01.930725] [DEBUG] [LOCAL ] HE: Trimmed 72241 records to 48999 (keeping 200 days of data) [2025-10-08T19:21:02.074977] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T19:21:02.188304] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T19:21:02.282562] [DEBUG] [LOCAL ] HE: Primary data saved (48999 records). [2025-10-08T19:21:02.282773] [INFO ] [MAIN ] HE: Full history saved. [2025-10-08T19:21:02.282873] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HE took 36.8s. Estimated remaining: 3h 11m 37s. Rate: 7.1 symbols/min [2025-10-08T19:21:02.422727] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-08T19:21:02.471438] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:02.471733] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-08T19:21:02.471790] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-08T19:21:02.471947] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-08T19:21:02.471992] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-08T19:21:02.472033] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-08T19:21:02.472065] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-08T19:21:02.888976] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:03.105209] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T19:21:03.217600] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-08T19:21:03.576164] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T19:21:04.017562] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-08T19:21:04.346929] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-08T19:21:04.817584] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-08T19:21:05.617585] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-08T19:21:05.881400] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-08T19:21:06.189141] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:21:06.417590] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-08T19:21:07.217575] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-08T19:21:07.859833] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T19:21:08.017627] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-08T19:21:08.268103] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-08T19:21:08.761701] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T19:21:08.817579] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-08T19:21:09.617568] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-08T19:21:09.913047] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T19:21:10.348933] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T19:21:10.417527] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-08T19:21:11.212348] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T19:21:11.217481] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-08T19:21:11.893512] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T19:21:12.017538] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-08T19:21:12.817612] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-08T19:21:13.522603] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T19:21:13.574895] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T19:21:13.617580] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-08T19:21:13.876120] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-08T19:21:14.417616] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-08T19:21:14.695840] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-08T19:21:15.217613] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-08T19:21:16.017575] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-08T19:21:16.799702] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T19:21:16.817496] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-08T19:21:17.235291] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T19:21:17.237937] [INFO ] [REMOTE ] HEI: Full fetch complete (48169 records). [2025-10-08T19:21:17.238057] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-08T19:21:17.623169] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-08T19:21:17.625970] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-08T19:21:17.626970] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-08T19:21:17.627733] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-08T19:21:17.627796] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-08T19:21:17.629058] [DEBUG] [LOCAL ] HEI: Trimmed 48169 records to 31659 (keeping 200 days of data) [2025-10-08T19:21:17.831197] [DEBUG] [LOCAL ] HEI: Primary data saved (31659 records). [2025-10-08T19:21:17.831357] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-08T19:21:17.831444] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEI took 32.5s. Estimated remaining: 3h 11m 38s. Rate: 7.1 symbols/min [2025-10-08T19:21:17.941163] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-08T19:21:18.017529] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:18.017844] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-08T19:21:18.017939] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-08T19:21:18.018083] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-08T19:21:18.018127] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-08T19:21:18.018170] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-08T19:21:18.018201] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-08T19:21:18.410528] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:18.423024] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-08T19:21:18.442388] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T19:21:18.670278] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-08T19:21:19.217550] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-08T19:21:19.450002] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-08T19:21:20.017590] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-08T19:21:20.671949] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T19:21:20.817568] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-08T19:21:21.060295] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-08T19:21:21.617539] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-08T19:21:21.981594] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T19:21:21.982292] [INFO ] [REMOTE ] HF: Full fetch complete (446 records). [2025-10-08T19:21:21.982401] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-08T19:21:22.174355] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-08T19:21:22.174559] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:21:22.174629] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:21:22.174717] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-08T19:21:22.174783] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-08T19:21:22.174820] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-08T19:21:22.174887] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-08T19:21:22.174969] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HF took 19.9s. Estimated remaining: 3h 11m 24s. Rate: 7.1 symbols/min [2025-10-08T19:21:22.354354] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:22.375470] [DEBUG] [LOCAL ] HFRO: Loaded 17508 existing records from primary storage. [2025-10-08T19:21:22.375774] [INFO ] [MAIN ] HFRO: Loaded 17508 existing records. [2025-10-08T19:21:22.422783] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-08T19:21:22.593569] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:21:22.594087] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-08T19:21:22.594151] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-08T19:21:22.594491] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-08T19:21:22.594580] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-08T19:21:22.986497] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:22.991389] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T19:21:23.217590] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-08T19:21:23.558145] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T19:21:24.017591] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-08T19:21:24.817573] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-08T19:21:25.324235] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:21:25.617542] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-08T19:21:26.375675] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:21:26.424231] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-08T19:21:26.429797] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T19:21:26.754611] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T19:21:27.217547] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-08T19:21:28.017563] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-08T19:21:28.684692] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T19:21:28.686021] [INFO ] [REMOTE ] HEQ: Full fetch complete (9437 records). [2025-10-08T19:21:28.686095] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-08T19:21:28.819490] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-08T19:21:29.125603] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-08T19:21:29.134269] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-08T19:21:29.137491] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-08T19:21:29.137809] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-08T19:21:29.139736] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T19:21:29.149802] [DEBUG] [LOCAL ] HEQ: Trimmed 9437 records to 6596 (keeping 200 days of data) [2025-10-08T19:21:29.195751] [DEBUG] [LOCAL ] HEQ: Primary data saved (6596 records). [2025-10-08T19:21:29.195921] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-08T19:21:29.196116] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HEQ took 37.6s. Estimated remaining: 3h 11m 14s. Rate: 7.1 symbols/min [2025-10-08T19:21:29.369376] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:29.385864] [DEBUG] [LOCAL ] HGER: Loaded 14155 existing records from primary storage. [2025-10-08T19:21:29.386118] [INFO ] [MAIN ] HGER: Loaded 14155 existing records. [2025-10-08T19:21:29.561109] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:21:29.561312] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-08T19:21:29.561357] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-08T19:21:29.561561] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-08T19:21:29.561619] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-08T19:21:29.624583] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-08T19:21:29.938269] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:29.953705] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T19:21:30.097772] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T19:21:30.417559] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-08T19:21:31.217564] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-08T19:21:31.649595] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-08T19:21:32.017569] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-08T19:21:32.329684] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T19:21:32.730059] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T19:21:32.817559] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-08T19:21:33.617513] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-08T19:21:33.933154] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T19:21:33.955319] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T19:21:34.417559] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-08T19:21:35.217532] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-08T19:21:35.406436] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T19:21:36.017573] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-08T19:21:36.706508] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T19:21:36.817577] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-08T19:21:36.887986] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:21:37.055926] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-08T19:21:37.617549] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-08T19:21:37.725937] [DEBUG] [REMOTE ] HGER: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-08T19:21:37.726324] [WARN ] [REMOTE ] HGER: No data returned for month 2025-01 [2025-10-08T19:21:37.726415] [FATAL] [REMOTE ] HGER: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:21:37.726568] [FATAL] [MAIN ] HGER: Failed to fetch primary data. [2025-10-08T19:21:37.726688] [WARN ] [MAIN ] HGER: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:21:37.726784] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-08T19:21:37.726858] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-08T19:21:37.726918] [INFO ] [LOCAL ] HGER: Starting deletion of derivative data. [2025-10-08T19:21:37.727269] [DEBUG] [LOCAL ] HGER: Deleted derivative data file. [2025-10-08T19:21:37.727374] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HGER took 8.5s. Estimated remaining: 3h 11m 6s. Rate: 7.1 symbols/min [2025-10-08T19:21:37.956437] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:37.969507] [DEBUG] [LOCAL ] HGLB: Loaded 9696 existing records from primary storage. [2025-10-08T19:21:37.969791] [INFO ] [MAIN ] HGLB: Loaded 9696 existing records. [2025-10-08T19:21:38.192143] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:21:38.192441] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-08T19:21:38.192499] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-08T19:21:38.192676] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-08T19:21:38.192747] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-08T19:21:38.422700] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-08T19:21:38.560151] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:38.836286] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-08T19:21:39.217555] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-08T19:21:40.017579] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-08T19:21:40.713030] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:21:40.817525] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-08T19:21:40.829257] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T19:21:41.617548] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-08T19:21:42.386518] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T19:21:42.417537] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-08T19:21:42.525876] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T19:21:42.529929] [INFO ] [REMOTE ] HESM: Full fetch complete (69412 records). [2025-10-08T19:21:42.530108] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-08T19:21:42.943992] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T19:21:42.944381] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-08T19:21:42.947501] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-08T19:21:42.948569] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-08T19:21:42.948636] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-08T19:21:42.950815] [DEBUG] [LOCAL ] HESM: Trimmed 69412 records to 48300 (keeping 200 days of data) [2025-10-08T19:21:43.217732] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-08T19:21:43.287354] [DEBUG] [LOCAL ] HESM: Primary data saved (48300 records). [2025-10-08T19:21:43.287504] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-08T19:21:43.287605] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HESM took 44.8s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-08T19:21:43.500130] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:43.517785] [DEBUG] [LOCAL ] HGTY: Loaded 13274 existing records from primary storage. [2025-10-08T19:21:43.518066] [INFO ] [MAIN ] HGTY: Loaded 13274 existing records. [2025-10-08T19:21:43.668333] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T19:21:43.752139] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:21:43.752411] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-08T19:21:43.752508] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-08T19:21:43.752756] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-08T19:21:43.752816] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-08T19:21:44.025759] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-08T19:21:44.156690] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:44.817534] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-08T19:21:44.829880] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T19:21:45.456716] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T19:21:45.617569] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-08T19:21:46.417592] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-08T19:21:46.545867] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T19:21:47.217584] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-08T19:21:47.231684] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:21:48.005496] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T19:21:48.017504] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-08T19:21:48.817546] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-08T19:21:48.882723] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T19:21:49.617582] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-08T19:21:49.789182] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T19:21:50.149378] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T19:21:50.417599] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-08T19:21:51.075270] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T19:21:51.217569] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-08T19:21:52.017570] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-08T19:21:52.286631] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T19:21:52.746313] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T19:21:52.817542] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-08T19:21:53.390996] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-08T19:21:53.617557] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-08T19:21:54.417544] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-08T19:21:54.429062] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T19:21:55.012444] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T19:21:55.217567] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-08T19:21:55.732753] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T19:21:56.017596] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-08T19:21:56.796689] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T19:21:56.817506] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-08T19:21:57.565215] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:21:57.617528] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-08T19:21:58.193754] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T19:21:58.417593] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-08T19:21:59.217575] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-08T19:21:59.489235] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T19:21:59.912059] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T19:22:00.017573] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-08T19:22:00.817562] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-08T19:22:00.917066] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T19:22:01.617550] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-08T19:22:01.941570] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T19:22:01.943751] [INFO ] [REMOTE ] HFRO: Full fetch complete (28642 records). [2025-10-08T19:22:01.943900] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-08T19:22:02.085691] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T19:22:02.337971] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-08T19:22:02.338061] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-08T19:22:02.338627] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-08T19:22:02.338712] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-08T19:22:02.340090] [DEBUG] [LOCAL ] HFRO: Trimmed 28642 records to 17481 (keeping 200 days of data) [2025-10-08T19:22:02.417967] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-08T19:22:02.450493] [DEBUG] [LOCAL ] HFRO: Primary data saved (17481 records). [2025-10-08T19:22:02.450677] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-08T19:22:02.450790] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFRO took 40.3s. Estimated remaining: 3h 10m 59s. Rate: 7.1 symbols/min [2025-10-08T19:22:02.624478] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:02.670948] [DEBUG] [LOCAL ] HGV: Loaded 46457 existing records from primary storage. [2025-10-08T19:22:02.671286] [INFO ] [MAIN ] HGV: Loaded 46457 existing records. [2025-10-08T19:22:02.849543] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:02.849824] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-08T19:22:02.849894] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-08T19:22:02.850153] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-08T19:22:02.850209] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-08T19:22:03.196100] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:03.217500] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-08T19:22:03.449992] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T19:22:04.017571] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-08T19:22:04.422571] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T19:22:04.817576] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-08T19:22:05.039167] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:22:05.040755] [INFO ] [REMOTE ] HGTY: Full fetch complete (17316 records). [2025-10-08T19:22:05.040855] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-08T19:22:05.408298] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-08T19:22:05.408384] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-08T19:22:05.408827] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-08T19:22:05.408890] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-08T19:22:05.409544] [DEBUG] [LOCAL ] HGTY: Trimmed 17316 records to 13249 (keeping 200 days of data) [2025-10-08T19:22:05.486565] [DEBUG] [LOCAL ] HGTY: Primary data saved (13249 records). [2025-10-08T19:22:05.486755] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-08T19:22:05.486857] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGTY took 22.2s. Estimated remaining: 3h 10m 44s. Rate: 7.1 symbols/min [2025-10-08T19:22:05.626045] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-08T19:22:05.659235] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:05.693701] [DEBUG] [LOCAL ] HHH: Loaded 32912 existing records from primary storage. [2025-10-08T19:22:05.694029] [INFO ] [MAIN ] HHH: Loaded 32912 existing records. [2025-10-08T19:22:05.877330] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:05.877599] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-08T19:22:05.877674] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-08T19:22:05.877948] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-08T19:22:05.878005] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-08T19:22:06.231306] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T19:22:06.256673] [INFO ] [REMOTE ] HFND: Full fetch complete (1781 records). [2025-10-08T19:22:06.262946] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-08T19:22:06.262687] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:06.425256] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-08T19:22:06.511269] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-08T19:22:06.513627] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:22:06.513995] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:22:06.523304] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:22:06.523384] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-08T19:22:06.523452] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-08T19:22:06.523489] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-08T19:22:06.523529] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-08T19:22:06.523594] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HFND took 48.7s. Estimated remaining: 3h 10m 25s. Rate: 7.1 symbols/min [2025-10-08T19:22:06.692787] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:06.728310] [DEBUG] [LOCAL ] HI: Loaded 35337 existing records from primary storage. [2025-10-08T19:22:06.728674] [INFO ] [MAIN ] HI: Loaded 35337 existing records. [2025-10-08T19:22:06.908341] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:06.908595] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-08T19:22:06.908874] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-08T19:22:06.909184] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-08T19:22:06.909244] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-08T19:22:07.222693] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-08T19:22:07.281305] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:07.334711] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T19:22:07.336276] [INFO ] [REMOTE ] HGLB: Full fetch complete (14876 records). [2025-10-08T19:22:07.336348] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-08T19:22:07.705103] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-08T19:22:07.705192] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-08T19:22:07.705556] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-08T19:22:07.705598] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-08T19:22:07.706367] [DEBUG] [LOCAL ] HGLB: Trimmed 14876 records to 9688 (keeping 200 days of data) [2025-10-08T19:22:07.768414] [DEBUG] [LOCAL ] HGLB: Primary data saved (9688 records). [2025-10-08T19:22:07.768601] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-08T19:22:07.768755] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGLB took 30.0s. Estimated remaining: 3h 10m 7s. Rate: 7.1 symbols/min [2025-10-08T19:22:07.948205] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:08.009111] [DEBUG] [LOCAL ] HIG: Loaded 51176 existing records from primary storage. [2025-10-08T19:22:08.009517] [INFO ] [MAIN ] HIG: Loaded 51176 existing records. [2025-10-08T19:22:08.022685] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-08T19:22:08.204322] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:08.204665] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-08T19:22:08.204736] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-08T19:22:08.204966] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-08T19:22:08.205023] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-08T19:22:08.508232] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T19:22:08.593015] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:08.817564] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-08T19:22:09.047715] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T19:22:09.617546] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-08T19:22:10.417637] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-08T19:22:10.566882] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T19:22:10.919467] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T19:22:11.217600] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-08T19:22:11.430296] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T19:22:12.017604] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-08T19:22:12.419259] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T19:22:12.817613] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-08T19:22:13.314267] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T19:22:13.617563] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-08T19:22:14.417568] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-08T19:22:14.457620] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T19:22:14.703331] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T19:22:15.217567] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-08T19:22:16.017539] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-08T19:22:16.152522] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:22:16.413048] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T19:22:16.817551] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-08T19:22:17.385560] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:22:17.617582] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-08T19:22:18.399720] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:22:18.417590] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-08T19:22:19.181083] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T19:22:19.217519] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-08T19:22:19.451532] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T19:22:20.017548] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-08T19:22:20.612193] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T19:22:20.817563] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-08T19:22:21.260558] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T19:22:21.617535] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-08T19:22:22.187602] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:22:22.417562] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-08T19:22:22.586327] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T19:22:23.217527] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-08T19:22:23.561720] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T19:22:24.017555] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-08T19:22:24.817533] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-08T19:22:24.901624] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T19:22:25.441996] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:22:25.617538] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-08T19:22:26.417558] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-08T19:22:26.458587] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:22:27.183539] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:22:27.217523] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-08T19:22:27.929454] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:22:28.017601] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-08T19:22:28.717846] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:22:28.817503] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-08T19:22:29.572060] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T19:22:29.617493] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-08T19:22:30.230143] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T19:22:30.417547] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-08T19:22:30.627427] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T19:22:31.217544] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-08T19:22:32.017591] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-08T19:22:32.272326] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T19:22:32.306048] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T19:22:32.817614] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-08T19:22:33.571521] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T19:22:33.617525] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-08T19:22:34.417709] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-08T19:22:34.582420] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T19:22:35.217512] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-08T19:22:35.361199] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:22:35.423844] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T19:22:36.017606] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-08T19:22:36.619019] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T19:22:36.817527] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-08T19:22:37.351533] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T19:22:37.354340] [INFO ] [REMOTE ] HI: Full fetch complete (49977 records). [2025-10-08T19:22:37.354444] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-08T19:22:37.622638] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-08T19:22:37.739791] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-08T19:22:37.739891] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-08T19:22:37.740846] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-08T19:22:37.740908] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-08T19:22:37.742096] [DEBUG] [LOCAL ] HI: Trimmed 49977 records to 35330 (keeping 200 days of data) [2025-10-08T19:22:37.858049] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T19:22:37.862936] [INFO ] [REMOTE ] HHH: Full fetch complete (45768 records). [2025-10-08T19:22:37.864056] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-08T19:22:38.354607] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-08T19:22:38.356241] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-08T19:22:38.356973] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-08T19:22:38.357331] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-08T19:22:38.362214] [DEBUG] [LOCAL ] HHH: Trimmed 45768 records to 32955 (keeping 200 days of data) [2025-10-08T19:22:38.421379] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-08T19:22:38.469396] [DEBUG] [LOCAL ] HI: Primary data saved (35330 records). [2025-10-08T19:22:38.471844] [INFO ] [MAIN ] HI: Full history saved. [2025-10-08T19:22:38.472724] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HI took 31.9s. Estimated remaining: 3h 10m 29s. Rate: 7.1 symbols/min [2025-10-08T19:22:38.659138] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:38.767090] [DEBUG] [LOCAL ] HII: Loaded 34213 existing records from primary storage. [2025-10-08T19:22:38.768834] [INFO ] [MAIN ] HII: Loaded 34213 existing records. [2025-10-08T19:22:38.959897] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:38.963012] [DEBUG] [LOCAL ] HHH: Primary data saved (32955 records). [2025-10-08T19:22:38.963348] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-08T19:22:38.963603] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-08T19:22:38.963523] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-08T19:22:38.963809] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HHH took 33.5s. Estimated remaining: 3h 10m 10s. Rate: 7.1 symbols/min [2025-10-08T19:22:39.018202] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-08T19:22:39.032238] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-08T19:22:39.263318] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:39.535832] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T19:22:39.533735] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:39.545188] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-08T19:22:39.587881] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-08T19:22:39.588280] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-08T19:22:39.765473] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:39.765778] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-08T19:22:39.765836] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-08T19:22:39.766144] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-08T19:22:39.766216] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-08T19:22:40.045196] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-08T19:22:40.079187] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T19:22:40.142251] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:40.138634] [INFO ] [REMOTE ] HIG: Full fetch complete (73189 records). [2025-10-08T19:22:40.142443] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-08T19:22:40.525737] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-08T19:22:40.525823] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-08T19:22:40.526748] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-08T19:22:40.526812] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-08T19:22:40.528230] [DEBUG] [LOCAL ] HIG: Trimmed 73189 records to 51163 (keeping 200 days of data) [2025-10-08T19:22:40.818971] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-08T19:22:40.861599] [DEBUG] [LOCAL ] HIG: Primary data saved (51163 records). [2025-10-08T19:22:40.861750] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-08T19:22:40.861849] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HIG took 33.1s. Estimated remaining: 3h 9m 53s. Rate: 7.1 symbols/min [2025-10-08T19:22:41.035099] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:41.057769] [DEBUG] [LOCAL ] HIO: Loaded 24020 existing records from primary storage. [2025-10-08T19:22:41.058029] [INFO ] [MAIN ] HIO: Loaded 24020 existing records. [2025-10-08T19:22:41.263898] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:41.264308] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-08T19:22:41.264454] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-08T19:22:41.265229] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-08T19:22:41.266467] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T19:22:41.266683] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-08T19:22:41.628254] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-08T19:22:41.668161] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T19:22:41.674214] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:42.417573] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-08T19:22:43.179034] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:22:43.217497] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-08T19:22:43.288401] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T19:22:43.445762] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:22:43.449163] [INFO ] [REMOTE ] HGV: Full fetch complete (65907 records). [2025-10-08T19:22:43.449276] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-08T19:22:43.843699] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-08T19:22:43.843791] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-08T19:22:43.844634] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-08T19:22:43.844712] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-08T19:22:43.846007] [DEBUG] [LOCAL ] HGV: Trimmed 65907 records to 46408 (keeping 200 days of data) [2025-10-08T19:22:44.022467] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-08T19:22:44.125156] [DEBUG] [LOCAL ] HGV: Primary data saved (46408 records). [2025-10-08T19:22:44.125317] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-08T19:22:44.125419] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HGV took 41.7s. Estimated remaining: 3h 9m 37s. Rate: 7.1 symbols/min [2025-10-08T19:22:44.295131] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:44.316952] [DEBUG] [LOCAL ] HIPO: Loaded 22014 existing records from primary storage. [2025-10-08T19:22:44.317312] [INFO ] [MAIN ] HIPO: Loaded 22014 existing records. [2025-10-08T19:22:44.505054] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:44.505314] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-08T19:22:44.505376] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-08T19:22:44.505572] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-08T19:22:44.505629] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-08T19:22:44.827555] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-08T19:22:44.872809] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:44.899677] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T19:22:45.617623] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-08T19:22:45.733016] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T19:22:46.398807] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-08T19:22:46.417500] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-08T19:22:47.217515] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-08T19:22:47.427450] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T19:22:48.017587] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-08T19:22:48.085982] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T19:22:48.616454] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-08T19:22:48.817524] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-08T19:22:49.045479] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T19:22:49.617568] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-08T19:22:49.638241] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T19:22:50.417543] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-08T19:22:51.217582] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-08T19:22:51.349543] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T19:22:51.415149] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T19:22:52.017575] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-08T19:22:52.817615] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-08T19:22:53.617556] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-08T19:23:05.641487] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (13.62 seconds). [2025-10-08T19:23:05.647413] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-08T19:23:07.874450] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (16.66 seconds). [2025-10-08T19:23:07.885605] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-08T19:23:08.428065] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (14.81 seconds). [2025-10-08T19:23:08.432513] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-08T19:23:09.318036] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T19:23:09.322236] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-08T19:23:09.457582] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (16.64 seconds). [2025-10-08T19:23:09.466416] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-08T19:23:09.975679] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (4.33 seconds). [2025-10-08T19:23:09.980264] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-08T19:23:10.413074] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T19:23:10.418321] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-08T19:23:10.744596] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:23:10.752797] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-08T19:23:10.876214] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T19:23:10.880929] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-08T19:23:11.236311] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T19:23:11.241469] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-08T19:23:12.003819] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (4.12 seconds). [2025-10-08T19:23:12.033837] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T19:23:12.040973] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-08T19:23:12.042500] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-08T19:23:12.073094] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:23:12.081373] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-08T19:23:12.133347] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T19:23:12.139111] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-08T19:23:13.393331] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T19:23:13.400137] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-08T19:23:13.420731] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T19:23:13.426949] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-08T19:23:13.650109] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T19:23:13.657172] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-08T19:23:14.231258] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:23:14.236426] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-08T19:23:14.510102] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-08T19:23:14.522275] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-08T19:23:14.566397] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T19:23:14.572705] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-08T19:23:14.944720] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T19:23:14.950121] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-08T19:23:15.136253] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T19:23:15.143809] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-08T19:23:15.551088] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T19:23:15.554033] [INFO ] [REMOTE ] HIO: Full fetch complete (37859 records). [2025-10-08T19:23:15.554113] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-08T19:23:15.917597] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-08T19:23:15.959329] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-08T19:23:15.976197] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-08T19:23:15.976288] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-08T19:23:15.976942] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-08T19:23:15.977007] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-08T19:23:15.977882] [DEBUG] [LOCAL ] HIO: Trimmed 37859 records to 24054 (keeping 200 days of data) [2025-10-08T19:23:16.118521] [DEBUG] [LOCAL ] HIO: Primary data saved (24054 records). [2025-10-08T19:23:16.118688] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-08T19:23:16.118791] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HIO took 35.3s. Estimated remaining: 3h 10m 0s. Rate: 7.1 symbols/min [2025-10-08T19:23:16.298618] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T19:23:16.302176] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:16.305831] [INFO ] [REMOTE ] HII: Full fetch complete (52638 records). [2025-10-08T19:23:16.306057] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-08T19:23:16.642121] [DEBUG] [LOCAL ] HIW: Loaded 44561 existing records from primary storage. [2025-10-08T19:23:16.668457] [INFO ] [MAIN ] HIW: Loaded 44561 existing records. [2025-10-08T19:23:16.800549] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-08T19:23:16.812285] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-08T19:23:16.823995] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-08T19:23:16.835290] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-08T19:23:16.921431] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:16.922445] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-08T19:23:16.922629] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-08T19:23:16.922863] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T19:23:16.921605] [DEBUG] [LOCAL ] HII: Trimmed 52638 records to 34069 (keeping 200 days of data) [2025-10-08T19:23:16.923182] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-08T19:23:16.924659] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-08T19:23:17.011396] [INFO ] [REMOTE ] HIPO: Full fetch complete (31424 records). [2025-10-08T19:23:17.031246] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-08T19:23:17.678759] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:17.710243] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-08T19:23:17.856153] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (3.33 seconds). [2025-10-08T19:23:17.854751] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-08T19:23:17.869629] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-08T19:23:17.870282] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-08T19:23:17.871036] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-08T19:23:17.871727] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-08T19:23:17.876110] [DEBUG] [LOCAL ] HIPO: Trimmed 31424 records to 21980 (keeping 200 days of data) [2025-10-08T19:23:18.116132] [DEBUG] [LOCAL ] HIPO: Primary data saved (21980 records). [2025-10-08T19:23:18.117292] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-08T19:23:18.117963] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIPO took 34.0s. Estimated remaining: 3h 9m 43s. Rate: 7.1 symbols/min [2025-10-08T19:23:18.233973] [DEBUG] [LOCAL ] HII: Primary data saved (34069 records). [2025-10-08T19:23:18.236950] [INFO ] [MAIN ] HII: Full history saved. [2025-10-08T19:23:18.237474] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HII took 39.8s. Estimated remaining: 3h 9m 24s. Rate: 7.1 symbols/min [2025-10-08T19:23:18.435938] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:18.514842] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:18.524318] [DEBUG] [LOCAL ] HIX: Loaded 20709 existing records from primary storage. [2025-10-08T19:23:18.524723] [INFO ] [MAIN ] HIX: Loaded 20709 existing records. [2025-10-08T19:23:18.689093] [DEBUG] [LOCAL ] HKD: Loaded 18519 existing records from primary storage. [2025-10-08T19:23:18.719951] [INFO ] [MAIN ] HKD: Loaded 18519 existing records. [2025-10-08T19:23:18.719751] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:18.757983] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-08T19:23:18.758065] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-08T19:23:18.788715] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-08T19:23:18.805755] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-08T19:23:19.016509] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:19.017668] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-08T19:23:19.028054] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-08T19:23:19.056850] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-08T19:23:19.101668] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-08T19:23:19.439079] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:19.458794] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-08T19:23:19.643383] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T19:23:19.687695] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-08T19:23:19.721340] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:19.722433] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-08T19:23:20.348268] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-08T19:23:20.362102] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-08T19:23:20.682693] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T19:23:20.689138] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-08T19:23:20.884255] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T19:23:20.895843] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-08T19:23:21.089280] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:23:21.096327] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-08T19:23:21.556639] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T19:23:21.562431] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-08T19:23:22.047352] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:23:22.056372] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-08T19:23:22.281232] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T19:23:22.285973] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-08T19:23:22.633263] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-08T19:23:22.634208] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T19:23:22.648876] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-08T19:23:23.092143] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T19:23:23.217527] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-08T19:23:23.434951] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T19:23:23.468129] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T19:23:24.017545] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-08T19:23:24.817595] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-08T19:23:25.390013] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:23:25.491939] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-08T19:23:25.617500] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-08T19:23:25.856592] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:23:26.417608] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-08T19:23:27.217574] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-08T19:23:27.618225] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T19:23:28.017516] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-08T19:23:28.056937] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-08T19:23:28.061750] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-08T19:23:28.061911] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-08T19:23:28.495454] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-08T19:23:28.495617] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-08T19:23:28.496725] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-08T19:23:28.496866] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-08T19:23:28.498543] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-10-08T19:23:28.749867] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:23:28.837389] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-08T19:23:28.911476] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-08T19:23:28.911662] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-08T19:23:28.911786] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIMS took 49.9s. Estimated remaining: 3h 9m 18s. Rate: 7.1 symbols/min [2025-10-08T19:23:29.083627] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:29.095548] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T19:23:29.146296] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-10-08T19:23:29.146684] [INFO ] [MAIN ] HL: Loaded 53671 existing records. [2025-10-08T19:23:29.320464] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:29.320731] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-08T19:23:29.320792] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-08T19:23:29.321025] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-08T19:23:29.321082] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-08T19:23:29.620053] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-08T19:23:29.703633] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:30.417572] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-08T19:23:30.483002] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T19:23:30.741792] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T19:23:31.217567] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-08T19:23:31.360676] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:23:32.017627] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-08T19:23:32.747689] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T19:23:32.817554] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-08T19:23:33.391529] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T19:23:33.617617] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-08T19:23:34.417613] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-08T19:23:34.710442] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-08T19:23:35.117958] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T19:23:35.217524] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-08T19:23:35.242777] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:23:36.017572] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-08T19:23:36.794092] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T19:23:36.817499] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-08T19:23:37.617517] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-08T19:23:37.857182] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T19:23:38.249135] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:23:38.253264] [INFO ] [REMOTE ] HIW: Full fetch complete (64830 records). [2025-10-08T19:23:38.253546] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-08T19:23:38.420905] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-08T19:23:38.669445] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-08T19:23:38.669607] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-08T19:23:38.670675] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-08T19:23:38.676176] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-08T19:23:38.681774] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:23:38.686513] [DEBUG] [LOCAL ] HIW: Trimmed 64830 records to 44497 (keeping 200 days of data) [2025-10-08T19:23:38.970204] [DEBUG] [LOCAL ] HIW: Primary data saved (44497 records). [2025-10-08T19:23:38.970370] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-08T19:23:38.970509] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIW took 22.9s. Estimated remaining: 3h 9m 12s. Rate: 7.1 symbols/min [2025-10-08T19:23:39.149557] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:39.194147] [DEBUG] [LOCAL ] HLF: Loaded 48469 existing records from primary storage. [2025-10-08T19:23:39.194520] [INFO ] [MAIN ] HLF: Loaded 48469 existing records. [2025-10-08T19:23:39.225424] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-08T19:23:39.373813] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:39.374028] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-08T19:23:39.374075] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-08T19:23:39.374294] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-08T19:23:39.374350] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-08T19:23:39.738882] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:40.017523] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-08T19:23:40.197867] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:23:40.325756] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T19:23:40.817639] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-08T19:23:41.561223] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:23:41.617583] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-08T19:23:42.015215] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T19:23:42.417511] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-08T19:23:42.758852] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:23:43.217557] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-08T19:23:43.947753] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T19:23:44.017495] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-08T19:23:44.426582] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T19:23:44.817522] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-08T19:23:45.471600] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T19:23:45.617562] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-08T19:23:45.994691] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T19:23:45.996578] [INFO ] [REMOTE ] HKD: Full fetch complete (28284 records). [2025-10-08T19:23:45.996690] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-08T19:23:46.360667] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-08T19:23:46.360758] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-08T19:23:46.361335] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-08T19:23:46.361373] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-08T19:23:46.362093] [DEBUG] [LOCAL ] HKD: Trimmed 28284 records to 18518 (keeping 200 days of data) [2025-10-08T19:23:46.440144] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-08T19:23:46.474960] [DEBUG] [LOCAL ] HKD: Primary data saved (18518 records). [2025-10-08T19:23:46.475122] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-08T19:23:46.475223] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HKD took 28.2s. Estimated remaining: 3h 9m 2s. Rate: 7.1 symbols/min [2025-10-08T19:23:46.644526] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:46.677221] [DEBUG] [LOCAL ] HLI: Loaded 30814 existing records from primary storage. [2025-10-08T19:23:46.677501] [INFO ] [MAIN ] HLI: Loaded 30814 existing records. [2025-10-08T19:23:46.856717] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:46.856981] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-08T19:23:46.857030] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-08T19:23:46.857307] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-08T19:23:46.857364] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-08T19:23:47.218448] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-08T19:23:47.222188] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:47.543533] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T19:23:47.640918] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T19:23:48.017569] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-08T19:23:48.235104] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T19:23:48.817575] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-08T19:23:49.617539] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-08T19:23:49.809494] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T19:23:50.417854] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-08T19:23:50.418075] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T19:23:50.421311] [INFO ] [REMOTE ] HIX: Full fetch complete (30562 records). [2025-10-08T19:23:50.421392] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-08T19:23:50.822832] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T19:23:50.870971] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-08T19:23:50.871037] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-08T19:23:50.871603] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-08T19:23:50.871720] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-08T19:23:50.872462] [DEBUG] [LOCAL ] HIX: Trimmed 30562 records to 20688 (keeping 200 days of data) [2025-10-08T19:23:50.999863] [DEBUG] [LOCAL ] HIX: Primary data saved (20688 records). [2025-10-08T19:23:51.000018] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-08T19:23:51.000121] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIX took 32.9s. Estimated remaining: 3h 8m 49s. Rate: 7.1 symbols/min [2025-10-08T19:23:51.204985] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:51.222973] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-08T19:23:51.237917] [DEBUG] [LOCAL ] HLIO: Loaded 27889 existing records from primary storage. [2025-10-08T19:23:51.238197] [INFO ] [MAIN ] HLIO: Loaded 27889 existing records. [2025-10-08T19:23:51.419741] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:51.419944] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-08T19:23:51.419994] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-08T19:23:51.420230] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-08T19:23:51.420288] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-08T19:23:51.790093] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:51.813294] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T19:23:52.017552] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-08T19:23:52.817631] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-08T19:23:52.867478] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:23:52.906193] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T19:23:53.617578] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-08T19:23:54.326238] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T19:23:54.417591] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-08T19:23:54.660465] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:23:55.217786] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-08T19:23:56.022666] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-08T19:23:56.037370] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T19:23:56.299169] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T19:23:56.817531] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-08T19:23:57.028935] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:23:57.617618] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-08T19:23:58.259543] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:23:58.417539] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-08T19:23:59.217557] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-08T19:23:59.484009] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T19:23:59.524881] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T19:24:00.017557] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-08T19:24:00.817529] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-08T19:24:00.982465] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:24:01.045438] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T19:24:01.617566] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-08T19:24:02.417580] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-08T19:24:02.971179] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T19:24:02.983297] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T19:24:03.217639] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-08T19:24:03.734241] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:24:04.017610] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-08T19:24:04.571303] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:24:04.817559] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-08T19:24:05.617513] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-08T19:24:05.913692] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T19:24:05.927008] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T19:24:06.417551] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-08T19:24:07.089417] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T19:24:07.217557] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-08T19:24:08.017605] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-08T19:24:08.179759] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T19:24:08.270797] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T19:24:08.817546] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-08T19:24:09.617566] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-08T19:24:09.674531] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T19:24:09.978165] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T19:24:10.417562] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-08T19:24:10.679132] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:24:11.217550] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-08T19:24:11.752509] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:24:12.017528] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-08T19:24:12.598063] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T19:24:12.817557] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-08T19:24:13.617546] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-08T19:24:13.920943] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T19:24:13.959601] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T19:24:13.964613] [INFO ] [REMOTE ] HL: Full fetch complete (77663 records). [2025-10-08T19:24:13.964791] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-08T19:24:14.367178] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-08T19:24:14.367307] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-08T19:24:14.368436] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-08T19:24:14.368623] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-08T19:24:14.370386] [DEBUG] [LOCAL ] HL: Trimmed 77663 records to 53672 (keeping 200 days of data) [2025-10-08T19:24:14.426220] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-08T19:24:14.484226] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T19:24:14.725570] [DEBUG] [LOCAL ] HL: Primary data saved (53672 records). [2025-10-08T19:24:14.725749] [INFO ] [MAIN ] HL: Full history saved. [2025-10-08T19:24:14.725841] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HL took 45.8s. Estimated remaining: 3h 9m 1s. Rate: 7.1 symbols/min [2025-10-08T19:24:14.896200] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:14.928639] [DEBUG] [LOCAL ] HLLY: Loaded 33426 existing records from primary storage. [2025-10-08T19:24:14.929018] [INFO ] [MAIN ] HLLY: Loaded 33426 existing records. [2025-10-08T19:24:15.125336] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:15.125588] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-08T19:24:15.125680] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-08T19:24:15.125947] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-08T19:24:15.126006] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-08T19:24:15.222824] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-08T19:24:15.508746] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:15.833213] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T19:24:16.017616] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-08T19:24:16.817600] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-08T19:24:16.852260] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T19:24:16.855981] [INFO ] [REMOTE ] HLF: Full fetch complete (70997 records). [2025-10-08T19:24:16.856112] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-08T19:24:17.261537] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-08T19:24:17.261669] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-08T19:24:17.262685] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-08T19:24:17.262820] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-08T19:24:17.264355] [DEBUG] [LOCAL ] HLF: Trimmed 70997 records to 48417 (keeping 200 days of data) [2025-10-08T19:24:17.371534] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T19:24:17.576234] [DEBUG] [LOCAL ] HLF: Primary data saved (48417 records). [2025-10-08T19:24:17.576429] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-08T19:24:17.576535] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 38.6s. Estimated remaining: 3h 8m 45s. Rate: 7.1 symbols/min [2025-10-08T19:24:17.622745] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-08T19:24:17.763181] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T19:24:17.762698] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:17.766263] [INFO ] [REMOTE ] HLIO: Full fetch complete (36412 records). [2025-10-08T19:24:17.766367] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-08T19:24:18.141923] [DEBUG] [LOCAL ] HLN: Loaded 53099 existing records from primary storage. [2025-10-08T19:24:18.176495] [INFO ] [MAIN ] HLN: Loaded 53099 existing records. [2025-10-08T19:24:18.259967] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-08T19:24:18.265692] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-08T19:24:18.271602] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-08T19:24:18.282468] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-08T19:24:18.332932] [DEBUG] [LOCAL ] HLIO: Trimmed 36412 records to 27907 (keeping 200 days of data) [2025-10-08T19:24:18.424788] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-08T19:24:18.373470] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:18.434301] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-08T19:24:18.435416] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-08T19:24:18.462837] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-08T19:24:18.463343] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-08T19:24:18.814502] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:24:18.873861] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:18.870773] [INFO ] [REMOTE ] HLI: Full fetch complete (45148 records). [2025-10-08T19:24:18.874566] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-08T19:24:19.222605] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-08T19:24:19.302084] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-08T19:24:19.303668] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-08T19:24:19.305529] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-08T19:24:19.305864] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-08T19:24:19.348403] [DEBUG] [LOCAL ] HLI: Trimmed 45148 records to 30808 (keeping 200 days of data) [2025-10-08T19:24:19.455312] [DEBUG] [LOCAL ] HLIO: Primary data saved (27907 records). [2025-10-08T19:24:19.456002] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-08T19:24:19.456613] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLIO took 28.5s. Estimated remaining: 3h 8m 28s. Rate: 7.1 symbols/min [2025-10-08T19:24:19.638885] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:19.699523] [DEBUG] [LOCAL ] HLT: Loaded 50618 existing records from primary storage. [2025-10-08T19:24:19.734004] [INFO ] [MAIN ] HLT: Loaded 50618 existing records. [2025-10-08T19:24:19.810242] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:24:19.969164] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:19.971397] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-08T19:24:19.971811] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-08T19:24:19.972720] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-08T19:24:19.973345] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-08T19:24:20.018687] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-08T19:24:20.238397] [DEBUG] [LOCAL ] HLI: Primary data saved (30808 records). [2025-10-08T19:24:20.249766] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-08T19:24:20.274288] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLI took 33.8s. Estimated remaining: 3h 8m 10s. Rate: 7.1 symbols/min [2025-10-08T19:24:20.473477] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:20.526682] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:20.568444] [DEBUG] [LOCAL ] HLX: Loaded 47654 existing records from primary storage. [2025-10-08T19:24:20.568813] [INFO ] [MAIN ] HLX: Loaded 47654 existing records. [2025-10-08T19:24:20.752302] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:20.752595] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-08T19:24:20.752706] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-08T19:24:20.752935] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-08T19:24:20.752993] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-08T19:24:20.826143] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-08T19:24:21.123237] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:21.166354] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T19:24:21.178354] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:24:21.617573] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-08T19:24:22.359732] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T19:24:22.417499] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-08T19:24:23.217559] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-08T19:24:23.333379] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T19:24:23.828632] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:24:24.017544] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-08T19:24:24.817515] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-08T19:24:24.913748] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:24:25.617527] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-08T19:24:25.653789] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T19:24:25.740412] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T19:24:26.417545] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-08T19:24:27.217478] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-08T19:24:27.280927] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T19:24:28.017550] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-08T19:24:28.344999] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T19:24:28.811737] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:24:28.821312] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-08T19:24:29.503424] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T19:24:29.617533] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-08T19:24:30.417538] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-08T19:24:30.522961] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T19:24:31.217527] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-08T19:24:31.501813] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T19:24:31.673669] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T19:24:32.017562] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-08T19:24:32.684306] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:24:32.817570] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-08T19:24:33.350423] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:24:33.617576] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-08T19:24:34.331236] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:24:34.417505] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-08T19:24:34.913449] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T19:24:35.217622] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-08T19:24:36.017567] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-08T19:24:36.241710] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T19:24:36.278766] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:24:36.817631] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-08T19:24:37.395549] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:24:37.617623] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-08T19:24:38.205249] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:24:38.417579] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-08T19:24:39.201976] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T19:24:39.217502] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-08T19:24:39.925481] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T19:24:40.017563] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-08T19:24:40.469938] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T19:24:40.817548] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-08T19:24:41.617584] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-08T19:24:41.777048] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T19:24:42.417516] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-08T19:24:42.532590] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T19:24:43.099500] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:24:43.217567] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-08T19:24:43.430595] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T19:24:44.017578] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-08T19:24:44.817539] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-08T19:24:44.953198] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:24:45.540470] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T19:24:45.617514] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-08T19:24:45.908307] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:24:46.417690] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-08T19:24:47.174744] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T19:24:47.217633] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-08T19:24:47.661388] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T19:24:47.664365] [INFO ] [REMOTE ] HLLY: Full fetch complete (46268 records). [2025-10-08T19:24:47.664495] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-08T19:24:48.025400] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-08T19:24:48.067551] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-08T19:24:48.067671] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-08T19:24:48.068392] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-08T19:24:48.068437] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-08T19:24:48.069986] [DEBUG] [LOCAL ] HLLY: Trimmed 46268 records to 33454 (keeping 200 days of data) [2025-10-08T19:24:48.265404] [DEBUG] [LOCAL ] HLLY: Primary data saved (33454 records). [2025-10-08T19:24:48.265575] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-08T19:24:48.265712] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLLY took 33.5s. Estimated remaining: 3h 8m 27s. Rate: 7.1 symbols/min [2025-10-08T19:24:48.432427] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:48.474569] [DEBUG] [LOCAL ] HMC: Loaded 46638 existing records from primary storage. [2025-10-08T19:24:48.474943] [INFO ] [MAIN ] HMC: Loaded 46638 existing records. [2025-10-08T19:24:48.652989] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:48.653254] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-08T19:24:48.653305] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-08T19:24:48.653566] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-08T19:24:48.653624] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-08T19:24:48.823716] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-08T19:24:49.060937] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:49.092083] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T19:24:49.302753] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:24:49.617571] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-08T19:24:50.401452] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T19:24:50.405780] [INFO ] [REMOTE ] HLN: Full fetch complete (76823 records). [2025-10-08T19:24:50.405963] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-08T19:24:50.422718] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-08T19:24:50.838879] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-08T19:24:50.838972] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-08T19:24:50.839993] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-08T19:24:50.840060] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-08T19:24:50.841614] [DEBUG] [LOCAL ] HLN: Trimmed 76823 records to 53097 (keeping 200 days of data) [2025-10-08T19:24:51.165114] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T19:24:51.169938] [INFO ] [REMOTE ] HLX: Full fetch complete (69073 records). [2025-10-08T19:24:51.170844] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-08T19:24:51.227698] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-08T19:24:51.597832] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-08T19:24:51.597550] [DEBUG] [LOCAL ] HLN: Primary data saved (53097 records). [2025-10-08T19:24:51.597946] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-08T19:24:51.598023] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-08T19:24:51.598982] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-08T19:24:51.599121] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLN took 34.0s. Estimated remaining: 3h 8m 12s. Rate: 7.1 symbols/min [2025-10-08T19:24:51.599194] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-08T19:24:51.698550] [DEBUG] [LOCAL ] HLX: Trimmed 69073 records to 47588 (keeping 200 days of data) [2025-10-08T19:24:51.851368] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:51.914380] [DEBUG] [LOCAL ] HMN: Loaded 23451 existing records from primary storage. [2025-10-08T19:24:51.916170] [INFO ] [MAIN ] HMN: Loaded 23451 existing records. [2025-10-08T19:24:52.111244] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:52.113595] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-08T19:24:52.114285] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-08T19:24:52.129685] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-08T19:24:52.130191] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-08T19:24:52.191182] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T19:24:52.253803] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-08T19:24:52.626171] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:52.697659] [DEBUG] [LOCAL ] HLX: Primary data saved (47588 records). [2025-10-08T19:24:52.697813] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-08T19:24:52.697904] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLX took 32.4s. Estimated remaining: 3h 7m 54s. Rate: 7.1 symbols/min [2025-10-08T19:24:52.828566] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-08T19:24:52.877911] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:52.939797] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T19:24:52.967414] [DEBUG] [LOCAL ] HMY: Loaded 53140 existing records from primary storage. [2025-10-08T19:24:52.967813] [INFO ] [MAIN ] HMY: Loaded 53140 existing records. [2025-10-08T19:24:53.148315] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:53.148611] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-08T19:24:53.148696] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-08T19:24:53.149068] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-08T19:24:53.149128] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-08T19:24:53.531061] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:53.622638] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-08T19:24:53.630767] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T19:24:53.676062] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:24:54.417560] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-08T19:24:55.217567] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-08T19:24:55.426676] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T19:24:55.862915] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T19:24:55.937972] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:24:56.017556] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-08T19:24:56.817524] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-08T19:24:57.043892] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T19:24:57.617586] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-08T19:24:58.371795] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T19:24:58.376935] [INFO ] [REMOTE ] HLT: Full fetch complete (73527 records). [2025-10-08T19:24:58.377155] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-08T19:24:58.422639] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-08T19:24:58.545577] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T19:24:58.789910] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-08T19:24:58.790045] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-08T19:24:58.791183] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-08T19:24:58.791248] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-08T19:24:58.792951] [DEBUG] [LOCAL ] HLT: Trimmed 73527 records to 50612 (keeping 200 days of data) [2025-10-08T19:24:59.123361] [DEBUG] [LOCAL ] HLT: Primary data saved (50612 records). [2025-10-08T19:24:59.123633] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-08T19:24:59.123773] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLT took 39.7s. Estimated remaining: 3h 7m 43s. Rate: 7.1 symbols/min [2025-10-08T19:24:59.222876] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-08T19:24:59.298412] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:59.298625] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-08T19:24:59.298702] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-08T19:24:59.298904] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-08T19:24:59.298984] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-08T19:24:59.299080] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-08T19:24:59.299134] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-08T19:24:59.666382] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:00.017502] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-08T19:25:00.119956] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:25:00.430501] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:25:00.817586] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-08T19:25:00.995561] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:25:00.995901] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-08T19:25:00.995992] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:25:00.996039] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-08T19:25:00.996096] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:25:00.996168] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-08T19:25:00.996231] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-08T19:25:00.996265] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-08T19:25:00.996319] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-08T19:25:00.996390] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HNGE took 1.9s. Estimated remaining: 3h 7m 26s. Rate: 7.1 symbols/min [2025-10-08T19:25:01.170781] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:01.200832] [DEBUG] [LOCAL ] HNI: Loaded 29406 existing records from primary storage. [2025-10-08T19:25:01.201141] [INFO ] [MAIN ] HNI: Loaded 29406 existing records. [2025-10-08T19:25:01.385282] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:01.385720] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-08T19:25:01.385941] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-08T19:25:01.386283] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-08T19:25:01.386412] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-08T19:25:01.625415] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-08T19:25:01.645753] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T19:25:01.868165] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:02.417562] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-08T19:25:03.144095] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T19:25:03.217510] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-08T19:25:04.017509] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-08T19:25:04.247045] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T19:25:04.393809] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:25:04.817562] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-08T19:25:05.617517] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-08T19:25:05.902610] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T19:25:05.990552] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:25:06.417525] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-08T19:25:07.155184] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T19:25:07.217506] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-08T19:25:07.650465] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:25:08.017554] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-08T19:25:08.817582] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-08T19:25:08.908885] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:25:08.934128] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:25:09.617556] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-08T19:25:09.746249] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T19:25:10.417570] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-08T19:25:11.217555] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-08T19:25:11.469310] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T19:25:11.560314] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T19:25:12.017523] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-08T19:25:12.266789] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T19:25:12.817546] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-08T19:25:13.617564] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-08T19:25:13.680392] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T19:25:14.417523] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-08T19:25:14.527489] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T19:25:14.754141] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T19:25:14.755990] [INFO ] [REMOTE ] HMN: Full fetch complete (31429 records). [2025-10-08T19:25:14.756077] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-08T19:25:15.135685] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-08T19:25:15.135778] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-08T19:25:15.136371] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-08T19:25:15.136434] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-08T19:25:15.137267] [DEBUG] [LOCAL ] HMN: Trimmed 31429 records to 23391 (keeping 200 days of data) [2025-10-08T19:25:15.225791] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-08T19:25:15.284958] [DEBUG] [LOCAL ] HMN: Primary data saved (23391 records). [2025-10-08T19:25:15.285096] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-08T19:25:15.285178] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMN took 23.7s. Estimated remaining: 3h 7m 25s. Rate: 7.1 symbols/min [2025-10-08T19:25:15.460440] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:15.509776] [DEBUG] [LOCAL ] HOG: Loaded 51064 existing records from primary storage. [2025-10-08T19:25:15.510112] [INFO ] [MAIN ] HOG: Loaded 51064 existing records. [2025-10-08T19:25:15.692208] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:15.692544] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-08T19:25:15.692603] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-08T19:25:15.693135] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-08T19:25:15.693193] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-08T19:25:15.985017] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:25:16.022632] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-08T19:25:16.088012] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:16.817576] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-08T19:25:16.936492] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:25:17.054048] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T19:25:17.617546] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-08T19:25:18.417529] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-08T19:25:18.497788] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T19:25:19.217509] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-08T19:25:19.692983] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-08T19:25:19.756918] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T19:25:20.017548] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-08T19:25:20.589850] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T19:25:20.817537] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-08T19:25:21.115257] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T19:25:21.617552] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-08T19:25:22.417561] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-08T19:25:22.724918] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T19:25:23.178175] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T19:25:23.217495] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-08T19:25:23.325196] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T19:25:24.017567] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-08T19:25:24.453815] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T19:25:24.817536] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-08T19:25:25.617543] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-08T19:25:26.351757] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T19:25:26.419760] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-08T19:25:26.425359] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T19:25:27.222697] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-08T19:25:27.240629] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T19:25:28.017553] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-08T19:25:28.366770] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-08T19:25:28.372887] [INFO ] [REMOTE ] HMY: Full fetch complete (76769 records). [2025-10-08T19:25:28.373060] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-08T19:25:28.789506] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-08T19:25:28.789697] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-08T19:25:28.790785] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-08T19:25:28.790887] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-08T19:25:28.793086] [DEBUG] [LOCAL ] HMY: Trimmed 76769 records to 53135 (keeping 200 days of data) [2025-10-08T19:25:28.849880] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-08T19:25:28.921573] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T19:25:29.183676] [DEBUG] [LOCAL ] HMY: Primary data saved (53135 records). [2025-10-08T19:25:29.183849] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-08T19:25:29.183973] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMY took 36.5s. Estimated remaining: 3h 7m 24s. Rate: 7.1 symbols/min [2025-10-08T19:25:29.397457] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:29.421801] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T19:25:29.468036] [DEBUG] [LOCAL ] HOMB: Loaded 43458 existing records from primary storage. [2025-10-08T19:25:29.468399] [INFO ] [MAIN ] HOMB: Loaded 43458 existing records. [2025-10-08T19:25:29.623771] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-08T19:25:29.653952] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:29.654194] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-08T19:25:29.654241] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-08T19:25:29.654572] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-08T19:25:29.654629] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-08T19:25:30.011792] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:30.321273] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T19:25:30.417529] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-08T19:25:30.872463] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T19:25:30.875172] [INFO ] [REMOTE ] HNI: Full fetch complete (41951 records). [2025-10-08T19:25:30.875256] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-08T19:25:31.217729] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-08T19:25:31.248777] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-08T19:25:31.248870] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-08T19:25:31.249570] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-08T19:25:31.249804] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-08T19:25:31.251083] [DEBUG] [LOCAL ] HNI: Trimmed 41951 records to 29303 (keeping 200 days of data) [2025-10-08T19:25:31.441630] [DEBUG] [LOCAL ] HNI: Primary data saved (29303 records). [2025-10-08T19:25:31.441808] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-08T19:25:31.441916] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HNI took 30.4s. Estimated remaining: 3h 7m 7s. Rate: 7.1 symbols/min [2025-10-08T19:25:32.017528] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-08T19:25:32.132080] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T19:25:32.802360] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T19:25:32.817507] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-08T19:25:33.596967] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T19:25:33.617504] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-08T19:25:34.167282] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:25:34.417553] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-08T19:25:34.938024] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:25:35.217586] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-08T19:25:36.017552] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-08T19:25:36.103237] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T19:25:36.605547] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:25:36.817543] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-08T19:25:37.065008] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T19:25:37.617621] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-08T19:25:38.417521] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-08T19:25:38.610231] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T19:25:38.941987] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:25:39.217624] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-08T19:25:39.756414] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T19:25:39.759977] [INFO ] [REMOTE ] HMC: Full fetch complete (69174 records). [2025-10-08T19:25:39.760111] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-08T19:25:40.026616] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-08T19:25:40.153018] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-08T19:25:40.153107] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-08T19:25:40.154006] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-08T19:25:40.154075] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-08T19:25:40.156756] [DEBUG] [LOCAL ] HMC: Trimmed 69174 records to 46543 (keeping 200 days of data) [2025-10-08T19:25:40.442847] [DEBUG] [LOCAL ] HMC: Primary data saved (46543 records). [2025-10-08T19:25:40.442999] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-08T19:25:40.443099] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMC took 52.2s. Estimated remaining: 3h 6m 60s. Rate: 7.1 symbols/min [2025-10-08T19:25:40.494908] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:25:40.817553] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-08T19:25:41.785404] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T19:25:41.797929] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-08T19:25:42.248073] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:25:42.417618] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-08T19:25:43.053118] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T19:25:43.056868] [INFO ] [REMOTE ] HOG: Full fetch complete (74142 records). [2025-10-08T19:25:43.056977] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-08T19:25:43.467730] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-08T19:25:43.468012] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-08T19:25:43.469077] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-08T19:25:43.469161] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-08T19:25:43.470721] [DEBUG] [LOCAL ] HOG: Trimmed 74142 records to 51002 (keeping 200 days of data) [2025-10-08T19:25:43.609426] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T19:25:43.625489] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-08T19:25:43.844433] [DEBUG] [LOCAL ] HOG: Primary data saved (51002 records). [2025-10-08T19:25:43.844570] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-08T19:25:43.844679] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOG took 28.6s. Estimated remaining: 3h 6m 45s. Rate: 7.1 symbols/min [2025-10-08T19:25:45.243228] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:25:45.253727] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-08T19:25:46.714704] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T19:25:46.726191] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-08T19:25:47.953275] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:25:47.964092] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-08T19:25:49.355528] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:25:49.359204] [INFO ] [REMOTE ] HOMB: Full fetch complete (63989 records). [2025-10-08T19:25:49.359300] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-08T19:25:49.745397] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-08T19:25:49.745534] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-08T19:25:49.746456] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-08T19:25:49.746524] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-08T19:25:49.747989] [DEBUG] [LOCAL ] HOMB: Trimmed 63989 records to 43436 (keeping 200 days of data) [2025-10-08T19:25:50.024917] [DEBUG] [LOCAL ] HOMB: Primary data saved (43436 records). [2025-10-08T19:25:50.025075] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-08T19:25:50.025166] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOMB took 20.8s. Estimated remaining: 3h 6m 33s. Rate: 7.1 symbols/min [2025-10-08T19:25:50.618141] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:50.684957] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:50.779218] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:50.796820] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:50.827162] [DEBUG] [LOCAL ] HOV: Loaded 13932 existing records from primary storage. [2025-10-08T19:25:50.827628] [INFO ] [MAIN ] HOV: Loaded 13932 existing records. [2025-10-08T19:25:50.998749] [DEBUG] [LOCAL ] HOUS: Loaded 44807 existing records from primary storage. [2025-10-08T19:25:51.004925] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-08T19:25:51.020991] [INFO ] [MAIN ] HOUS: Loaded 44807 existing records. [2025-10-08T19:25:51.061241] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-08T19:25:51.164474] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:51.222502] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-08T19:25:51.290329] [DEBUG] [LOCAL ] HP: Loaded 51653 existing records from primary storage. [2025-10-08T19:25:51.301892] [INFO ] [MAIN ] HP: Loaded 51653 existing records. [2025-10-08T19:25:51.285972] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-08T19:25:51.396743] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-08T19:25:51.498926] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:51.443140] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-08T19:25:51.528418] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-08T19:25:51.571768] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-08T19:25:51.590637] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:51.599543] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-08T19:25:51.626860] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-08T19:25:51.621609] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-08T19:25:51.665505] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-08T19:25:51.665621] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-08T19:25:51.743315] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-08T19:25:51.807103] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:51.846868] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-08T19:25:51.944227] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-08T19:25:51.987098] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-08T19:25:52.033428] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-08T19:25:52.844072] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:52.877532] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-08T19:25:53.073940] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:53.145630] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-08T19:25:53.162035] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:53.188033] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-08T19:25:53.219419] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:53.222052] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-08T19:25:53.849821] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T19:25:53.853591] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-08T19:25:54.587194] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:25:54.595952] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-08T19:25:54.667275] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:25:54.670940] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-08T19:25:54.702407] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T19:25:54.712720] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-08T19:25:54.860731] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T19:25:54.871605] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-08T19:25:55.221234] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T19:25:55.224126] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-08T19:25:55.653303] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T19:25:55.668342] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-08T19:25:55.832808] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T19:25:55.849695] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-08T19:25:55.864437] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T19:25:56.017696] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-08T19:25:56.350152] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T19:25:56.817602] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-08T19:25:56.935406] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T19:25:57.105235] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T19:25:57.230180] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:25:57.617515] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-08T19:25:58.417582] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-08T19:25:58.571383] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T19:25:59.073634] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:25:59.217576] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-08T19:25:59.597469] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:26:00.017555] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-08T19:26:00.817521] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-08T19:26:01.060690] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T19:26:01.617562] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-08T19:26:01.765412] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T19:26:02.178197] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T19:26:02.417607] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-08T19:26:02.467405] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T19:26:03.217562] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-08T19:26:04.017557] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-08T19:26:04.177479] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:26:04.657840] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T19:26:04.817554] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-08T19:26:04.945743] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T19:26:05.617568] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-08T19:26:06.288636] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:26:06.417515] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-08T19:26:06.665939] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T19:26:07.217555] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-08T19:26:08.017572] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-08T19:26:08.067841] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T19:26:08.817515] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-08T19:26:08.920736] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:26:09.254994] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T19:26:09.617557] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-08T19:26:10.417517] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-08T19:26:10.583560] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T19:26:11.217530] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-08T19:26:11.288749] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T19:26:11.333737] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T19:26:12.017552] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-08T19:26:12.817529] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-08T19:26:12.956246] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:26:13.617570] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-08T19:26:13.714531] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T19:26:13.870134] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T19:26:14.417557] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-08T19:26:15.107082] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T19:26:15.217561] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-08T19:26:16.017565] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-08T19:26:16.071258] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T19:26:16.628091] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T19:26:16.629596] [INFO ] [REMOTE ] HOV: Full fetch complete (19130 records). [2025-10-08T19:26:16.629703] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-08T19:26:16.822472] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-08T19:26:17.015197] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-08T19:26:17.015379] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-08T19:26:17.015918] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-08T19:26:17.016001] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-08T19:26:17.016887] [DEBUG] [LOCAL ] HOV: Trimmed 19130 records to 13912 (keeping 200 days of data) [2025-10-08T19:26:17.111124] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T19:26:17.146876] [DEBUG] [LOCAL ] HOV: Primary data saved (13912 records). [2025-10-08T19:26:17.147032] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-08T19:26:17.147134] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 27.1s. Estimated remaining: 3h 6m 49s. Rate: 7.1 symbols/min [2025-10-08T19:26:17.322883] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:17.333369] [DEBUG] [LOCAL ] HPF: Loaded 7495 existing records from primary storage. [2025-10-08T19:26:17.333619] [INFO ] [MAIN ] HPF: Loaded 7495 existing records. [2025-10-08T19:26:17.517140] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:17.517462] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-08T19:26:17.517565] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-08T19:26:17.517822] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-08T19:26:17.517879] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-08T19:26:17.622717] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-08T19:26:17.870544] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:18.417589] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-08T19:26:18.544396] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T19:26:18.548810] [INFO ] [REMOTE ] HP: Full fetch complete (73991 records). [2025-10-08T19:26:18.548955] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-08T19:26:19.004569] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-08T19:26:19.004794] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-08T19:26:19.006447] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-08T19:26:19.006572] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-08T19:26:19.032715] [DEBUG] [LOCAL ] HP: Trimmed 73991 records to 51643 (keeping 200 days of data) [2025-10-08T19:26:19.035281] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:26:19.225085] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-08T19:26:19.358935] [DEBUG] [LOCAL ] HP: Primary data saved (51643 records). [2025-10-08T19:26:19.359091] [INFO ] [MAIN ] HP: Full history saved. [2025-10-08T19:26:19.359212] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HP took 29.3s. Estimated remaining: 3h 6m 33s. Rate: 7.1 symbols/min [2025-10-08T19:26:19.529849] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:19.542442] [DEBUG] [LOCAL ] HPI: Loaded 10570 existing records from primary storage. [2025-10-08T19:26:19.542699] [INFO ] [MAIN ] HPI: Loaded 10570 existing records. [2025-10-08T19:26:19.725990] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:19.726196] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-08T19:26:19.726242] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-08T19:26:19.726431] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-08T19:26:19.726490] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-08T19:26:20.022704] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-08T19:26:20.139602] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:20.452046] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T19:26:20.817538] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-08T19:26:20.909384] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T19:26:20.926585] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T19:26:21.314428] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-08T19:26:21.617555] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-08T19:26:22.407433] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T19:26:22.417555] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-08T19:26:23.104841] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T19:26:23.217552] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-08T19:26:24.017591] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-08T19:26:24.672324] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T19:26:24.817520] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-08T19:26:25.138725] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T19:26:25.142674] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-08T19:26:25.142794] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-08T19:26:25.556215] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T19:26:25.560122] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-08T19:26:25.562491] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-08T19:26:25.563729] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-08T19:26:25.564207] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-08T19:26:25.565680] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-10-08T19:26:25.622715] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-08T19:26:25.912061] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-08T19:26:25.912231] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-08T19:26:25.912325] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HPE took 35.9s. Estimated remaining: 3h 6m 22s. Rate: 7.1 symbols/min [2025-10-08T19:26:26.088804] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:26.139341] [DEBUG] [LOCAL ] HPP: Loaded 51040 existing records from primary storage. [2025-10-08T19:26:26.139729] [INFO ] [MAIN ] HPP: Loaded 51040 existing records. [2025-10-08T19:26:26.324384] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:26.324866] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-08T19:26:26.324929] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-08T19:26:26.325208] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-08T19:26:26.325267] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-08T19:26:26.422689] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-08T19:26:26.433500] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:26:26.691484] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:27.217631] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-08T19:26:27.899248] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T19:26:28.017542] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-08T19:26:28.053924] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T19:26:28.057930] [INFO ] [REMOTE ] HOUS: Full fetch complete (63887 records). [2025-10-08T19:26:28.058052] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-08T19:26:28.454740] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-08T19:26:28.454919] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-08T19:26:28.455772] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-08T19:26:28.455835] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-08T19:26:28.457140] [DEBUG] [LOCAL ] HOUS: Trimmed 63887 records to 44857 (keeping 200 days of data) [2025-10-08T19:26:28.710975] [DEBUG] [LOCAL ] HOUS: Primary data saved (44857 records). [2025-10-08T19:26:28.711116] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-08T19:26:28.711244] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HOUS took 38.7s. Estimated remaining: 3h 6m 6s. Rate: 7.1 symbols/min [2025-10-08T19:26:28.822730] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-08T19:26:28.886779] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:28.937429] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-08T19:26:28.937784] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-08T19:26:29.121781] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:29.122052] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-08T19:26:29.122109] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-08T19:26:29.122575] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-08T19:26:29.122637] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-08T19:26:29.498578] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:29.553907] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:26:29.617546] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-08T19:26:29.624667] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T19:26:30.417548] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-08T19:26:31.217575] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-08T19:26:31.266781] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T19:26:31.974536] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T19:26:32.006954] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T19:26:32.017744] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-08T19:26:32.817574] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-08T19:26:33.550614] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T19:26:33.617516] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-08T19:26:33.895567] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T19:26:34.417570] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-08T19:26:34.833299] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T19:26:35.217557] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-08T19:26:36.017519] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-08T19:26:36.204200] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:26:36.240975] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T19:26:36.815075] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T19:26:36.817484] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-08T19:26:37.434745] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T19:26:37.617570] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-08T19:26:38.172042] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T19:26:38.417610] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-08T19:26:39.217579] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-08T19:26:39.236267] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:26:39.988897] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T19:26:40.017539] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-08T19:26:40.817605] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-08T19:26:40.874856] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T19:26:41.552089] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T19:26:41.617536] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-08T19:26:42.161496] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T19:26:42.162672] [INFO ] [REMOTE ] HPF: Full fetch complete (10776 records). [2025-10-08T19:26:42.162744] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-08T19:26:42.422625] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-08T19:26:42.524391] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-08T19:26:42.524470] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-08T19:26:42.524786] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-08T19:26:42.524845] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-08T19:26:42.525327] [DEBUG] [LOCAL ] HPF: Trimmed 10776 records to 7485 (keeping 200 days of data) [2025-10-08T19:26:42.571154] [DEBUG] [LOCAL ] HPF: Primary data saved (7485 records). [2025-10-08T19:26:42.571282] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-08T19:26:42.571364] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 25.4s. Estimated remaining: 3h 6m 5s. Rate: 7.1 symbols/min [2025-10-08T19:26:42.735547] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:42.748190] [DEBUG] [LOCAL ] HPS: Loaded 10266 existing records from primary storage. [2025-10-08T19:26:42.748420] [INFO ] [MAIN ] HPS: Loaded 10266 existing records. [2025-10-08T19:26:42.924168] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:42.924414] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-08T19:26:42.924460] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-08T19:26:42.924691] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-08T19:26:42.924750] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-08T19:26:43.232230] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-08T19:26:43.272857] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:44.017563] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-08T19:26:44.114517] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:26:44.149784] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T19:26:44.817529] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-08T19:26:44.846268] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T19:26:45.617551] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-08T19:26:46.197852] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:26:46.378401] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T19:26:46.417568] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-08T19:26:47.217531] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-08T19:26:47.352824] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T19:26:47.354302] [INFO ] [REMOTE ] HPI: Full fetch complete (13982 records). [2025-10-08T19:26:47.354374] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-08T19:26:47.761462] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-08T19:26:47.761594] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-08T19:26:47.762134] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-08T19:26:47.762269] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-08T19:26:47.763215] [DEBUG] [LOCAL ] HPI: Trimmed 13982 records to 10608 (keeping 200 days of data) [2025-10-08T19:26:47.841699] [DEBUG] [LOCAL ] HPI: Primary data saved (10608 records). [2025-10-08T19:26:47.841879] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-08T19:26:47.841974] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 28.5s. Estimated remaining: 3h 5m 52s. Rate: 7.1 symbols/min [2025-10-08T19:26:48.022834] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-08T19:26:48.121668] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:48.128953] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T19:26:48.162452] [DEBUG] [LOCAL ] HQH: Loaded 25466 existing records from primary storage. [2025-10-08T19:26:48.162809] [INFO ] [MAIN ] HQH: Loaded 25466 existing records. [2025-10-08T19:26:48.406262] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:48.406571] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-08T19:26:48.406629] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-08T19:26:48.406897] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-08T19:26:48.406967] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-08T19:26:48.822672] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-08T19:26:48.903212] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:49.617566] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-08T19:26:49.824970] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T19:26:50.068378] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-08T19:26:50.417592] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-08T19:26:50.982810] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:26:51.217573] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-08T19:26:52.017599] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-08T19:26:52.061606] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T19:26:52.316256] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T19:26:52.817581] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-08T19:26:53.350551] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:26:53.564941] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:26:53.617504] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-08T19:26:54.413473] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T19:26:54.417492] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-08T19:26:55.217522] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-08T19:26:55.354863] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T19:26:56.017597] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-08T19:26:56.719816] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T19:26:56.817513] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-08T19:26:56.975667] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:26:57.617564] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-08T19:26:58.022498] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T19:26:58.417561] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-08T19:26:59.217544] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-08T19:26:59.312932] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:26:59.564924] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:27:00.017566] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-08T19:27:00.817516] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-08T19:27:01.184733] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-08T19:27:01.339013] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:27:01.617528] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-08T19:27:01.908186] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T19:27:02.397921] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T19:27:02.417544] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-08T19:27:03.217618] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-08T19:27:04.017531] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-08T19:27:04.257885] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T19:27:04.392117] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T19:27:04.636428] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T19:27:04.638132] [INFO ] [REMOTE ] HPS: Full fetch complete (15243 records). [2025-10-08T19:27:04.638223] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-08T19:27:04.821511] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-08T19:27:05.039843] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-08T19:27:05.039923] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-08T19:27:05.040258] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-08T19:27:05.040296] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-08T19:27:05.040863] [DEBUG] [LOCAL ] HPS: Trimmed 15243 records to 10270 (keeping 200 days of data) [2025-10-08T19:27:05.105107] [DEBUG] [LOCAL ] HPS: Primary data saved (10270 records). [2025-10-08T19:27:05.105270] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-08T19:27:05.105370] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPS took 22.5s. Estimated remaining: 3h 5m 55s. Rate: 7.1 symbols/min [2025-10-08T19:27:05.281340] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:05.299787] [DEBUG] [LOCAL ] HQL: Loaded 16555 existing records from primary storage. [2025-10-08T19:27:05.300038] [INFO ] [MAIN ] HQL: Loaded 16555 existing records. [2025-10-08T19:27:05.476668] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:05.476865] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-08T19:27:05.476911] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-08T19:27:05.477108] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-08T19:27:05.477165] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-08T19:27:05.622738] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-08T19:27:05.837677] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:06.417527] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-08T19:27:06.911372] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-08T19:27:07.045108] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T19:27:07.217582] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-08T19:27:07.642793] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T19:27:08.017608] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-08T19:27:08.218900] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T19:27:08.817594] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-08T19:27:09.617567] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-08T19:27:09.672374] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T19:27:10.389419] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:27:10.417494] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-08T19:27:10.501698] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T19:27:11.109810] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T19:27:11.217516] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-08T19:27:12.017562] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-08T19:27:12.211492] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T19:27:12.817550] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-08T19:27:13.539694] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T19:27:13.617495] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-08T19:27:13.657522] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:27:13.661401] [INFO ] [REMOTE ] HPP: Full fetch complete (73296 records). [2025-10-08T19:27:13.661502] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-08T19:27:14.062830] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-08T19:27:14.062918] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-08T19:27:14.063876] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-08T19:27:14.063939] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-08T19:27:14.065516] [DEBUG] [LOCAL ] HPP: Trimmed 73296 records to 51041 (keeping 200 days of data) [2025-10-08T19:27:14.372536] [DEBUG] [LOCAL ] HPP: Primary data saved (51041 records). [2025-10-08T19:27:14.372704] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-08T19:27:14.372806] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 48.5s. Estimated remaining: 3h 5m 48s. Rate: 7.1 symbols/min [2025-10-08T19:27:14.421179] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-08T19:27:14.566138] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:14.613905] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T19:27:14.640028] [DEBUG] [LOCAL ] HR: Loaded 51972 existing records from primary storage. [2025-10-08T19:27:14.640402] [INFO ] [MAIN ] HR: Loaded 51972 existing records. [2025-10-08T19:27:14.833467] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:14.833723] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-08T19:27:14.833782] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-08T19:27:14.834280] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-08T19:27:14.834337] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-08T19:27:15.208383] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:15.217496] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-08T19:27:15.421047] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T19:27:16.017591] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-08T19:27:16.817581] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-08T19:27:16.943611] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T19:27:17.475500] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T19:27:17.479437] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-08T19:27:17.479548] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-08T19:27:17.618787] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-08T19:27:17.648379] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T19:27:17.897314] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-08T19:27:17.897437] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-08T19:27:17.898415] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-08T19:27:17.898481] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-08T19:27:17.900087] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 53668 (keeping 200 days of data) [2025-10-08T19:27:18.233915] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-10-08T19:27:18.234061] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-08T19:27:18.234148] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPQ took 49.5s. Estimated remaining: 3h 5m 34s. Rate: 7.1 symbols/min [2025-10-08T19:27:18.400958] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:18.426155] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-08T19:27:18.446318] [DEBUG] [LOCAL ] HRB: Loaded 48437 existing records from primary storage. [2025-10-08T19:27:18.446626] [INFO ] [MAIN ] HRB: Loaded 48437 existing records. [2025-10-08T19:27:18.632991] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:18.633175] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-08T19:27:18.633222] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-08T19:27:18.633551] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-08T19:27:18.633609] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-08T19:27:19.000197] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:19.217516] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-08T19:27:19.286394] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:27:19.348095] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T19:27:20.017556] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-08T19:27:20.369844] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T19:27:20.817556] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-08T19:27:21.617531] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-08T19:27:21.738361] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T19:27:21.765523] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T19:27:22.417516] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-08T19:27:22.746680] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T19:27:23.217581] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-08T19:27:23.410693] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T19:27:24.017615] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-08T19:27:24.752172] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:27:24.817545] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-08T19:27:24.892426] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:27:24.895237] [INFO ] [REMOTE ] HQH: Full fetch complete (37404 records). [2025-10-08T19:27:24.895333] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-08T19:27:25.275906] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-08T19:27:25.276013] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-08T19:27:25.276746] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-08T19:27:25.276810] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-08T19:27:25.277770] [DEBUG] [LOCAL ] HQH: Trimmed 37404 records to 25511 (keeping 200 days of data) [2025-10-08T19:27:25.446010] [DEBUG] [LOCAL ] HQH: Primary data saved (25511 records). [2025-10-08T19:27:25.446214] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-08T19:27:25.446330] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HQH took 37.6s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-10-08T19:27:25.616885] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:25.617730] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-08T19:27:25.654124] [DEBUG] [LOCAL ] HRI: Loaded 32653 existing records from primary storage. [2025-10-08T19:27:25.654454] [INFO ] [MAIN ] HRI: Loaded 32653 existing records. [2025-10-08T19:27:25.838156] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:25.838413] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-08T19:27:25.838462] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-08T19:27:25.839096] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-08T19:27:25.839159] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-08T19:27:26.212129] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:26.277582] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:27:26.417556] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-08T19:27:26.596790] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T19:27:27.217585] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-08T19:27:27.461787] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T19:27:28.017587] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-08T19:27:28.754749] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T19:27:28.771556] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T19:27:28.773769] [INFO ] [REMOTE ] HQL: Full fetch complete (25093 records). [2025-10-08T19:27:28.773848] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-08T19:27:28.827707] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-08T19:27:29.152027] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-08T19:27:29.152114] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-08T19:27:29.152730] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-08T19:27:29.152795] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-08T19:27:29.153511] [DEBUG] [LOCAL ] HQL: Trimmed 25093 records to 16673 (keeping 200 days of data) [2025-10-08T19:27:29.257828] [DEBUG] [LOCAL ] HQL: Primary data saved (16673 records). [2025-10-08T19:27:29.258001] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-08T19:27:29.258092] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQL took 24.2s. Estimated remaining: 3h 5m 9s. Rate: 7.1 symbols/min [2025-10-08T19:27:29.426708] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:29.477147] [DEBUG] [LOCAL ] HRL: Loaded 53093 existing records from primary storage. [2025-10-08T19:27:29.477472] [INFO ] [MAIN ] HRL: Loaded 53093 existing records. [2025-10-08T19:27:29.622833] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-08T19:27:29.660217] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:29.660456] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-08T19:27:29.660502] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-08T19:27:29.660815] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-08T19:27:29.660874] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-08T19:27:30.023636] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:30.423014] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-08T19:27:30.448259] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T19:27:30.721112] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T19:27:31.217617] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-08T19:27:31.874584] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:27:32.017567] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-08T19:27:32.820258] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-08T19:27:32.825964] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T19:27:33.617540] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-08T19:27:33.769518] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T19:27:34.289777] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T19:27:34.417525] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-08T19:27:35.013959] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:27:35.217552] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-08T19:27:35.843432] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T19:27:36.017557] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-08T19:27:36.724137] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T19:27:36.817557] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-08T19:27:37.297542] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:27:37.617589] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-08T19:27:38.379140] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T19:27:38.417503] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-08T19:27:39.219973] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-08T19:27:39.223264] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:27:39.815009] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T19:27:40.017564] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-08T19:27:40.600984] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:27:40.817585] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-08T19:27:41.335102] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T19:27:41.617607] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-08T19:27:42.417517] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-08T19:27:42.669053] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T19:27:43.217521] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-08T19:27:43.407396] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:27:43.773036] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T19:27:44.017597] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-08T19:27:44.135845] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T19:27:44.817603] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-08T19:27:45.617550] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-08T19:27:45.950751] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T19:27:46.033780] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T19:27:46.417590] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-08T19:27:47.217525] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-08T19:27:47.252130] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T19:27:47.735032] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:27:48.017571] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-08T19:27:48.817539] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-08T19:27:48.885782] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:27:49.342235] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T19:27:49.617545] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-08T19:27:50.422894] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-08T19:27:50.425893] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T19:27:51.017390] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T19:27:51.020145] [INFO ] [REMOTE ] HRI: Full fetch complete (46248 records). [2025-10-08T19:27:51.020239] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-08T19:27:51.230145] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-08T19:27:51.447266] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-08T19:27:51.447354] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-08T19:27:51.448122] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-08T19:27:51.448186] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-08T19:27:51.449464] [DEBUG] [LOCAL ] HRI: Trimmed 46248 records to 32605 (keeping 200 days of data) [2025-10-08T19:27:51.658182] [DEBUG] [LOCAL ] HRI: Primary data saved (32605 records). [2025-10-08T19:27:51.658325] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-08T19:27:51.658407] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HRI took 26.2s. Estimated remaining: 3h 5m 19s. Rate: 7.1 symbols/min [2025-10-08T19:27:51.828748] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:51.862705] [DEBUG] [LOCAL ] HRTG: Loaded 33749 existing records from primary storage. [2025-10-08T19:27:51.863003] [INFO ] [MAIN ] HRTG: Loaded 33749 existing records. [2025-10-08T19:27:52.043978] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:52.044043] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-08T19:27:52.045365] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-08T19:27:52.045490] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-08T19:27:52.045867] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-08T19:27:52.045973] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-08T19:27:52.193965] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T19:27:52.450736] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:52.541303] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T19:27:52.817540] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-08T19:27:53.617562] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-08T19:27:53.783960] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:27:54.357688] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:27:54.417537] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-08T19:27:55.217533] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-08T19:27:55.378145] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T19:27:55.383813] [INFO ] [REMOTE ] HR: Full fetch complete (74840 records). [2025-10-08T19:27:55.383986] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-08T19:27:55.789027] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-08T19:27:55.789125] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-08T19:27:55.790177] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-08T19:27:55.790242] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-08T19:27:55.794164] [DEBUG] [LOCAL ] HR: Trimmed 74840 records to 51997 (keeping 200 days of data) [2025-10-08T19:27:56.018053] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-08T19:27:56.125606] [DEBUG] [LOCAL ] HR: Primary data saved (51997 records). [2025-10-08T19:27:56.125774] [INFO ] [MAIN ] HR: Full history saved. [2025-10-08T19:27:56.125885] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 41.8s. Estimated remaining: 3h 5m 5s. Rate: 7.1 symbols/min [2025-10-08T19:27:56.301916] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:56.302169] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-10-08T19:27:56.302241] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-10-08T19:27:56.302423] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-08T19:27:56.302497] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-08T19:27:56.302610] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-08T19:27:56.302691] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-08T19:27:56.516373] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T19:27:56.719479] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:56.764077] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:27:56.817491] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-08T19:27:57.137206] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T19:27:57.617558] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-08T19:27:58.419952] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-08T19:27:58.422343] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:27:59.197430] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T19:27:59.201103] [INFO ] [REMOTE ] HRB: Full fetch complete (69931 records). [2025-10-08T19:27:59.201201] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-08T19:27:59.222749] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-08T19:27:59.597542] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-08T19:27:59.597631] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-08T19:27:59.598622] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-08T19:27:59.598715] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-08T19:27:59.600172] [DEBUG] [LOCAL ] HRB: Trimmed 69931 records to 48391 (keeping 200 days of data) [2025-10-08T19:27:59.898522] [DEBUG] [LOCAL ] HRB: Primary data saved (48391 records). [2025-10-08T19:27:59.898697] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-08T19:27:59.898821] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRB took 41.7s. Estimated remaining: 3h 4m 51s. Rate: 7.1 symbols/min [2025-10-08T19:28:00.017564] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-08T19:28:00.078415] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:00.095040] [DEBUG] [LOCAL ] HSHP: Loaded 15141 existing records from primary storage. [2025-10-08T19:28:00.095310] [INFO ] [MAIN ] HSHP: Loaded 15141 existing records. [2025-10-08T19:28:00.295189] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:00.318682] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-08T19:28:00.321792] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-08T19:28:00.335102] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T19:28:00.348215] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T19:28:00.353512] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-08T19:28:00.353699] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-08T19:28:00.707847] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:00.817504] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-08T19:28:01.617580] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-08T19:28:01.655443] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:28:01.662971] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T19:28:01.668923] [INFO ] [REMOTE ] HRL: Full fetch complete (76686 records). [2025-10-08T19:28:01.669179] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-08T19:28:02.086551] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-08T19:28:02.086682] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-08T19:28:02.087774] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-08T19:28:02.087892] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-08T19:28:02.089702] [DEBUG] [LOCAL ] HRL: Trimmed 76686 records to 53097 (keeping 200 days of data) [2025-10-08T19:28:02.417539] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-08T19:28:02.441224] [DEBUG] [LOCAL ] HRL: Primary data saved (53097 records). [2025-10-08T19:28:02.441406] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-08T19:28:02.441538] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRL took 33.2s. Estimated remaining: 3h 4m 35s. Rate: 7.1 symbols/min [2025-10-08T19:28:02.615268] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:02.631857] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:28:02.685687] [DEBUG] [LOCAL ] HSY: Loaded 50359 existing records from primary storage. [2025-10-08T19:28:02.686076] [INFO ] [MAIN ] HSY: Loaded 50359 existing records. [2025-10-08T19:28:02.867714] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:02.867962] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-08T19:28:02.868012] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-08T19:28:02.869633] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-08T19:28:02.869719] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-08T19:28:03.222713] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-08T19:28:03.226690] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:28:03.246317] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:04.017573] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-08T19:28:04.820795] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-08T19:28:04.827879] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:28:05.617524] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-08T19:28:05.908770] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T19:28:05.996435] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T19:28:06.417567] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-08T19:28:07.217532] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-08T19:28:07.395289] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:28:08.017517] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-08T19:28:08.279847] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T19:28:08.339632] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T19:28:08.817547] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-08T19:28:09.617525] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-08T19:28:09.805270] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:28:10.417557] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-08T19:28:10.627870] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:28:10.814037] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T19:28:11.217561] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-08T19:28:11.735597] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T19:28:12.017554] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-08T19:28:12.780554] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T19:28:12.817517] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-08T19:28:12.827888] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T19:28:13.617618] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-08T19:28:14.417522] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-08T19:28:14.719492] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T19:28:14.968941] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T19:28:15.217560] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-08T19:28:15.599220] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:28:15.695202] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T19:28:16.017556] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-08T19:28:16.817535] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-08T19:28:17.467728] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T19:28:17.617634] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-08T19:28:17.820182] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:28:18.417572] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-08T19:28:19.138639] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T19:28:19.217494] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-08T19:28:19.376398] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:28:20.017707] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-08T19:28:20.820956] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-08T19:28:20.822526] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T19:28:20.871854] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T19:28:21.617550] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-08T19:28:22.250066] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T19:28:22.417575] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-08T19:28:23.217532] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-08T19:28:23.265472] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T19:28:24.017577] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-08T19:28:24.211080] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T19:28:24.334718] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T19:28:24.817516] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-08T19:28:25.363511] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:28:25.617551] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-08T19:28:26.303091] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T19:28:26.417511] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-08T19:28:27.220376] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-08T19:28:27.223712] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T19:28:28.017705] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-08T19:28:28.152805] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:28:28.589520] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T19:28:28.592974] [INFO ] [REMOTE ] HRTG: Full fetch complete (43382 records). [2025-10-08T19:28:28.593113] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-08T19:28:28.822666] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-08T19:28:29.008426] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-08T19:28:29.008542] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-08T19:28:29.009283] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-08T19:28:29.009346] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-08T19:28:29.010433] [DEBUG] [LOCAL ] HRTG: Trimmed 43382 records to 33817 (keeping 200 days of data) [2025-10-08T19:28:29.215763] [DEBUG] [LOCAL ] HRTG: Primary data saved (33817 records). [2025-10-08T19:28:29.215992] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-08T19:28:29.216169] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRTG took 37.6s. Estimated remaining: 3h 4m 50s. Rate: 7.1 symbols/min [2025-10-08T19:28:29.391192] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:29.391449] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-08T19:28:29.391580] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-08T19:28:29.391846] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-08T19:28:29.391988] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-08T19:28:29.392120] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-08T19:28:29.392175] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-08T19:28:29.627824] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-08T19:28:29.786404] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:29.788855] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T19:28:30.417606] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-08T19:28:30.598875] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:28:30.600300] [INFO ] [REMOTE ] HSHP: Full fetch complete (23231 records). [2025-10-08T19:28:30.600375] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-08T19:28:30.919257] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T19:28:31.014479] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-08T19:28:31.014576] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-08T19:28:31.015105] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-08T19:28:31.015168] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-08T19:28:31.016037] [DEBUG] [LOCAL ] HSHP: Trimmed 23231 records to 15044 (keeping 200 days of data) [2025-10-08T19:28:31.106058] [DEBUG] [LOCAL ] HSHP: Primary data saved (15044 records). [2025-10-08T19:28:31.106239] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-08T19:28:31.106395] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HSHP took 31.2s. Estimated remaining: 3h 4m 33s. Rate: 7.1 symbols/min [2025-10-08T19:28:31.222684] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-08T19:28:31.281939] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:31.297269] [DEBUG] [LOCAL ] HTD: Loaded 13918 existing records from primary storage. [2025-10-08T19:28:31.297524] [INFO ] [MAIN ] HTD: Loaded 13918 existing records. [2025-10-08T19:28:31.474258] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:31.474491] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-08T19:28:31.474537] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-08T19:28:31.475159] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-08T19:28:31.475237] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-08T19:28:31.519735] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:28:31.558344] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-08T19:28:31.580257] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:28:31.580421] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-08T19:28:31.580574] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:28:31.581077] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-08T19:28:31.596985] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-08T19:28:31.602215] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-08T19:28:31.631624] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-08T19:28:31.668790] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HTB took 2.5s. Estimated remaining: 3h 4m 15s. Rate: 7.1 symbols/min [2025-10-08T19:28:32.035187] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-08T19:28:32.035099] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:32.041394] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:32.043319] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-08T19:28:32.043576] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-08T19:28:32.043784] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-08T19:28:32.043884] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-08T19:28:32.044120] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-08T19:28:32.044206] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-08T19:28:32.336787] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T19:28:32.470069] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:32.817794] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-08T19:28:33.617631] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-08T19:28:33.800352] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T19:28:33.973103] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T19:28:34.288464] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T19:28:34.292499] [INFO ] [REMOTE ] HSY: Full fetch complete (73529 records). [2025-10-08T19:28:34.292679] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-08T19:28:34.433837] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-08T19:28:34.699283] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-08T19:28:34.699369] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-08T19:28:34.700377] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-08T19:28:34.700446] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-08T19:28:34.701969] [DEBUG] [LOCAL ] HSY: Trimmed 73529 records to 50345 (keeping 200 days of data) [2025-10-08T19:28:34.798034] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-08T19:28:35.032129] [DEBUG] [LOCAL ] HSY: Primary data saved (50345 records). [2025-10-08T19:28:35.032345] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-08T19:28:35.033342] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSY took 32.6s. Estimated remaining: 3h 4m 0s. Rate: 7.1 symbols/min [2025-10-08T19:28:35.201455] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:35.226421] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-08T19:28:35.250426] [DEBUG] [LOCAL ] HTGC: Loaded 47448 existing records from primary storage. [2025-10-08T19:28:35.250774] [INFO ] [MAIN ] HTGC: Loaded 47448 existing records. [2025-10-08T19:28:35.425555] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:35.425857] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-08T19:28:35.425917] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-08T19:28:35.427253] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-08T19:28:35.427314] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-08T19:28:35.599153] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-08T19:28:35.798712] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:36.017566] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-08T19:28:36.817574] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-08T19:28:37.130517] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-08T19:28:37.617547] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-08T19:28:37.674532] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T19:28:38.042777] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-08T19:28:38.417561] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-08T19:28:38.732607] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T19:28:39.217620] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-08T19:28:40.017559] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-08T19:28:40.051904] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T19:28:40.256319] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-08T19:28:40.817560] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-08T19:28:41.617593] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-08T19:28:41.671687] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T19:28:42.417555] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-08T19:28:42.650280] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-08T19:28:43.095446] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T19:28:43.099199] [INFO ] [REMOTE ] HSBC: Full fetch complete (73796 records). [2025-10-08T19:28:43.099297] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-08T19:28:43.222705] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-08T19:28:43.484516] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-08T19:28:43.484599] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-08T19:28:43.485510] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-08T19:28:43.485573] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-08T19:28:43.486960] [DEBUG] [LOCAL ] HSBC: Trimmed 73796 records to 50946 (keeping 200 days of data) [2025-10-08T19:28:43.554681] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-08T19:28:43.803473] [DEBUG] [LOCAL ] HSBC: Primary data saved (50946 records). [2025-10-08T19:28:43.803625] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-08T19:28:43.803739] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSBC took 47.7s. Estimated remaining: 3h 3m 52s. Rate: 7.1 symbols/min [2025-10-08T19:28:43.977499] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:44.009259] [DEBUG] [LOCAL ] HTH: Loaded 32391 existing records from primary storage. [2025-10-08T19:28:44.009546] [INFO ] [MAIN ] HTH: Loaded 32391 existing records. [2025-10-08T19:28:44.022637] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-08T19:28:44.190047] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:44.190281] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-08T19:28:44.190328] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-08T19:28:44.191282] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-08T19:28:44.191342] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-08T19:28:44.583724] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:44.817534] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-08T19:28:45.617529] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-08T19:28:45.667741] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T19:28:45.744605] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T19:28:46.421450] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-08T19:28:46.422616] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T19:28:46.763132] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-08T19:28:47.217547] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-08T19:28:48.017583] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-08T19:28:48.817526] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-08T19:28:48.854852] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T19:28:49.617509] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-08T19:28:49.885751] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T19:28:50.417618] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-08T19:28:50.517027] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T19:28:51.217579] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-08T19:28:51.238058] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (4.02 seconds). [2025-10-08T19:28:51.239031] [INFO ] [REMOTE ] HTFC: Full fetch complete (846 records). [2025-10-08T19:28:51.239106] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-08T19:28:51.425202] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-08T19:28:51.425475] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:28:51.425712] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:28:51.425800] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-08T19:28:51.425964] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-08T19:28:51.426025] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-08T19:28:51.426131] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-08T19:28:51.426214] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTFC took 19.7s. Estimated remaining: 3h 3m 43s. Rate: 7.1 symbols/min [2025-10-08T19:28:51.601882] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:51.625729] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T19:28:51.666955] [DEBUG] [LOCAL ] HUBB: Loaded 36598 existing records from primary storage. [2025-10-08T19:28:51.667272] [INFO ] [MAIN ] HUBB: Loaded 36598 existing records. [2025-10-08T19:28:51.869686] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:51.871466] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-08T19:28:51.871269] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T19:28:51.871625] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-08T19:28:51.876818] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-08T19:28:51.876881] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-08T19:28:52.022764] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-08T19:28:52.225807] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:52.817508] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-08T19:28:53.049810] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T19:28:53.617510] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-08T19:28:53.669951] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T19:28:54.417588] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-08T19:28:54.765290] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T19:28:55.217596] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-08T19:28:55.377678] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T19:28:56.017573] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-08T19:28:56.733700] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T19:28:56.817606] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-08T19:28:57.620667] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-08T19:28:57.625236] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:28:58.064871] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:28:58.227067] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T19:28:58.417578] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-08T19:28:59.217534] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-08T19:29:00.009353] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:29:00.017893] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-08T19:29:00.027321] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T19:29:00.817534] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-08T19:29:01.530345] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T19:29:01.617503] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-08T19:29:02.422700] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-08T19:29:02.445262] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T19:29:02.964200] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T19:29:03.217545] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-08T19:29:03.787544] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T19:29:04.017554] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-08T19:29:04.481043] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:29:04.817682] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-08T19:29:05.297735] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:29:05.617576] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-08T19:29:06.142054] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:29:06.417527] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-08T19:29:07.109215] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T19:29:07.217553] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-08T19:29:07.476857] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:29:08.017562] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-08T19:29:08.797387] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:29:08.817520] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-08T19:29:08.985108] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:29:08.987253] [INFO ] [REMOTE ] HTD: Full fetch complete (19149 records). [2025-10-08T19:29:08.987353] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-08T19:29:09.375766] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-08T19:29:09.375879] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-08T19:29:09.376691] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-08T19:29:09.376768] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-08T19:29:09.377558] [DEBUG] [LOCAL ] HTD: Trimmed 19149 records to 13925 (keeping 200 days of data) [2025-10-08T19:29:09.461763] [DEBUG] [LOCAL ] HTD: Primary data saved (13925 records). [2025-10-08T19:29:09.461905] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-08T19:29:09.462002] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTD took 38.4s. Estimated remaining: 3h 3m 46s. Rate: 7.1 symbols/min [2025-10-08T19:29:09.625743] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-08T19:29:09.628281] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:09.668366] [DEBUG] [LOCAL ] HUBS: Loaded 39612 existing records from primary storage. [2025-10-08T19:29:09.668727] [INFO ] [MAIN ] HUBS: Loaded 39612 existing records. [2025-10-08T19:29:09.846989] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:09.847269] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-08T19:29:09.847324] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-08T19:29:09.848608] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-08T19:29:09.848696] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-08T19:29:10.203049] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:10.417516] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-08T19:29:10.574404] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T19:29:10.903135] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:29:11.217534] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-08T19:29:11.808947] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T19:29:12.017553] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-08T19:29:12.258744] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T19:29:12.817552] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-08T19:29:13.392007] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:29:13.617556] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-08T19:29:13.894056] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T19:29:14.417549] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-08T19:29:15.051614] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T19:29:15.217542] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-08T19:29:15.960928] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:29:16.017494] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-08T19:29:16.377978] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T19:29:16.382419] [INFO ] [REMOTE ] HTGC: Full fetch complete (68401 records). [2025-10-08T19:29:16.382541] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-08T19:29:16.823288] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-08T19:29:16.826731] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-08T19:29:16.827667] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-08T19:29:16.828595] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-08T19:29:16.828724] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-08T19:29:16.830326] [DEBUG] [LOCAL ] HTGC: Trimmed 68401 records to 47466 (keeping 200 days of data) [2025-10-08T19:29:17.127142] [DEBUG] [LOCAL ] HTGC: Primary data saved (47466 records). [2025-10-08T19:29:17.127263] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-08T19:29:17.127349] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTGC took 42.1s. Estimated remaining: 3h 3m 37s. Rate: 7.1 symbols/min [2025-10-08T19:29:17.302372] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:17.348589] [DEBUG] [LOCAL ] HUM: Loaded 48999 existing records from primary storage. [2025-10-08T19:29:17.349079] [INFO ] [MAIN ] HUM: Loaded 48999 existing records. [2025-10-08T19:29:17.468302] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T19:29:17.564966] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:17.565194] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-08T19:29:17.565244] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-08T19:29:17.567000] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-08T19:29:17.567062] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-08T19:29:17.635440] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-08T19:29:17.925711] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:18.100126] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:29:18.417563] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-08T19:29:19.008684] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T19:29:19.217576] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-08T19:29:20.017531] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-08T19:29:20.190148] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:29:20.822885] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-08T19:29:20.828437] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T19:29:21.194225] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T19:29:21.197291] [INFO ] [REMOTE ] HTH: Full fetch complete (46816 records). [2025-10-08T19:29:21.197407] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-08T19:29:21.613344] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-08T19:29:21.613467] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-08T19:29:21.614593] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-08T19:29:21.614684] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-08T19:29:21.616225] [DEBUG] [LOCAL ] HTH: Trimmed 46816 records to 32417 (keeping 200 days of data) [2025-10-08T19:29:21.617849] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-08T19:29:21.827536] [DEBUG] [LOCAL ] HTH: Primary data saved (32417 records). [2025-10-08T19:29:21.827703] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-08T19:29:21.827798] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 38.0s. Estimated remaining: 3h 3m 24s. Rate: 7.1 symbols/min [2025-10-08T19:29:21.985360] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T19:29:22.053052] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:22.110204] [DEBUG] [LOCAL ] HUN: Loaded 53204 existing records from primary storage. [2025-10-08T19:29:22.110531] [INFO ] [MAIN ] HUN: Loaded 53204 existing records. [2025-10-08T19:29:22.288132] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:22.288367] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-08T19:29:22.288413] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-08T19:29:22.290157] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-08T19:29:22.290217] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-08T19:29:22.426519] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-08T19:29:22.639963] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:22.955783] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T19:29:23.217546] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-08T19:29:23.785438] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T19:29:23.788327] [INFO ] [REMOTE ] HUBB: Full fetch complete (53875 records). [2025-10-08T19:29:23.788420] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-08T19:29:24.028442] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-08T19:29:24.167530] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-08T19:29:24.167704] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-08T19:29:24.173189] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-08T19:29:24.173455] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-08T19:29:24.176004] [DEBUG] [LOCAL ] HUBB: Trimmed 53875 records to 36591 (keeping 200 days of data) [2025-10-08T19:29:24.409479] [DEBUG] [LOCAL ] HUBB: Primary data saved (36591 records). [2025-10-08T19:29:24.409637] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-08T19:29:24.409766] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 33.0s. Estimated remaining: 3h 3m 8s. Rate: 7.1 symbols/min [2025-10-08T19:29:24.582020] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:24.627244] [DEBUG] [LOCAL ] HUYA: Loaded 43908 existing records from primary storage. [2025-10-08T19:29:24.627588] [INFO ] [MAIN ] HUYA: Loaded 43908 existing records. [2025-10-08T19:29:24.818226] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-08T19:29:24.818056] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:24.819965] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-08T19:29:24.820128] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-08T19:29:24.821681] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-08T19:29:24.821923] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-08T19:29:25.150171] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T19:29:25.245027] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:25.493237] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T19:29:25.617592] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-08T19:29:26.377163] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T19:29:26.417561] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-08T19:29:27.161811] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:29:27.217544] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-08T19:29:28.017578] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-08T19:29:28.089680] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T19:29:28.694639] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T19:29:28.817566] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-08T19:29:29.416348] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T19:29:29.617562] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-08T19:29:30.280219] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:29:30.417545] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-08T19:29:31.217526] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-08T19:29:31.311435] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T19:29:32.017571] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-08T19:29:32.239548] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T19:29:32.758840] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:29:32.817513] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-08T19:29:33.048581] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T19:29:33.617619] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-08T19:29:34.417523] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-08T19:29:34.501485] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T19:29:35.206152] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:29:35.217494] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-08T19:29:36.017522] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-08T19:29:36.400240] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T19:29:36.509072] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T19:29:36.817613] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-08T19:29:37.282678] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T19:29:37.617563] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-08T19:29:38.417540] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-08T19:29:38.484256] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:29:39.107394] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:29:39.217533] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-08T19:29:39.755035] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T19:29:40.017549] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-08T19:29:40.782696] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T19:29:40.786900] [INFO ] [REMOTE ] HUBS: Full fetch complete (55921 records). [2025-10-08T19:29:40.787033] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-08T19:29:40.823106] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-08T19:29:41.191874] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-08T19:29:41.192201] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-08T19:29:41.193019] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-08T19:29:41.193083] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-08T19:29:41.194320] [DEBUG] [LOCAL ] HUBS: Trimmed 55921 records to 39673 (keeping 200 days of data) [2025-10-08T19:29:41.436843] [DEBUG] [LOCAL ] HUBS: Primary data saved (39673 records). [2025-10-08T19:29:41.437009] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-08T19:29:41.437097] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBS took 32.0s. Estimated remaining: 3h 3m 10s. Rate: 7.1 symbols/min [2025-10-08T19:29:41.604431] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:41.620182] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-08T19:29:41.620554] [DEBUG] [LOCAL ] HVT: Loaded 15322 existing records from primary storage. [2025-10-08T19:29:41.621564] [INFO ] [MAIN ] HVT: Loaded 15322 existing records. [2025-10-08T19:29:41.810291] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:41.810830] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-08T19:29:41.810956] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-08T19:29:41.812079] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-08T19:29:41.812142] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-08T19:29:42.173072] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T19:29:42.238440] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:42.417576] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-08T19:29:42.617676] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T19:29:42.833611] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:29:43.217627] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-08T19:29:43.421989] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T19:29:44.017577] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-08T19:29:44.614510] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T19:29:44.817525] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-08T19:29:44.969164] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T19:29:45.617552] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-08T19:29:46.263557] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T19:29:46.417540] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-08T19:29:46.610854] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T19:29:47.217574] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-08T19:29:48.023054] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-08T19:29:48.028955] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T19:29:48.782833] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:29:48.817503] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-08T19:29:49.617568] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-08T19:29:49.765035] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:29:50.269300] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:29:50.417510] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-08T19:29:50.453111] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T19:29:51.217549] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-08T19:29:52.017533] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-08T19:29:52.179510] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T19:29:52.817568] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-08T19:29:53.043310] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T19:29:53.306556] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T19:29:53.617550] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-08T19:29:53.874050] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:29:54.417572] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-08T19:29:55.217583] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-08T19:29:55.239465] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T19:29:55.243451] [INFO ] [REMOTE ] HUN: Full fetch complete (76726 records). [2025-10-08T19:29:55.243606] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-08T19:29:55.698623] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-08T19:29:55.698826] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-08T19:29:55.699969] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-08T19:29:55.700035] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-08T19:29:55.703632] [DEBUG] [LOCAL ] HUN: Trimmed 76726 records to 53202 (keeping 200 days of data) [2025-10-08T19:29:55.957277] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T19:29:56.020713] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-08T19:29:56.071419] [DEBUG] [LOCAL ] HUN: Primary data saved (53202 records). [2025-10-08T19:29:56.071543] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-08T19:29:56.071637] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUN took 34.2s. Estimated remaining: 3h 3m 10s. Rate: 7.1 symbols/min [2025-10-08T19:29:56.261228] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:56.313401] [DEBUG] [LOCAL ] HWM: Loaded 52904 existing records from primary storage. [2025-10-08T19:29:56.313754] [INFO ] [MAIN ] HWM: Loaded 52904 existing records. [2025-10-08T19:29:56.502920] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:56.503150] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-08T19:29:56.503247] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-08T19:29:56.503492] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-08T19:29:56.503548] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-08T19:29:56.808222] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T19:29:56.818919] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-08T19:29:56.882279] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:56.882442] [INFO ] [REMOTE ] HUM: Full fetch complete (70990 records). [2025-10-08T19:29:56.882606] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-08T19:29:57.249027] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T19:29:57.264596] [INFO ] [REMOTE ] HUYA: Full fetch complete (63778 records). [2025-10-08T19:29:57.282085] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-08T19:29:57.282233] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-08T19:29:57.282445] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-08T19:29:57.283473] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-08T19:29:57.283564] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-08T19:29:57.390209] [DEBUG] [LOCAL ] HUM: Trimmed 70990 records to 49032 (keeping 200 days of data) [2025-10-08T19:29:57.624732] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-08T19:29:57.906790] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-08T19:29:57.912139] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-08T19:29:57.913226] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-08T19:29:57.925206] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-08T19:29:57.934951] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T19:29:57.945230] [DEBUG] [LOCAL ] HUYA: Trimmed 63778 records to 43890 (keeping 200 days of data) [2025-10-08T19:29:58.271001] [DEBUG] [LOCAL ] HUYA: Primary data saved (43890 records). [2025-10-08T19:29:58.271697] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-08T19:29:58.271856] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUYA took 33.9s. Estimated remaining: 3h 2m 54s. Rate: 7.1 symbols/min [2025-10-08T19:29:58.347036] [DEBUG] [LOCAL ] HUM: Primary data saved (49032 records). [2025-10-08T19:29:58.369720] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-08T19:29:58.370942] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUM took 41.2s. Estimated remaining: 3h 2m 35s. Rate: 7.1 symbols/min [2025-10-08T19:29:58.422082] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-08T19:29:58.586343] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:58.632075] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:58.642935] [DEBUG] [LOCAL ] HY: Loaded 10004 existing records from primary storage. [2025-10-08T19:29:58.643267] [INFO ] [MAIN ] HY: Loaded 10004 existing records. [2025-10-08T19:29:58.835640] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:58.848302] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-08T19:29:58.848386] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-08T19:29:58.849153] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-08T19:29:58.849112] [DEBUG] [LOCAL ] HXL: Loaded 45917 existing records from primary storage. [2025-10-08T19:29:58.849273] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-08T19:29:58.875882] [INFO ] [MAIN ] HXL: Loaded 45917 existing records. [2025-10-08T19:29:59.269561] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:59.299036] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-08T19:29:59.326601] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-08T19:29:59.344014] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-08T19:29:59.364237] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-08T19:29:59.576040] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:59.576769] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-08T19:29:59.801094] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-08T19:29:59.865133] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T19:29:59.900106] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:00.017554] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-08T19:30:00.440349] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T19:30:00.817550] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-08T19:30:01.341782] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T19:30:01.617703] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-08T19:30:02.417519] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-08T19:30:02.834931] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-08T19:30:03.170920] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:30:03.217533] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-08T19:30:03.275785] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T19:30:03.819819] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T19:30:04.017560] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-08T19:30:04.817616] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-08T19:30:05.481812] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T19:30:05.496672] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T19:30:05.617540] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-08T19:30:06.417589] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-08T19:30:07.062499] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T19:30:07.113376] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T19:30:07.217547] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-08T19:30:08.017530] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-08T19:30:08.099805] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T19:30:08.817535] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-08T19:30:09.617520] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-08T19:30:09.794617] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:30:10.319533] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T19:30:10.382506] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T19:30:10.417504] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-08T19:30:11.217611] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-08T19:30:11.817440] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:30:11.982343] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T19:30:12.017510] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-08T19:30:12.565206] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T19:30:12.817554] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-08T19:30:13.617576] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-08T19:30:13.670048] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T19:30:14.417558] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-08T19:30:14.445840] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T19:30:15.217587] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-08T19:30:16.017526] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-08T19:30:16.080486] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T19:30:16.123358] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T19:30:16.817544] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-08T19:30:17.617517] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-08T19:30:17.758128] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T19:30:18.292887] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T19:30:18.417516] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-08T19:30:18.458020] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T19:30:19.217559] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-08T19:30:19.228033] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T19:30:19.230290] [INFO ] [REMOTE ] HVT: Full fetch complete (23274 records). [2025-10-08T19:30:19.230470] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-08T19:30:19.634296] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-08T19:30:19.634418] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-08T19:30:19.635394] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-08T19:30:19.635523] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-08T19:30:19.637571] [DEBUG] [LOCAL ] HVT: Trimmed 23274 records to 15297 (keeping 200 days of data) [2025-10-08T19:30:19.737559] [DEBUG] [LOCAL ] HVT: Primary data saved (15297 records). [2025-10-08T19:30:19.737742] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-08T19:30:19.737853] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 38.3s. Estimated remaining: 3h 2m 42s. Rate: 7.1 symbols/min [2025-10-08T19:30:19.903965] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:19.904146] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-08T19:30:19.904184] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-08T19:30:19.904297] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-08T19:30:19.904337] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-08T19:30:19.904378] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-08T19:30:19.904410] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-08T19:30:20.022743] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-08T19:30:20.258948] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:20.697773] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T19:30:20.817571] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-08T19:30:21.047992] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T19:30:21.617547] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-08T19:30:22.057749] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T19:30:22.417584] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-08T19:30:23.217599] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-08T19:30:23.475288] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-08T19:30:23.640631] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T19:30:23.661415] [INFO ] [REMOTE ] HY: Full fetch complete (15137 records). [2025-10-08T19:30:23.662860] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-08T19:30:23.665562] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-08T19:30:24.019332] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-08T19:30:24.050145] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-08T19:30:24.050264] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-08T19:30:24.050778] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-08T19:30:24.050843] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-08T19:30:24.051548] [DEBUG] [LOCAL ] HY: Trimmed 15137 records to 9989 (keeping 200 days of data) [2025-10-08T19:30:24.117005] [DEBUG] [LOCAL ] HY: Primary data saved (9989 records). [2025-10-08T19:30:24.117150] [INFO ] [MAIN ] HY: Full history saved. [2025-10-08T19:30:24.117289] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HY took 25.7s. Estimated remaining: 3h 2m 29s. Rate: 7.1 symbols/min [2025-10-08T19:30:24.285985] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:24.286228] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-08T19:30:24.286279] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-08T19:30:24.286424] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-08T19:30:24.286469] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-08T19:30:24.286512] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-08T19:30:24.286545] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-08T19:30:24.365731] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T19:30:24.647593] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:24.817607] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-08T19:30:25.101054] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-08T19:30:25.617579] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-08T19:30:25.883847] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-08T19:30:26.417592] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-08T19:30:26.740583] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-08T19:30:27.217563] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-08T19:30:28.017575] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-08T19:30:28.238692] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-08T19:30:28.736174] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T19:30:28.817563] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-08T19:30:29.147052] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-08T19:30:29.617563] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-08T19:30:29.971676] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-08T19:30:30.417557] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-08T19:30:31.217565] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-08T19:30:31.776915] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T19:30:31.780841] [INFO ] [REMOTE ] HXL: Full fetch complete (66280 records). [2025-10-08T19:30:31.780997] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-08T19:30:32.022771] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-08T19:30:32.184031] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-08T19:30:32.184153] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-08T19:30:32.185135] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-08T19:30:32.185199] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-08T19:30:32.186772] [DEBUG] [LOCAL ] HXL: Trimmed 66280 records to 45893 (keeping 200 days of data) [2025-10-08T19:30:32.423462] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T19:30:32.473309] [DEBUG] [LOCAL ] HXL: Primary data saved (45893 records). [2025-10-08T19:30:32.473463] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-08T19:30:32.473565] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HXL took 34.2s. Estimated remaining: 3h 2m 20s. Rate: 7.1 symbols/min [2025-10-08T19:30:32.647210] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:32.659911] [DEBUG] [LOCAL ] HYI: Loaded 9882 existing records from primary storage. [2025-10-08T19:30:32.660182] [INFO ] [MAIN ] HYI: Loaded 9882 existing records. [2025-10-08T19:30:32.821699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-08T19:30:32.852848] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:30:32.853956] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-08T19:30:32.854007] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-08T19:30:32.854183] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-08T19:30:32.854240] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-08T19:30:33.256962] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:33.313717] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-08T19:30:33.380463] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T19:30:33.617560] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-08T19:30:34.166585] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T19:30:34.417578] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-08T19:30:34.650320] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-08T19:30:35.217612] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-08T19:30:35.439865] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-08T19:30:36.017627] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-08T19:30:36.601538] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T19:30:36.817557] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-08T19:30:37.359359] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T19:30:37.617629] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-08T19:30:37.917761] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-08T19:30:38.417614] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-08T19:30:38.720016] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-08T19:30:38.720797] [INFO ] [REMOTE ] HYAC: Full fetch complete (869 records). [2025-10-08T19:30:38.720871] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-08T19:30:38.721234] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T19:30:38.721347] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:30:38.721391] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:30:38.721443] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-08T19:30:38.721550] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-08T19:30:38.721621] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-08T19:30:38.721733] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-08T19:30:38.721814] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 19.0s. Estimated remaining: 3h 2m 9s. Rate: 7.1 symbols/min [2025-10-08T19:30:38.897872] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:38.935526] [DEBUG] [LOCAL ] HYT: Loaded 33699 existing records from primary storage. [2025-10-08T19:30:38.935876] [INFO ] [MAIN ] HYT: Loaded 33699 existing records. [2025-10-08T19:30:39.171148] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:30:39.171428] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-08T19:30:39.171484] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-08T19:30:39.172006] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-08T19:30:39.172066] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-08T19:30:39.222718] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-08T19:30:39.542344] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:39.545880] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-08T19:30:40.017567] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-08T19:30:40.318466] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-08T19:30:40.817549] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-08T19:30:41.617549] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-08T19:30:42.417558] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-08T19:30:42.677341] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T19:30:42.749232] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-08T19:30:42.831611] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T19:30:43.217558] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-08T19:30:44.017586] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-08T19:30:44.125929] [DEBUG] [REMOTE ] HYT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-08T19:30:44.126232] [WARN ] [REMOTE ] HYT: No data returned for month 2025-01 [2025-10-08T19:30:44.126322] [FATAL] [REMOTE ] HYT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:30:44.126442] [FATAL] [MAIN ] HYT: Failed to fetch primary data. [2025-10-08T19:30:44.126510] [WARN ] [MAIN ] HYT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:30:44.126580] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-08T19:30:44.126665] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-08T19:30:44.126723] [INFO ] [LOCAL ] HYT: Starting deletion of derivative data. [2025-10-08T19:30:44.126963] [DEBUG] [LOCAL ] HYT: Deleted derivative data file. [2025-10-08T19:30:44.127048] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HYT took 5.4s. Estimated remaining: 3h 1m 57s. Rate: 7.1 symbols/min [2025-10-08T19:30:44.295714] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:44.301186] [DEBUG] [LOCAL ] HYTR: Loaded 3134 existing records from primary storage. [2025-10-08T19:30:44.301375] [INFO ] [MAIN ] HYTR: Loaded 3134 existing records. [2025-10-08T19:30:44.475791] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:30:44.476024] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-08T19:30:44.476070] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-08T19:30:44.476229] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-08T19:30:44.476285] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-08T19:30:44.823036] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-08T19:30:44.827876] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:44.956779] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:30:45.417478] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T19:30:45.617587] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-08T19:30:46.007289] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-08T19:30:46.417591] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-08T19:30:46.746729] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-08T19:30:47.217572] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-08T19:30:47.647233] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-08T19:30:48.017563] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-08T19:30:48.396429] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-08T19:30:48.817577] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-08T19:30:49.617596] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-08T19:30:49.898268] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-08T19:30:50.417537] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-08T19:30:50.507599] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T19:30:51.049715] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-08T19:30:51.217570] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-08T19:30:52.017577] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-08T19:30:52.540006] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T19:30:52.774774] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T19:30:52.778719] [INFO ] [REMOTE ] HWM: Full fetch complete (76572 records). [2025-10-08T19:30:52.778867] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-08T19:30:52.822680] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-08T19:30:53.198739] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-08T19:30:53.198845] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-08T19:30:53.200260] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-08T19:30:53.200325] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-08T19:30:53.201878] [DEBUG] [LOCAL ] HWM: Trimmed 76572 records to 52895 (keeping 200 days of data) [2025-10-08T19:30:53.306684] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-08T19:30:53.549207] [DEBUG] [LOCAL ] HWM: Primary data saved (52895 records). [2025-10-08T19:30:53.549364] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-08T19:30:53.549471] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HWM took 57.5s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-08T19:30:53.622680] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-08T19:30:53.720581] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:53.748526] [DEBUG] [LOCAL ] HZO: Loaded 29133 existing records from primary storage. [2025-10-08T19:30:53.748862] [INFO ] [MAIN ] HZO: Loaded 29133 existing records. [2025-10-08T19:30:53.924942] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:30:53.925128] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-08T19:30:53.925173] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-08T19:30:53.925414] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-08T19:30:53.925472] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-08T19:30:54.033936] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T19:30:54.291990] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:54.417598] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-08T19:30:55.124464] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T19:30:55.217585] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-08T19:30:55.738351] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T19:30:56.017567] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-08T19:30:56.817529] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-08T19:30:56.859280] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T19:30:57.377363] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T19:30:57.617550] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-08T19:30:58.417578] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-08T19:30:58.840183] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T19:30:59.024135] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:30:59.217603] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-08T19:30:59.624043] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T19:30:59.624753] [INFO ] [REMOTE ] HYBX: Full fetch complete (729 records). [2025-10-08T19:30:59.624822] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-08T19:30:59.799672] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-08T19:30:59.799865] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:30:59.799970] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:30:59.800043] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-08T19:30:59.800121] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-08T19:30:59.800185] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-08T19:30:59.800240] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-08T19:30:59.800318] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYBX took 35.7s. Estimated remaining: 3h 1m 39s. Rate: 7.1 symbols/min [2025-10-08T19:30:59.972585] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:59.981353] [DEBUG] [LOCAL ] IAE: Loaded 6054 existing records from primary storage. [2025-10-08T19:30:59.981582] [INFO ] [MAIN ] IAE: Loaded 6054 existing records. [2025-10-08T19:31:00.022850] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-08T19:31:00.161121] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:00.161360] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-08T19:31:00.161408] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-08T19:31:00.161568] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-08T19:31:00.161627] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-08T19:31:00.546168] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:00.817539] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-08T19:31:01.256259] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:31:01.490019] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T19:31:01.617569] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-08T19:31:02.417570] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-08T19:31:02.852560] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T19:31:03.036019] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T19:31:03.217549] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-08T19:31:04.017559] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-08T19:31:04.549539] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T19:31:04.786706] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:31:04.817605] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-08T19:31:05.516799] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T19:31:05.617588] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-08T19:31:06.374280] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:31:06.417499] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-08T19:31:07.217540] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-08T19:31:07.227948] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T19:31:08.017519] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-08T19:31:08.418604] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T19:31:08.567866] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T19:31:08.570058] [INFO ] [REMOTE ] HYI: Full fetch complete (13934 records). [2025-10-08T19:31:08.570136] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-08T19:31:08.822679] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-08T19:31:08.985542] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-08T19:31:08.985681] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-08T19:31:08.986293] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-08T19:31:08.986379] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-08T19:31:08.987329] [DEBUG] [LOCAL ] HYI: Trimmed 13934 records to 9914 (keeping 200 days of data) [2025-10-08T19:31:09.051399] [DEBUG] [LOCAL ] HYI: Primary data saved (9914 records). [2025-10-08T19:31:09.051543] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-08T19:31:09.051686] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYI took 36.6s. Estimated remaining: 3h 1m 32s. Rate: 7.1 symbols/min [2025-10-08T19:31:09.537897] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T19:31:09.617518] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-08T19:31:10.006741] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-08T19:31:10.417543] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-08T19:31:11.217561] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-08T19:31:11.420785] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:31:11.589844] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-08T19:31:12.017516] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-08T19:31:12.716438] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T19:31:12.817552] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-08T19:31:13.617560] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-08T19:31:13.883871] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T19:31:14.213181] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:31:14.417596] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-08T19:31:14.801829] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T19:31:15.217567] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-08T19:31:15.568414] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-08T19:31:16.017580] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-08T19:31:16.817553] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-08T19:31:17.292920] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T19:31:17.306849] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T19:31:17.617717] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-08T19:31:18.273547] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T19:31:18.417536] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-08T19:31:19.177181] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:31:19.217546] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-08T19:31:19.725589] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T19:31:19.726767] [INFO ] [REMOTE ] IAE: Full fetch complete (8754 records). [2025-10-08T19:31:19.726838] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-08T19:31:20.022757] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-08T19:31:20.090894] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-08T19:31:20.091004] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-08T19:31:20.091273] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-08T19:31:20.091382] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-08T19:31:20.092031] [DEBUG] [LOCAL ] IAE: Trimmed 8754 records to 6125 (keeping 200 days of data) [2025-10-08T19:31:20.129389] [DEBUG] [LOCAL ] IAE: Primary data saved (6125 records). [2025-10-08T19:31:20.129530] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-08T19:31:20.129617] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. IAE took 20.3s. Estimated remaining: 3h 1m 27s. Rate: 7.1 symbols/min [2025-10-08T19:31:20.817558] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-08T19:31:21.287113] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:31:21.300225] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-08T19:31:21.617561] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-08T19:31:22.417562] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-08T19:31:22.808002] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T19:31:22.808962] [INFO ] [REMOTE ] HYTR: Full fetch complete (4598 records). [2025-10-08T19:31:22.809033] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-08T19:31:22.894637] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T19:31:22.920778] [INFO ] [REMOTE ] HZO: Full fetch complete (41086 records). [2025-10-08T19:31:22.931490] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-08T19:31:23.511562] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-08T19:31:23.521867] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-08T19:31:23.522438] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-08T19:31:23.523214] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-08T19:31:23.575228] [DEBUG] [LOCAL ] HYTR: Trimmed 4598 records to 3113 (keeping 200 days of data) [2025-10-08T19:31:23.632112] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-08T19:31:23.633210] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-08T19:31:23.634378] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-08T19:31:23.634823] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-08T19:31:23.638454] [DEBUG] [LOCAL ] HZO: Trimmed 41086 records to 29050 (keeping 200 days of data) [2025-10-08T19:31:23.640755] [DEBUG] [LOCAL ] HYTR: Primary data saved (3113 records). [2025-10-08T19:31:23.640945] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-08T19:31:23.641057] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYTR took 39.5s. Estimated remaining: 3h 1m 12s. Rate: 7.1 symbols/min [2025-10-08T19:31:23.811828] [DEBUG] [LOCAL ] HZO: Primary data saved (29050 records). [2025-10-08T19:31:23.811986] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-08T19:31:23.812121] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 30.3s. Estimated remaining: 3h 0m 54s. Rate: 7.1 symbols/min [2025-10-08T19:31:24.451016] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:24.494053] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:24.559509] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:24.561537] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:24.625627] [DEBUG] [LOCAL ] IBP: Loaded 28806 existing records from primary storage. [2025-10-08T19:31:24.626441] [INFO ] [MAIN ] IBP: Loaded 28806 existing records. [2025-10-08T19:31:24.698338] [DEBUG] [LOCAL ] IBN: Loaded 52857 existing records from primary storage. [2025-10-08T19:31:24.750026] [INFO ] [MAIN ] IBN: Loaded 52857 existing records. [2025-10-08T19:31:24.816185] [DEBUG] [LOCAL ] IAG: Loaded 53461 existing records from primary storage. [2025-10-08T19:31:24.822572] [DEBUG] [LOCAL ] IBM: Loaded 53631 existing records from primary storage. [2025-10-08T19:31:24.837852] [INFO ] [MAIN ] IBM: Loaded 53631 existing records. [2025-10-08T19:31:24.838448] [INFO ] [MAIN ] IAG: Loaded 53461 existing records. [2025-10-08T19:31:25.055371] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:25.140047] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-08T19:31:25.170048] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-08T19:31:25.190959] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-08T19:31:25.227177] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-08T19:31:25.394159] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:25.474851] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-08T19:31:25.541688] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-08T19:31:25.498397] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:25.581933] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-08T19:31:25.582039] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-08T19:31:25.582082] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-08T19:31:25.581731] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:25.582203] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-08T19:31:25.582842] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-08T19:31:25.593311] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-08T19:31:25.582777] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-08T19:31:25.644557] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-08T19:31:25.756213] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-08T19:31:25.827867] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-08T19:31:26.552055] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:26.583322] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-08T19:31:26.896663] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:26.912805] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-08T19:31:26.961070] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:26.961748] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-08T19:31:27.043016] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:27.043342] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-08T19:31:27.872576] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T19:31:27.878788] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-08T19:31:28.653522] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T19:31:28.665353] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-08T19:31:28.761965] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T19:31:28.772615] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-08T19:31:28.788736] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T19:31:28.817519] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-08T19:31:29.343751] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-08T19:31:29.617608] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-08T19:31:29.694814] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T19:31:30.216667] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:31:30.285409] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T19:31:30.417500] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-08T19:31:31.217586] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-08T19:31:31.524795] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T19:31:31.849822] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T19:31:32.017550] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-08T19:31:32.817521] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-08T19:31:33.079900] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T19:31:33.131325] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T19:31:33.617552] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-08T19:31:34.417513] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-08T19:31:34.910808] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-08T19:31:35.217571] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-08T19:31:35.463265] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T19:31:35.559751] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:31:36.017588] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-08T19:31:36.817603] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-08T19:31:37.319182] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T19:31:37.440774] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-08T19:31:37.617587] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-08T19:31:38.295809] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:31:38.417498] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-08T19:31:38.586787] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T19:31:39.217515] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-08T19:31:40.017534] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-08T19:31:40.320850] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T19:31:40.392156] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:31:40.817595] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-08T19:31:41.563346] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T19:31:41.617503] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-08T19:31:42.302847] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T19:31:42.417570] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-08T19:31:43.217518] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-08T19:31:43.375938] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:31:44.017613] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-08T19:31:44.456874] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T19:31:44.817620] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-08T19:31:45.047233] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T19:31:45.367340] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:31:45.617555] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-08T19:31:46.417572] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-08T19:31:46.953525] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T19:31:47.217541] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-08T19:31:47.323545] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:31:48.017619] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-08T19:31:48.239271] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T19:31:48.817576] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-08T19:31:48.986229] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T19:31:49.017292] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:31:49.617554] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-08T19:31:50.417576] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-08T19:31:50.666489] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T19:31:50.668806] [INFO ] [REMOTE ] IBP: Full fetch complete (41138 records). [2025-10-08T19:31:50.668891] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-08T19:31:51.026814] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-08T19:31:51.112508] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-08T19:31:51.112595] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-08T19:31:51.113240] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-08T19:31:51.113300] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-08T19:31:51.114144] [DEBUG] [LOCAL ] IBP: Trimmed 41138 records to 28771 (keeping 200 days of data) [2025-10-08T19:31:51.219627] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-08T19:31:51.300333] [DEBUG] [LOCAL ] IBP: Primary data saved (28771 records). [2025-10-08T19:31:51.300472] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-08T19:31:51.300565] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IBP took 27.5s. Estimated remaining: 3h 1m 8s. Rate: 7.1 symbols/min [2025-10-08T19:31:51.470336] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:51.505778] [DEBUG] [LOCAL ] IBTA: Loaded 37273 existing records from primary storage. [2025-10-08T19:31:51.506071] [INFO ] [MAIN ] IBTA: Loaded 37273 existing records. [2025-10-08T19:31:51.685491] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:51.685914] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-08T19:31:51.685964] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-08T19:31:51.686183] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-08T19:31:51.686240] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-08T19:31:52.039448] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-08T19:31:52.095329] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:52.168568] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T19:31:52.817572] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-08T19:31:53.441484] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-08T19:31:53.617506] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-08T19:31:54.070474] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T19:31:54.163178] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T19:31:54.417547] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-08T19:31:55.217548] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-08T19:31:55.615266] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T19:31:56.017522] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-08T19:31:56.161817] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T19:31:56.165830] [INFO ] [REMOTE ] IBN: Full fetch complete (76332 records). [2025-10-08T19:31:56.165960] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-08T19:31:56.571821] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-08T19:31:56.571904] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-08T19:31:56.572843] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-08T19:31:56.572913] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-08T19:31:56.574335] [DEBUG] [LOCAL ] IBN: Trimmed 76332 records to 52860 (keeping 200 days of data) [2025-10-08T19:31:56.728995] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:31:56.840599] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-08T19:31:56.967875] [DEBUG] [LOCAL ] IBN: Primary data saved (52860 records). [2025-10-08T19:31:56.968047] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-08T19:31:56.968176] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 33.1s. Estimated remaining: 3h 0m 57s. Rate: 7.1 symbols/min [2025-10-08T19:31:57.101683] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T19:31:57.184251] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:57.236200] [DEBUG] [LOCAL ] ICE: Loaded 53011 existing records from primary storage. [2025-10-08T19:31:57.236536] [INFO ] [MAIN ] ICE: Loaded 53011 existing records. [2025-10-08T19:31:57.419602] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:57.419889] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-08T19:31:57.419939] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-08T19:31:57.420177] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-08T19:31:57.420234] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-08T19:31:57.625637] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-08T19:31:57.785137] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:58.417572] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-08T19:31:58.549392] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T19:31:58.556735] [INFO ] [REMOTE ] IAG: Full fetch complete (77275 records). [2025-10-08T19:31:58.556947] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-08T19:31:58.998693] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-08T19:31:58.998849] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-08T19:31:58.999840] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-08T19:31:58.999993] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-08T19:31:59.015478] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:31:59.021796] [DEBUG] [LOCAL ] IAG: Trimmed 77275 records to 53473 (keeping 200 days of data) [2025-10-08T19:31:59.218360] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-08T19:31:59.336358] [DEBUG] [LOCAL ] IAG: Primary data saved (53473 records). [2025-10-08T19:31:59.336515] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-08T19:31:59.336604] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IAG took 35.5s. Estimated remaining: 3h 0m 41s. Rate: 7.1 symbols/min [2025-10-08T19:31:59.502011] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:59.537687] [DEBUG] [LOCAL ] ICL: Loaded 38342 existing records from primary storage. [2025-10-08T19:31:59.537991] [INFO ] [MAIN ] ICL: Loaded 38342 existing records. [2025-10-08T19:31:59.710835] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:59.711074] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-08T19:31:59.711121] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-08T19:31:59.711361] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-08T19:31:59.711417] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-08T19:32:00.022724] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-08T19:32:00.063987] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:00.437397] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T19:32:00.817577] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-08T19:32:01.175312] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-08T19:32:01.628873] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-08T19:32:01.633045] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T19:32:01.797083] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T19:32:02.417550] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-08T19:32:02.845613] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T19:32:03.217593] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-08T19:32:03.847148] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T19:32:04.017526] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-08T19:32:04.809567] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T19:32:04.819100] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-08T19:32:05.420810] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:32:05.617550] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-08T19:32:06.417521] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-08T19:32:06.805444] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T19:32:07.217558] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-08T19:32:07.333423] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-08T19:32:07.338155] [INFO ] [REMOTE ] IBM: Full fetch complete (77623 records). [2025-10-08T19:32:07.338300] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-08T19:32:07.738590] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T19:32:07.786111] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-08T19:32:07.786554] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-08T19:32:07.787577] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-08T19:32:07.787665] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-08T19:32:07.789406] [DEBUG] [LOCAL ] IBM: Trimmed 77623 records to 53631 (keeping 200 days of data) [2025-10-08T19:32:08.024725] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-08T19:32:08.149342] [DEBUG] [LOCAL ] IBM: Primary data saved (53631 records). [2025-10-08T19:32:08.149514] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-08T19:32:08.150343] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBM took 44.3s. Estimated remaining: 3h 0m 33s. Rate: 7.1 symbols/min [2025-10-08T19:32:08.339978] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:08.378865] [DEBUG] [LOCAL ] IDA: Loaded 32522 existing records from primary storage. [2025-10-08T19:32:08.379194] [INFO ] [MAIN ] IDA: Loaded 32522 existing records. [2025-10-08T19:32:08.565573] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:08.565897] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-08T19:32:08.565945] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-08T19:32:08.566166] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-08T19:32:08.566251] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-08T19:32:08.823013] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-08T19:32:08.978179] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T19:32:08.976495] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:09.388713] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T19:32:09.617564] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-08T19:32:09.935285] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:32:10.417562] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-08T19:32:10.856020] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T19:32:11.217562] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-08T19:32:11.832587] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T19:32:12.017553] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-08T19:32:12.659871] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T19:32:12.817507] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-08T19:32:13.293808] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T19:32:13.617569] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-08T19:32:14.233856] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T19:32:14.417573] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-08T19:32:14.776094] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T19:32:15.217583] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-08T19:32:16.017509] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-08T19:32:16.159218] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T19:32:16.711220] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T19:32:16.817600] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-08T19:32:17.494743] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T19:32:17.617549] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-08T19:32:18.124054] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T19:32:18.417515] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-08T19:32:19.217517] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-08T19:32:19.418847] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T19:32:20.017612] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-08T19:32:20.057477] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T19:32:20.317560] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T19:32:20.817629] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-08T19:32:21.460586] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:32:21.617525] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-08T19:32:21.663816] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T19:32:22.417606] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-08T19:32:23.083543] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T19:32:23.217556] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-08T19:32:23.379262] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T19:32:23.382079] [INFO ] [REMOTE ] IBTA: Full fetch complete (50972 records). [2025-10-08T19:32:23.382187] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-08T19:32:23.773070] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-08T19:32:23.773152] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-08T19:32:23.773976] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-08T19:32:23.774045] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-08T19:32:23.775113] [DEBUG] [LOCAL ] IBTA: Trimmed 50972 records to 37145 (keeping 200 days of data) [2025-10-08T19:32:23.990271] [DEBUG] [LOCAL ] IBTA: Primary data saved (37145 records). [2025-10-08T19:32:23.990433] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-08T19:32:23.990536] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBTA took 32.7s. Estimated remaining: 3h 0m 33s. Rate: 7.1 symbols/min [2025-10-08T19:32:24.022616] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-08T19:32:24.165306] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:24.176284] [DEBUG] [LOCAL ] IDE: Loaded 8835 existing records from primary storage. [2025-10-08T19:32:24.176507] [INFO ] [MAIN ] IDE: Loaded 8835 existing records. [2025-10-08T19:32:24.363568] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:24.363947] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-08T19:32:24.364053] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-08T19:32:24.364263] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-08T19:32:24.364324] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-08T19:32:24.477350] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T19:32:24.507574] [INFO ] [REMOTE ] ICL: Full fetch complete (55874 records). [2025-10-08T19:32:24.531443] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-08T19:32:24.828342] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-08T19:32:24.895568] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:25.138446] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-08T19:32:25.138597] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-08T19:32:25.139514] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-08T19:32:25.139637] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-08T19:32:25.141176] [DEBUG] [LOCAL ] ICL: Trimmed 55874 records to 38375 (keeping 200 days of data) [2025-10-08T19:32:25.353086] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T19:32:25.387777] [DEBUG] [LOCAL ] ICL: Primary data saved (38375 records). [2025-10-08T19:32:25.387945] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-08T19:32:25.388037] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. ICL took 26.1s. Estimated remaining: 3h 0m 17s. Rate: 7.1 symbols/min [2025-10-08T19:32:25.556631] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:25.578980] [DEBUG] [LOCAL ] IDT: Loaded 18116 existing records from primary storage. [2025-10-08T19:32:25.579371] [INFO ] [MAIN ] IDT: Loaded 18116 existing records. [2025-10-08T19:32:25.622763] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-08T19:32:25.770278] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:25.770571] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-08T19:32:25.770630] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-08T19:32:25.770883] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-08T19:32:25.770939] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-08T19:32:26.115513] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:26.417511] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-08T19:32:26.450145] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T19:32:26.753434] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T19:32:27.217613] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-08T19:32:27.556768] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:32:27.971535] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T19:32:28.017541] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-08T19:32:28.753101] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:32:28.817520] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-08T19:32:29.591359] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:32:29.617499] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-08T19:32:30.417528] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-08T19:32:30.657473] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:32:31.217600] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-08T19:32:32.017570] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-08T19:32:32.042605] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T19:32:32.211823] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T19:32:32.817607] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-08T19:32:33.376080] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T19:32:33.410265] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T19:32:33.617526] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-08T19:32:34.417563] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-08T19:32:35.123295] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T19:32:35.217516] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-08T19:32:35.493081] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T19:32:35.862384] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T19:32:36.017596] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-08T19:32:36.817560] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-08T19:32:37.617590] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-08T19:32:37.873094] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-08T19:32:37.877367] [INFO ] [REMOTE ] ICE: Full fetch complete (76763 records). [2025-10-08T19:32:37.877555] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-08T19:32:38.287971] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T19:32:38.311680] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T19:32:38.399741] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-08T19:32:38.399822] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-08T19:32:38.400753] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-08T19:32:38.400817] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-08T19:32:38.403175] [DEBUG] [LOCAL ] ICE: Trimmed 76763 records to 53012 (keeping 200 days of data) [2025-10-08T19:32:38.463434] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-08T19:32:38.751583] [DEBUG] [LOCAL ] ICE: Primary data saved (53012 records). [2025-10-08T19:32:38.751748] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-08T19:32:38.751838] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICE took 41.8s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-08T19:32:38.929341] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:38.968121] [DEBUG] [LOCAL ] IEX: Loaded 38343 existing records from primary storage. [2025-10-08T19:32:38.968473] [INFO ] [MAIN ] IEX: Loaded 38343 existing records. [2025-10-08T19:32:39.149872] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:39.150112] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-08T19:32:39.150175] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-08T19:32:39.150377] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-08T19:32:39.150435] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-08T19:32:39.221047] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-08T19:32:39.261279] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T19:32:39.522447] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:40.017567] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-08T19:32:40.577943] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T19:32:40.822331] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-08T19:32:40.824693] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:32:41.617546] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-08T19:32:42.285019] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:32:42.369339] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T19:32:42.417603] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-08T19:32:43.217562] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-08T19:32:43.563704] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T19:32:44.017614] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-08T19:32:44.269417] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T19:32:44.817581] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-08T19:32:45.328469] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T19:32:45.331793] [INFO ] [REMOTE ] IDA: Full fetch complete (44984 records). [2025-10-08T19:32:45.331904] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-08T19:32:45.461362] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T19:32:45.622632] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-08T19:32:45.748198] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-08T19:32:45.748272] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-08T19:32:45.749007] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-08T19:32:45.749070] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-08T19:32:45.750092] [DEBUG] [LOCAL ] IDA: Trimmed 44984 records to 32579 (keeping 200 days of data) [2025-10-08T19:32:45.955093] [DEBUG] [LOCAL ] IDA: Primary data saved (32579 records). [2025-10-08T19:32:45.955251] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-08T19:32:45.956189] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. IDA took 37.8s. Estimated remaining: 3h 0m 4s. Rate: 7.1 symbols/min [2025-10-08T19:32:46.131065] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:46.181140] [DEBUG] [LOCAL ] IFF: Loaded 51041 existing records from primary storage. [2025-10-08T19:32:46.181470] [INFO ] [MAIN ] IFF: Loaded 51041 existing records. [2025-10-08T19:32:46.374493] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:46.374742] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-08T19:32:46.374795] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-08T19:32:46.375016] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-08T19:32:46.375074] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-08T19:32:46.418739] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-08T19:32:46.746359] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:46.758519] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:32:47.135048] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T19:32:47.217558] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-08T19:32:48.017604] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-08T19:32:48.604317] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:32:48.817539] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-08T19:32:48.995825] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T19:32:49.617604] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-08T19:32:50.160186] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T19:32:50.417592] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-08T19:32:51.177906] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:32:51.222066] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-08T19:32:51.228335] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T19:32:51.880860] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T19:32:52.017564] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-08T19:32:52.817527] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-08T19:32:52.834759] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T19:32:53.617555] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-08T19:32:54.417582] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-08T19:32:54.512859] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:32:54.985862] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T19:32:54.987049] [INFO ] [REMOTE ] IDE: Full fetch complete (12571 records). [2025-10-08T19:32:54.987139] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-08T19:32:55.182173] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T19:32:55.225060] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-08T19:32:55.386878] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-08T19:32:55.386955] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-08T19:32:55.387227] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-08T19:32:55.387265] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-08T19:32:55.387733] [DEBUG] [LOCAL ] IDE: Trimmed 12571 records to 8882 (keeping 200 days of data) [2025-10-08T19:32:55.440326] [DEBUG] [LOCAL ] IDE: Primary data saved (8882 records). [2025-10-08T19:32:55.440442] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-08T19:32:55.440536] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDE took 31.4s. Estimated remaining: 2h 59m 57s. Rate: 7.1 symbols/min [2025-10-08T19:32:55.609289] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:55.629332] [DEBUG] [LOCAL ] IFN: Loaded 18399 existing records from primary storage. [2025-10-08T19:32:55.629568] [INFO ] [MAIN ] IFN: Loaded 18399 existing records. [2025-10-08T19:32:55.804779] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:55.805029] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-08T19:32:55.805084] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-08T19:32:55.805243] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-08T19:32:55.805284] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-08T19:32:56.022690] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-08T19:32:56.157108] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:56.817518] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-08T19:32:56.860995] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T19:32:57.343180] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T19:32:57.617533] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-08T19:32:57.900478] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:32:57.902777] [INFO ] [REMOTE ] IDT: Full fetch complete (23340 records). [2025-10-08T19:32:57.902857] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-08T19:32:58.267094] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-08T19:32:58.267234] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-08T19:32:58.267781] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-08T19:32:58.267855] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-08T19:32:58.268475] [DEBUG] [LOCAL ] IDT: Trimmed 23340 records to 18163 (keeping 200 days of data) [2025-10-08T19:32:58.381341] [DEBUG] [LOCAL ] IDT: Primary data saved (18163 records). [2025-10-08T19:32:58.381473] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-08T19:32:58.381556] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDT took 33.0s. Estimated remaining: 2h 59m 42s. Rate: 7.1 symbols/min [2025-10-08T19:32:58.424716] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-08T19:32:58.564061] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:58.564484] [DEBUG] [LOCAL ] IFS: No existing data file found in primary storage. [2025-10-08T19:32:58.564560] [WARN ] [MAIN ] IFS: No existing data found, performing full refresh instead. [2025-10-08T19:32:58.564785] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-08T19:32:58.564835] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-08T19:32:58.564882] [DEBUG] [LOCAL ] IFS: No primary data file found to delete. [2025-10-08T19:32:58.564920] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-08T19:32:58.740448] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T19:32:58.941865] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:59.217553] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-08T19:33:00.017589] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-08T19:33:00.086299] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T19:33:00.403281] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T19:33:00.817509] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-08T19:33:01.155913] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T19:33:01.617564] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-08T19:33:01.672177] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T19:33:02.417550] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-08T19:33:03.127143] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:33:03.164349] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T19:33:03.217511] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-08T19:33:04.017562] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-08T19:33:04.658492] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:33:04.817517] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-08T19:33:05.146756] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T19:33:05.602153] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T19:33:05.617492] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-08T19:33:06.417584] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-08T19:33:06.702667] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T19:33:07.217589] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-08T19:33:07.609906] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T19:33:08.017550] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-08T19:33:08.413528] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T19:33:08.817545] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-08T19:33:09.207487] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T19:33:09.617565] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-08T19:33:10.269941] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T19:33:10.417532] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-08T19:33:10.452755] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T19:33:11.217607] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-08T19:33:12.017549] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-08T19:33:12.189782] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T19:33:12.439338] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T19:33:12.817507] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-08T19:33:13.195789] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:33:13.617553] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-08T19:33:14.273297] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T19:33:14.417543] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-08T19:33:14.570484] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:33:15.217637] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-08T19:33:15.762807] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T19:33:15.766165] [INFO ] [REMOTE ] IEX: Full fetch complete (53482 records). [2025-10-08T19:33:15.766298] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-08T19:33:16.030929] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-08T19:33:16.211474] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T19:33:16.286058] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-08T19:33:16.286167] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-08T19:33:16.287216] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-08T19:33:16.287292] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-08T19:33:16.288873] [DEBUG] [LOCAL ] IEX: Trimmed 53482 records to 38329 (keeping 200 days of data) [2025-10-08T19:33:16.561204] [DEBUG] [LOCAL ] IEX: Primary data saved (38329 records). [2025-10-08T19:33:16.561372] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-08T19:33:16.561478] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IEX took 37.8s. Estimated remaining: 2h 59m 45s. Rate: 7.1 symbols/min [2025-10-08T19:33:16.793125] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:16.807188] [DEBUG] [LOCAL ] IGA: Loaded 9969 existing records from primary storage. [2025-10-08T19:33:16.807467] [INFO ] [MAIN ] IGA: Loaded 9969 existing records. [2025-10-08T19:33:16.822816] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-08T19:33:17.053958] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:17.054303] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-08T19:33:17.054379] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-08T19:33:17.054634] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-08T19:33:17.054740] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-08T19:33:17.272387] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T19:33:17.492906] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:17.617512] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-08T19:33:17.669260] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T19:33:18.298399] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T19:33:18.417497] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-08T19:33:19.181053] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T19:33:19.217511] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-08T19:33:19.953712] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T19:33:20.017495] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-08T19:33:20.789387] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T19:33:20.817500] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-08T19:33:21.492841] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T19:33:21.617567] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-08T19:33:22.372005] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:33:22.417518] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-08T19:33:23.143556] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T19:33:23.217551] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-08T19:33:24.017587] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-08T19:33:24.758518] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:33:24.805348] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T19:33:24.817513] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-08T19:33:25.480734] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T19:33:25.617563] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-08T19:33:26.417520] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-08T19:33:26.729833] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T19:33:26.951765] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T19:33:27.217604] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-08T19:33:28.017517] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-08T19:33:28.817518] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-08T19:33:28.867400] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T19:33:29.156975] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T19:33:29.612814] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T19:33:29.617533] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-08T19:33:30.417560] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-08T19:33:30.598861] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T19:33:30.601223] [INFO ] [REMOTE ] IFS: Full fetch complete (31711 records). [2025-10-08T19:33:30.601365] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-08T19:33:30.994361] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-08T19:33:30.994461] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-08T19:33:30.995284] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-08T19:33:30.995350] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-08T19:33:30.996270] [DEBUG] [LOCAL ] IFS: Trimmed 31711 records to 22937 (keeping 200 days of data) [2025-10-08T19:33:31.134841] [DEBUG] [LOCAL ] IFS: Primary data saved (22937 records). [2025-10-08T19:33:31.134976] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-08T19:33:31.135089] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IFS took 32.8s. Estimated remaining: 2h 59m 44s. Rate: 7.1 symbols/min [2025-10-08T19:33:31.227386] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-08T19:33:31.332772] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T19:33:31.336305] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:31.361108] [DEBUG] [LOCAL ] IGD: Loaded 19232 existing records from primary storage. [2025-10-08T19:33:31.361403] [INFO ] [MAIN ] IGD: Loaded 19232 existing records. [2025-10-08T19:33:31.537537] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:31.537800] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-08T19:33:31.537849] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-08T19:33:31.538050] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-08T19:33:31.538107] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-08T19:33:31.906138] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:32.017587] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-08T19:33:32.817605] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-08T19:33:32.920889] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T19:33:32.922831] [INFO ] [REMOTE ] IFN: Full fetch complete (28903 records). [2025-10-08T19:33:32.922938] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-08T19:33:33.313682] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-08T19:33:33.313775] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-08T19:33:33.314344] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-08T19:33:33.314419] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-08T19:33:33.345545] [DEBUG] [LOCAL ] IFN: Trimmed 28903 records to 18362 (keeping 200 days of data) [2025-10-08T19:33:33.347862] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-08T19:33:33.476741] [DEBUG] [LOCAL ] IFN: Primary data saved (18362 records). [2025-10-08T19:33:33.476908] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-08T19:33:33.477007] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 38.0s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-08T19:33:33.621791] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-08T19:33:33.651519] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:33.652495] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T19:33:33.654482] [INFO ] [REMOTE ] IGA: Full fetch complete (13861 records). [2025-10-08T19:33:33.654562] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-08T19:33:33.738312] [DEBUG] [LOCAL ] IGI: Loaded 3734 existing records from primary storage. [2025-10-08T19:33:33.759535] [INFO ] [MAIN ] IGI: Loaded 3734 existing records. [2025-10-08T19:33:34.150384] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:34.153018] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-08T19:33:34.153129] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-08T19:33:34.174501] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-08T19:33:34.192293] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-08T19:33:34.341851] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-08T19:33:34.347063] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-08T19:33:34.352637] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-08T19:33:34.360433] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-08T19:33:34.377154] [DEBUG] [LOCAL ] IGA: Trimmed 13861 records to 10005 (keeping 200 days of data) [2025-10-08T19:33:34.435154] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-08T19:33:34.759354] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:34.769935] [DEBUG] [LOCAL ] IGA: Primary data saved (10005 records). [2025-10-08T19:33:34.770023] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-08T19:33:34.770094] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IGA took 18.2s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-10-08T19:33:34.938463] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:34.969935] [DEBUG] [LOCAL ] IGR: Loaded 30409 existing records from primary storage. [2025-10-08T19:33:34.970247] [INFO ] [MAIN ] IGR: Loaded 30409 existing records. [2025-10-08T19:33:35.189626] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:35.190159] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-08T19:33:35.190394] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-08T19:33:35.190830] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-08T19:33:35.190897] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-08T19:33:35.221831] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-08T19:33:35.575037] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T19:33:35.614141] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:35.627887] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T19:33:35.926337] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T19:33:36.017558] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-08T19:33:36.328279] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-08T19:33:36.817621] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-08T19:33:37.617593] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-08T19:33:38.252525] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:33:38.257167] [INFO ] [REMOTE ] IFF: Full fetch complete (73194 records). [2025-10-08T19:33:38.257320] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-08T19:33:38.422747] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-08T19:33:38.695464] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-08T19:33:38.695606] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-08T19:33:38.696596] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-08T19:33:38.696709] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-08T19:33:38.717494] [DEBUG] [LOCAL ] IFF: Trimmed 73194 records to 51052 (keeping 200 days of data) [2025-10-08T19:33:38.719540] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T19:33:39.061328] [DEBUG] [LOCAL ] IFF: Primary data saved (51052 records). [2025-10-08T19:33:39.061503] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-08T19:33:39.061615] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFF took 53.1s. Estimated remaining: 2h 58m 58s. Rate: 7.1 symbols/min [2025-10-08T19:33:39.224699] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-08T19:33:39.227418] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:39.234363] [DEBUG] [LOCAL ] IH: Loaded 2861 existing records from primary storage. [2025-10-08T19:33:39.234558] [INFO ] [MAIN ] IH: Loaded 2861 existing records. [2025-10-08T19:33:39.413395] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:39.413682] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-08T19:33:39.413837] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-08T19:33:39.414133] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-08T19:33:39.414212] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-08T19:33:39.711283] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T19:33:39.722901] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T19:33:39.813852] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:40.017525] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-08T19:33:40.390501] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-08T19:33:40.817716] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-08T19:33:41.250778] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T19:33:41.617560] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-08T19:33:42.417539] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-08T19:33:42.616815] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:33:43.217627] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-08T19:33:43.837844] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T19:33:43.892479] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T19:33:44.017530] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-08T19:33:44.817531] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-08T19:33:45.209114] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T19:33:45.617589] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-08T19:33:46.346943] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T19:33:46.389445] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T19:33:46.417525] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-08T19:33:47.217578] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-08T19:33:47.736304] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:33:47.989990] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:33:48.017521] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-08T19:33:48.768932] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:33:48.817582] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-08T19:33:49.617569] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-08T19:33:50.152613] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T19:33:50.182797] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:33:50.417534] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-08T19:33:51.213227] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T19:33:51.218810] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-08T19:33:52.017598] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-08T19:33:52.343513] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-08T19:33:52.458387] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T19:33:52.817569] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-08T19:33:53.617616] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-08T19:33:53.826293] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T19:33:53.936846] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-08T19:33:54.417561] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-08T19:33:55.217540] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-08T19:33:55.640021] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T19:33:55.886029] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T19:33:56.017532] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-08T19:33:56.567400] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-08T19:33:56.817543] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-08T19:33:57.495051] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T19:33:57.617601] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-08T19:33:58.154758] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T19:33:58.417542] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-08T19:33:59.217517] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-08T19:33:59.583200] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:33:59.774977] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T19:34:00.017550] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-08T19:34:00.817548] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-08T19:34:01.253583] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T19:34:01.419774] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:34:01.617554] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-08T19:34:02.417550] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-08T19:34:03.217590] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-08T19:34:03.466343] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T19:34:03.483603] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:34:04.017516] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-08T19:34:04.075928] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-08T19:34:04.817525] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-08T19:34:04.908958] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T19:34:04.911604] [INFO ] [REMOTE ] IGD: Full fetch complete (29727 records). [2025-10-08T19:34:04.911741] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-08T19:34:05.373353] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-08T19:34:05.373460] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-08T19:34:05.374218] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-08T19:34:05.374294] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-08T19:34:05.375209] [DEBUG] [LOCAL ] IGD: Trimmed 29727 records to 19218 (keeping 200 days of data) [2025-10-08T19:34:05.495096] [DEBUG] [LOCAL ] IGD: Primary data saved (19218 records). [2025-10-08T19:34:05.495251] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-08T19:34:05.495336] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGD took 34.4s. Estimated remaining: 2h 59m 11s. Rate: 7.1 symbols/min [2025-10-08T19:34:05.622624] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-08T19:34:05.686879] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:05.702604] [DEBUG] [LOCAL ] IHD: Loaded 7017 existing records from primary storage. [2025-10-08T19:34:05.703036] [INFO ] [MAIN ] IHD: Loaded 7017 existing records. [2025-10-08T19:34:05.902091] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:05.902411] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-08T19:34:05.902484] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-08T19:34:05.908184] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-08T19:34:05.918147] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-08T19:34:05.963754] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T19:34:06.227737] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T19:34:06.292725] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:06.417548] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-08T19:34:07.217545] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-08T19:34:07.543246] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T19:34:07.545550] [INFO ] [REMOTE ] IGR: Full fetch complete (45342 records). [2025-10-08T19:34:07.545688] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-08T19:34:07.844380] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T19:34:07.848204] [INFO ] [REMOTE ] IH: Full fetch complete (4966 records). [2025-10-08T19:34:07.848302] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-08T19:34:08.022419] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-08T19:34:08.095267] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-08T19:34:08.095481] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-08T19:34:08.172078] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-08T19:34:08.194375] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-08T19:34:08.235736] [DEBUG] [LOCAL ] IGR: Trimmed 45342 records to 30399 (keeping 200 days of data) [2025-10-08T19:34:08.400104] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-08T19:34:08.400715] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-08T19:34:08.401133] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-08T19:34:08.401545] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-08T19:34:08.402364] [DEBUG] [LOCAL ] IH: Trimmed 4966 records to 2853 (keeping 200 days of data) [2025-10-08T19:34:08.424072] [DEBUG] [LOCAL ] IH: Primary data saved (2853 records). [2025-10-08T19:34:08.424484] [INFO ] [MAIN ] IH: Full history saved. [2025-10-08T19:34:08.426875] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IH took 29.4s. Estimated remaining: 2h 58m 56s. Rate: 7.1 symbols/min [2025-10-08T19:34:08.690734] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:08.699560] [DEBUG] [LOCAL ] IGR: Primary data saved (30399 records). [2025-10-08T19:34:08.699843] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-08T19:34:08.699945] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGR took 33.9s. Estimated remaining: 2h 58m 38s. Rate: 7.1 symbols/min [2025-10-08T19:34:08.821060] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-08T19:34:08.884863] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:08.894998] [DEBUG] [LOCAL ] IHG: Loaded 24318 existing records from primary storage. [2025-10-08T19:34:08.895302] [INFO ] [MAIN ] IHG: Loaded 24318 existing records. [2025-10-08T19:34:08.987202] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T19:34:09.115194] [DEBUG] [LOCAL ] IHS: Loaded 38502 existing records from primary storage. [2025-10-08T19:34:09.118591] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:09.118897] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-08T19:34:09.119221] [INFO ] [MAIN ] IHS: Loaded 38502 existing records. [2025-10-08T19:34:09.119098] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-08T19:34:09.151050] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-08T19:34:09.162481] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-08T19:34:09.513742] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:09.540101] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-08T19:34:09.552885] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-08T19:34:09.552822] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T19:34:09.584208] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-08T19:34:09.609865] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-08T19:34:09.626842] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-08T19:34:09.801276] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:10.073406] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:10.367091] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T19:34:10.417523] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-08T19:34:11.217556] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-08T19:34:11.727849] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:34:11.892021] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T19:34:12.017595] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-08T19:34:12.624328] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T19:34:12.625444] [INFO ] [REMOTE ] IGI: Full fetch complete (5346 records). [2025-10-08T19:34:12.625516] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-08T19:34:12.822674] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-08T19:34:13.031253] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-08T19:34:13.031340] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-08T19:34:13.031513] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-08T19:34:13.031553] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-08T19:34:13.031988] [DEBUG] [LOCAL ] IGI: Trimmed 5346 records to 3787 (keeping 200 days of data) [2025-10-08T19:34:13.055730] [DEBUG] [LOCAL ] IGI: Primary data saved (3787 records). [2025-10-08T19:34:13.055862] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-08T19:34:13.055948] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGI took 39.6s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-08T19:34:13.236182] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:13.244240] [DEBUG] [LOCAL ] IIF: Loaded 5685 existing records from primary storage. [2025-10-08T19:34:13.244440] [INFO ] [MAIN ] IIF: Loaded 5685 existing records. [2025-10-08T19:34:13.431472] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:13.431730] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-08T19:34:13.431783] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-08T19:34:13.431971] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-08T19:34:13.432028] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-08T19:34:13.528176] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T19:34:13.623117] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-08T19:34:13.798636] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:14.417566] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-08T19:34:15.151177] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T19:34:15.217491] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-08T19:34:15.427719] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T19:34:16.017527] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-08T19:34:16.385941] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T19:34:16.817543] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-08T19:34:16.831363] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T19:34:17.617593] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-08T19:34:17.971126] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:34:18.396193] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T19:34:18.417520] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-08T19:34:19.062678] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T19:34:19.217589] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-08T19:34:19.946815] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T19:34:20.017583] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-08T19:34:20.817530] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-08T19:34:21.131405] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T19:34:21.400026] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T19:34:21.617584] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-08T19:34:22.160744] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T19:34:22.417603] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-08T19:34:23.140818] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T19:34:23.217566] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-08T19:34:24.017565] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-08T19:34:24.208203] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T19:34:24.817595] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-08T19:34:25.503746] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T19:34:25.548946] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T19:34:25.617550] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-08T19:34:26.417608] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-08T19:34:26.666134] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T19:34:27.217612] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-08T19:34:27.363575] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T19:34:28.017574] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-08T19:34:28.488476] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T19:34:28.817605] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-08T19:34:28.840116] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T19:34:29.617578] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-08T19:34:29.875292] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:34:30.417605] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-08T19:34:30.873059] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T19:34:31.080208] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T19:34:31.217532] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-08T19:34:31.821128] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T19:34:32.017571] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-08T19:34:32.495383] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T19:34:32.817559] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-08T19:34:33.617561] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-08T19:34:34.178590] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T19:34:34.297979] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:34:34.417585] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-08T19:34:35.217552] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-08T19:34:35.919571] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T19:34:35.991693] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T19:34:36.017512] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-08T19:34:36.600743] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T19:34:36.817615] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-08T19:34:37.617513] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-08T19:34:37.666368] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T19:34:38.417554] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-08T19:34:38.453504] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T19:34:39.217568] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-08T19:34:39.417715] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T19:34:40.017509] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-08T19:34:40.314798] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T19:34:40.558829] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T19:34:40.560060] [INFO ] [REMOTE ] IHD: Full fetch complete (11860 records). [2025-10-08T19:34:40.560130] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-08T19:34:40.822683] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-08T19:34:40.923004] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-08T19:34:40.923081] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-08T19:34:40.923359] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-08T19:34:40.923396] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-08T19:34:40.923859] [DEBUG] [LOCAL ] IHD: Trimmed 11860 records to 7064 (keeping 200 days of data) [2025-10-08T19:34:40.965428] [DEBUG] [LOCAL ] IHD: Primary data saved (7064 records). [2025-10-08T19:34:40.965535] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-08T19:34:40.965615] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IHD took 35.5s. Estimated remaining: 2h 58m 39s. Rate: 7.1 symbols/min [2025-10-08T19:34:41.133127] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:41.156011] [DEBUG] [LOCAL ] IIIN: Loaded 16171 existing records from primary storage. [2025-10-08T19:34:41.156443] [INFO ] [MAIN ] IIIN: Loaded 16171 existing records. [2025-10-08T19:34:41.332990] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:41.333360] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-08T19:34:41.333448] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-08T19:34:41.333946] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-08T19:34:41.334006] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-08T19:34:41.622706] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-08T19:34:41.694701] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:42.152433] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:34:42.333304] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T19:34:42.417511] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-08T19:34:43.064450] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T19:34:43.217551] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-08T19:34:43.715912] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T19:34:43.716838] [INFO ] [REMOTE ] IIF: Full fetch complete (9203 records). [2025-10-08T19:34:43.716910] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-08T19:34:44.032335] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-08T19:34:44.077811] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-08T19:34:44.077894] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-08T19:34:44.078151] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-08T19:34:44.078191] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-08T19:34:44.078748] [DEBUG] [LOCAL ] IIF: Trimmed 9203 records to 5659 (keeping 200 days of data) [2025-10-08T19:34:44.114915] [DEBUG] [LOCAL ] IIF: Primary data saved (5659 records). [2025-10-08T19:34:44.115075] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-08T19:34:44.115166] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IIF took 31.1s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-08T19:34:44.286008] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:44.303352] [DEBUG] [LOCAL ] IIM: Loaded 15838 existing records from primary storage. [2025-10-08T19:34:44.303601] [INFO ] [MAIN ] IIM: Loaded 15838 existing records. [2025-10-08T19:34:44.493216] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:44.493453] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-08T19:34:44.493501] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-08T19:34:44.493759] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-08T19:34:44.493819] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-08T19:34:44.822698] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-08T19:34:44.854330] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:45.297351] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T19:34:45.617546] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-08T19:34:45.779918] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T19:34:45.782419] [INFO ] [REMOTE ] IHS: Full fetch complete (51502 records). [2025-10-08T19:34:45.782522] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-08T19:34:46.173710] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-08T19:34:46.173806] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-08T19:34:46.174551] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-08T19:34:46.174593] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-08T19:34:46.175827] [DEBUG] [LOCAL ] IHS: Trimmed 51502 records to 38329 (keeping 200 days of data) [2025-10-08T19:34:46.397964] [DEBUG] [LOCAL ] IHS: Primary data saved (38329 records). [2025-10-08T19:34:46.398255] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-08T19:34:46.398427] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHS took 37.7s. Estimated remaining: 2h 58m 9s. Rate: 7.1 symbols/min [2025-10-08T19:34:46.416404] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T19:34:46.425811] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-08T19:34:46.429392] [INFO ] [REMOTE ] IHG: Full fetch complete (33785 records). [2025-10-08T19:34:46.440420] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-08T19:34:46.740158] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:46.987025] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-08T19:34:46.987125] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-08T19:34:46.987837] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-08T19:34:46.987962] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-08T19:34:46.997755] [DEBUG] [LOCAL ] IHG: Trimmed 33785 records to 24221 (keeping 200 days of data) [2025-10-08T19:34:46.999791] [DEBUG] [LOCAL ] IIPR: Loaded 29578 existing records from primary storage. [2025-10-08T19:34:47.000272] [INFO ] [MAIN ] IIPR: Loaded 29578 existing records. [2025-10-08T19:34:47.222595] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-08T19:34:47.284625] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:47.290706] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-08T19:34:47.291474] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-08T19:34:47.292368] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-08T19:34:47.292686] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-08T19:34:47.692200] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:47.707257] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T19:34:47.744365] [DEBUG] [LOCAL ] IHG: Primary data saved (24221 records). [2025-10-08T19:34:47.744504] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-08T19:34:47.744603] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IHG took 39.3s. Estimated remaining: 2h 57m 53s. Rate: 7.1 symbols/min [2025-10-08T19:34:47.914790] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:47.955728] [DEBUG] [LOCAL ] IMAX: Loaded 42871 existing records from primary storage. [2025-10-08T19:34:47.956050] [INFO ] [MAIN ] IMAX: Loaded 42871 existing records. [2025-10-08T19:34:48.022697] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-08T19:34:48.145178] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:48.145421] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-08T19:34:48.145469] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-08T19:34:48.145897] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-08T19:34:48.145959] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-08T19:34:48.584784] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:48.585879] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T19:34:48.817556] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-08T19:34:49.322980] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T19:34:49.617528] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-08T19:34:49.732124] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T19:34:50.417577] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-08T19:34:50.967442] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T19:34:51.217532] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-08T19:34:51.460579] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:34:52.017568] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-08T19:34:52.518929] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T19:34:52.817506] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-08T19:34:52.901076] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T19:34:53.617518] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-08T19:34:53.651928] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T19:34:54.417597] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-08T19:34:54.652719] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:34:55.217554] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-08T19:34:55.910380] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T19:34:56.017555] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-08T19:34:56.315093] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T19:34:56.817588] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-08T19:34:57.035048] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T19:34:57.392858] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T19:34:57.617549] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-08T19:34:58.417513] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-08T19:34:58.547264] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T19:34:59.217501] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-08T19:34:59.393020] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T19:35:00.017544] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-08T19:35:00.817529] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-08T19:35:00.918364] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T19:35:01.103823] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T19:35:01.617518] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-08T19:35:01.861815] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:35:02.417589] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-08T19:35:03.035804] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T19:35:03.111081] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T19:35:03.217592] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-08T19:35:04.017607] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-08T19:35:04.432404] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T19:35:04.817594] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-08T19:35:05.093040] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T19:35:05.330026] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T19:35:05.617563] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-08T19:35:06.417599] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-08T19:35:07.217523] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-08T19:35:07.567899] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T19:35:07.704091] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-08T19:35:07.705630] [INFO ] [REMOTE ] IIIN: Full fetch complete (24724 records). [2025-10-08T19:35:07.705755] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-08T19:35:07.989759] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T19:35:08.022691] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-08T19:35:08.105132] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-08T19:35:08.105432] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-08T19:35:08.106065] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-08T19:35:08.106127] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-08T19:35:08.106810] [DEBUG] [LOCAL ] IIIN: Trimmed 24724 records to 16149 (keeping 200 days of data) [2025-10-08T19:35:08.205710] [DEBUG] [LOCAL ] IIIN: Primary data saved (16149 records). [2025-10-08T19:35:08.205854] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-08T19:35:08.205939] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IIIN took 27.2s. Estimated remaining: 2h 57m 58s. Rate: 7.1 symbols/min [2025-10-08T19:35:08.384601] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:08.431008] [DEBUG] [LOCAL ] INFA: Loaded 49429 existing records from primary storage. [2025-10-08T19:35:08.431352] [INFO ] [MAIN ] INFA: Loaded 49429 existing records. [2025-10-08T19:35:08.612225] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:08.612492] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-08T19:35:08.612543] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-08T19:35:08.612768] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-08T19:35:08.612826] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-08T19:35:08.827541] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-08T19:35:08.987574] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:09.617518] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-08T19:35:09.670968] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T19:35:09.869753] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T19:35:10.417572] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-08T19:35:10.648317] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T19:35:11.217751] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-08T19:35:12.017519] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-08T19:35:12.129356] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T19:35:12.250922] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:35:12.817540] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-08T19:35:13.617612] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-08T19:35:13.846314] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T19:35:14.276335] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:35:14.417622] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-08T19:35:14.529450] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T19:35:15.217557] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-08T19:35:15.940415] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:35:16.017586] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-08T19:35:16.817575] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-08T19:35:17.010687] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T19:35:17.617537] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-08T19:35:17.682083] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T19:35:17.963757] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T19:35:17.966388] [INFO ] [REMOTE ] IIPR: Full fetch complete (44858 records). [2025-10-08T19:35:17.966492] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-08T19:35:18.359462] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T19:35:18.363374] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-08T19:35:18.363976] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-08T19:35:18.365226] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-08T19:35:18.365294] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-08T19:35:18.366299] [DEBUG] [LOCAL ] IIPR: Trimmed 44858 records to 29456 (keeping 200 days of data) [2025-10-08T19:35:18.423284] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-08T19:35:18.556256] [DEBUG] [LOCAL ] IIPR: Primary data saved (29456 records). [2025-10-08T19:35:18.556399] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-08T19:35:18.556535] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIPR took 32.2s. Estimated remaining: 2h 57m 52s. Rate: 7.1 symbols/min [2025-10-08T19:35:18.731965] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:18.787609] [DEBUG] [LOCAL ] INFY: Loaded 53595 existing records from primary storage. [2025-10-08T19:35:18.788024] [INFO ] [MAIN ] INFY: Loaded 53595 existing records. [2025-10-08T19:35:18.967550] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:18.967803] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-08T19:35:18.967851] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-08T19:35:18.968056] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-08T19:35:18.968112] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-08T19:35:19.225041] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-08T19:35:19.234596] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T19:35:19.344970] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:20.017559] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-08T19:35:20.817533] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-08T19:35:20.935226] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:35:21.524332] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:35:21.617528] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-08T19:35:21.819174] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T19:35:22.417551] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-08T19:35:23.032545] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:35:23.036098] [INFO ] [REMOTE ] IMAX: Full fetch complete (60010 records). [2025-10-08T19:35:23.036215] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-08T19:35:23.220253] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-08T19:35:23.438852] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-08T19:35:23.438943] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-08T19:35:23.439794] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-08T19:35:23.439861] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-08T19:35:23.443276] [DEBUG] [LOCAL ] IMAX: Trimmed 60010 records to 42877 (keeping 200 days of data) [2025-10-08T19:35:23.699545] [DEBUG] [LOCAL ] IMAX: Primary data saved (42877 records). [2025-10-08T19:35:23.699749] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-08T19:35:23.699856] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IMAX took 36.0s. Estimated remaining: 2h 57m 40s. Rate: 7.1 symbols/min [2025-10-08T19:35:23.866545] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:23.914059] [DEBUG] [LOCAL ] ING: Loaded 50705 existing records from primary storage. [2025-10-08T19:35:23.914401] [INFO ] [MAIN ] ING: Loaded 50705 existing records. [2025-10-08T19:35:24.021741] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-08T19:35:24.099555] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:24.099832] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-08T19:35:24.099904] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-08T19:35:24.100345] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-08T19:35:24.100662] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-08T19:35:24.440961] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T19:35:24.512563] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:24.556761] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T19:35:24.817579] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-08T19:35:25.150587] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T19:35:25.617619] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-08T19:35:26.417530] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-08T19:35:26.425504] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T19:35:26.427782] [INFO ] [REMOTE ] IIM: Full fetch complete (25426 records). [2025-10-08T19:35:26.428039] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-08T19:35:26.516538] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:35:26.920880] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-08T19:35:26.920982] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-08T19:35:26.921594] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-08T19:35:26.921701] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-08T19:35:26.922427] [DEBUG] [LOCAL ] IIM: Trimmed 25426 records to 15846 (keeping 200 days of data) [2025-10-08T19:35:27.038481] [DEBUG] [LOCAL ] IIM: Primary data saved (15846 records). [2025-10-08T19:35:27.038810] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-08T19:35:27.039051] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIM took 42.9s. Estimated remaining: 2h 57m 25s. Rate: 7.1 symbols/min [2025-10-08T19:35:27.230468] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-08T19:35:27.271111] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:27.306011] [DEBUG] [LOCAL ] INGM: Loaded 28689 existing records from primary storage. [2025-10-08T19:35:27.306350] [INFO ] [MAIN ] INGM: Loaded 28689 existing records. [2025-10-08T19:35:27.551570] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:27.551911] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-08T19:35:27.551995] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-08T19:35:27.552327] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-08T19:35:27.552395] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-08T19:35:28.021777] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-08T19:35:28.021623] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:28.202560] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T19:35:28.817513] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-08T19:35:29.017751] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:35:29.362745] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:35:29.617604] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-08T19:35:29.866335] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T19:35:30.417577] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-08T19:35:31.205443] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T19:35:31.217494] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-08T19:35:31.700629] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:35:32.017582] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-08T19:35:32.817524] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-08T19:35:33.014581] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T19:35:33.624489] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-08T19:35:33.629879] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T19:35:34.396619] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T19:35:34.417493] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-08T19:35:35.217532] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-08T19:35:35.258718] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T19:35:35.863492] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T19:35:36.023278] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-08T19:35:36.035975] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T19:35:36.817588] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-08T19:35:37.617526] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-08T19:35:37.772526] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T19:35:38.417540] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-08T19:35:38.694258] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T19:35:38.776450] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T19:35:39.217563] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-08T19:35:39.923590] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:35:40.017537] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-08T19:35:40.435788] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T19:35:40.439308] [INFO ] [REMOTE ] INFA: Full fetch complete (71020 records). [2025-10-08T19:35:40.439464] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-08T19:35:40.822684] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-08T19:35:40.845187] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-08T19:35:40.846144] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-08T19:35:40.847180] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-08T19:35:40.847348] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-08T19:35:40.848868] [DEBUG] [LOCAL ] INFA: Trimmed 71020 records to 49319 (keeping 200 days of data) [2025-10-08T19:35:41.141251] [DEBUG] [LOCAL ] INFA: Primary data saved (49319 records). [2025-10-08T19:35:41.141392] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-08T19:35:41.141488] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. INFA took 32.9s. Estimated remaining: 2h 57m 24s. Rate: 7.1 symbols/min [2025-10-08T19:35:41.320365] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:41.355633] [DEBUG] [LOCAL ] INGR: Loaded 33657 existing records from primary storage. [2025-10-08T19:35:41.355953] [INFO ] [MAIN ] INGR: Loaded 33657 existing records. [2025-10-08T19:35:41.542632] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:41.543018] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-08T19:35:41.543190] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-08T19:35:41.543438] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-08T19:35:41.543495] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-08T19:35:41.621378] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-08T19:35:41.955348] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T19:35:41.959966] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:41.986887] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:35:42.417605] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-08T19:35:43.221763] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-08T19:35:43.227741] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:35:43.996756] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:35:44.017490] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-08T19:35:44.291470] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:35:44.817557] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-08T19:35:45.617533] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-08T19:35:45.874763] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T19:35:46.208996] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:35:46.417599] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-08T19:35:46.529180] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T19:35:47.217555] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-08T19:35:48.017539] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-08T19:35:48.137405] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T19:35:48.809476] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:35:48.817471] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-08T19:35:49.520698] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T19:35:49.617498] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-08T19:35:50.351291] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T19:35:50.417724] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-08T19:35:51.211787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T19:35:51.222479] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-08T19:35:51.825412] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T19:35:52.017546] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-08T19:35:52.817544] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-08T19:35:53.126340] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T19:35:53.397257] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:35:53.617568] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-08T19:35:54.417540] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-08T19:35:54.739435] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T19:35:54.785219] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T19:35:55.217577] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-08T19:35:56.017525] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-08T19:35:56.146380] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:35:56.150305] [INFO ] [REMOTE ] ING: Full fetch complete (73611 records). [2025-10-08T19:35:56.150455] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-08T19:35:56.561564] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-08T19:35:56.561746] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-08T19:35:56.562784] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-08T19:35:56.562849] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-08T19:35:56.564355] [DEBUG] [LOCAL ] ING: Trimmed 73611 records to 50706 (keeping 200 days of data) [2025-10-08T19:35:56.809717] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T19:35:56.824297] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-08T19:35:56.921314] [DEBUG] [LOCAL ] ING: Primary data saved (50706 records). [2025-10-08T19:35:56.921469] [INFO ] [MAIN ] ING: Full history saved. [2025-10-08T19:35:56.921573] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. ING took 33.2s. Estimated remaining: 2h 57m 23s. Rate: 7.1 symbols/min [2025-10-08T19:35:57.146218] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:57.190791] [DEBUG] [LOCAL ] INN: Loaded 41813 existing records from primary storage. [2025-10-08T19:35:57.191155] [INFO ] [MAIN ] INN: Loaded 41813 existing records. [2025-10-08T19:35:57.415832] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:57.416262] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-08T19:35:57.416349] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-08T19:35:57.416695] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-08T19:35:57.416861] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-08T19:35:57.533570] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:35:57.622634] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-08T19:35:57.838128] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:58.417542] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-08T19:35:58.590698] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-08T19:35:58.594800] [INFO ] [REMOTE ] INFY: Full fetch complete (77545 records). [2025-10-08T19:35:58.594946] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-08T19:35:58.800217] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:35:59.057819] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-08T19:35:59.057908] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-08T19:35:59.058879] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-08T19:35:59.058950] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-08T19:35:59.060520] [DEBUG] [LOCAL ] INFY: Trimmed 77545 records to 53594 (keeping 200 days of data) [2025-10-08T19:35:59.257868] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-08T19:35:59.415146] [DEBUG] [LOCAL ] INFY: Primary data saved (53594 records). [2025-10-08T19:35:59.415306] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-08T19:35:59.415431] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 40.9s. Estimated remaining: 2h 57m 8s. Rate: 7.1 symbols/min [2025-10-08T19:35:59.603459] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:59.603803] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-08T19:35:59.603924] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-08T19:35:59.604149] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-08T19:35:59.604268] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-08T19:35:59.604418] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-08T19:35:59.604542] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-08T19:35:59.733865] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:36:00.023846] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-08T19:36:00.038102] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:00.148319] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T19:36:00.817550] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-08T19:36:01.418386] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T19:36:01.617627] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-08T19:36:02.095579] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:36:02.417599] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-08T19:36:02.514086] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T19:36:03.217609] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-08T19:36:03.811744] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:36:03.815097] [INFO ] [REMOTE ] INGR: Full fetch complete (50425 records). [2025-10-08T19:36:03.815191] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-08T19:36:04.022699] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-08T19:36:04.220139] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-08T19:36:04.220254] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-08T19:36:04.221019] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-08T19:36:04.221081] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-08T19:36:04.222200] [DEBUG] [LOCAL ] INGR: Trimmed 50425 records to 33594 (keeping 200 days of data) [2025-10-08T19:36:04.391990] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:36:04.416488] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-08T19:36:04.418997] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:36:04.424009] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-08T19:36:04.424830] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:36:04.427291] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-08T19:36:04.428914] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-08T19:36:04.430616] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-08T19:36:04.433482] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-08T19:36:04.435762] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INR took 5.0s. Estimated remaining: 2h 56m 56s. Rate: 7.1 symbols/min [2025-10-08T19:36:04.655197] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:04.659368] [DEBUG] [LOCAL ] INGR: Primary data saved (33594 records). [2025-10-08T19:36:04.659539] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-08T19:36:04.661343] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T19:36:04.662077] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGR took 23.5s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-08T19:36:04.829664] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-08T19:36:04.863677] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:04.875671] [DEBUG] [LOCAL ] INSP: Loaded 37565 existing records from primary storage. [2025-10-08T19:36:04.875970] [INFO ] [MAIN ] INSP: Loaded 37565 existing records. [2025-10-08T19:36:05.068029] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:05.068328] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-08T19:36:05.068378] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-08T19:36:05.068749] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-08T19:36:05.068806] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-08T19:36:05.185265] [DEBUG] [LOCAL ] INSW: Loaded 39831 existing records from primary storage. [2025-10-08T19:36:05.201330] [INFO ] [MAIN ] INSW: Loaded 39831 existing records. [2025-10-08T19:36:05.599197] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:05.635564] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-08T19:36:05.635445] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-08T19:36:05.641773] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:05.642926] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-08T19:36:05.643269] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-08T19:36:05.643340] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-08T19:36:06.029398] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:06.154417] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:36:06.417708] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-08T19:36:07.121494] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T19:36:07.217571] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-08T19:36:07.935320] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T19:36:08.017550] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-08T19:36:08.657148] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:36:08.820474] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-08T19:36:08.824497] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T19:36:09.617559] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-08T19:36:10.226487] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:36:10.417595] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-08T19:36:11.217564] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-08T19:36:11.445425] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T19:36:11.761932] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T19:36:12.017589] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-08T19:36:12.332629] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T19:36:12.817561] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-08T19:36:12.882828] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:36:12.885345] [INFO ] [REMOTE ] INGM: Full fetch complete (42244 records). [2025-10-08T19:36:12.885449] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-08T19:36:13.255147] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-08T19:36:13.255232] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-08T19:36:13.255913] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-08T19:36:13.255978] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-08T19:36:13.256995] [DEBUG] [LOCAL ] INGM: Trimmed 42244 records to 28664 (keeping 200 days of data) [2025-10-08T19:36:13.435091] [DEBUG] [LOCAL ] INGM: Primary data saved (28664 records). [2025-10-08T19:36:13.435254] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-08T19:36:13.435341] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGM took 46.4s. Estimated remaining: 2h 56m 30s. Rate: 7.1 symbols/min [2025-10-08T19:36:13.604835] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:13.617568] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-08T19:36:13.654334] [DEBUG] [LOCAL ] INVH: Loaded 53160 existing records from primary storage. [2025-10-08T19:36:13.654700] [INFO ] [MAIN ] INVH: Loaded 53160 existing records. [2025-10-08T19:36:13.834858] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:13.835096] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-08T19:36:13.835179] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-08T19:36:13.835467] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-08T19:36:13.835526] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-08T19:36:14.197510] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:14.284242] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T19:36:14.417565] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-08T19:36:14.729061] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T19:36:15.217567] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-08T19:36:15.645936] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T19:36:16.017626] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-08T19:36:16.794203] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:36:16.817534] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-08T19:36:17.625866] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-08T19:36:17.643368] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T19:36:18.385893] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:36:18.417499] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-08T19:36:18.798684] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T19:36:19.217598] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-08T19:36:19.684704] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T19:36:20.017558] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-08T19:36:20.183251] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T19:36:20.817588] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-08T19:36:21.406386] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T19:36:21.617551] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-08T19:36:21.828385] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T19:36:22.417590] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-08T19:36:23.217617] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-08T19:36:23.341446] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T19:36:24.009271] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:36:24.022556] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-08T19:36:24.561593] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T19:36:24.817577] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-08T19:36:25.617576] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-08T19:36:25.737928] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T19:36:25.978112] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T19:36:26.417623] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-08T19:36:27.109326] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:36:27.217623] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-08T19:36:27.869840] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:36:28.017567] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-08T19:36:28.817517] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-08T19:36:28.886618] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:36:29.109120] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T19:36:29.112302] [INFO ] [REMOTE ] INN: Full fetch complete (57862 records). [2025-10-08T19:36:29.112401] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-08T19:36:29.522170] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-08T19:36:29.522258] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-08T19:36:29.523150] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-08T19:36:29.523215] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-08T19:36:29.524484] [DEBUG] [LOCAL ] INN: Trimmed 57862 records to 41765 (keeping 200 days of data) [2025-10-08T19:36:29.617777] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-08T19:36:29.779866] [DEBUG] [LOCAL ] INN: Primary data saved (41765 records). [2025-10-08T19:36:29.780008] [INFO ] [MAIN ] INN: Full history saved. [2025-10-08T19:36:29.780092] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 32.9s. Estimated remaining: 2h 56m 31s. Rate: 7.1 symbols/min [2025-10-08T19:36:29.951424] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:29.979004] [DEBUG] [LOCAL ] INVX: Loaded 29163 existing records from primary storage. [2025-10-08T19:36:29.979281] [INFO ] [MAIN ] INVX: Loaded 29163 existing records. [2025-10-08T19:36:30.158232] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:30.158479] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-08T19:36:30.158564] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-08T19:36:30.159317] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-08T19:36:30.159380] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-08T19:36:30.420266] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-08T19:36:30.535878] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:30.583102] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T19:36:30.793175] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:36:31.217616] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-08T19:36:31.581170] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T19:36:32.017596] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-08T19:36:32.681481] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:36:32.817543] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-08T19:36:33.487429] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:36:33.617591] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-08T19:36:34.142050] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T19:36:34.417588] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-08T19:36:34.808252] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:36:34.812075] [INFO ] [REMOTE ] INSP: Full fetch complete (53241 records). [2025-10-08T19:36:34.812227] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-08T19:36:35.210130] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-08T19:36:35.210215] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-08T19:36:35.211043] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-08T19:36:35.211108] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-08T19:36:35.212267] [DEBUG] [LOCAL ] INSP: Trimmed 53241 records to 37638 (keeping 200 days of data) [2025-10-08T19:36:35.265332] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-08T19:36:35.456911] [DEBUG] [LOCAL ] INSP: Primary data saved (37638 records). [2025-10-08T19:36:35.457065] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-08T19:36:35.457151] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 31.0s. Estimated remaining: 2h 56m 19s. Rate: 7.1 symbols/min [2025-10-08T19:36:35.636187] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:35.689124] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-08T19:36:35.689459] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-08T19:36:35.889376] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:35.889582] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-08T19:36:35.889629] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-08T19:36:35.891614] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-08T19:36:35.891698] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-08T19:36:36.048818] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-08T19:36:36.311130] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:36.328128] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T19:36:36.822676] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-08T19:36:36.835054] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T19:36:37.617530] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-08T19:36:37.877792] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T19:36:38.417515] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-08T19:36:38.652252] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T19:36:38.848305] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:36:39.217616] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-08T19:36:40.017523] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-08T19:36:40.347906] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T19:36:40.817577] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-08T19:36:40.861833] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-08T19:36:41.112166] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T19:36:41.617581] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-08T19:36:42.245238] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T19:36:42.417558] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-08T19:36:42.944031] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:36:43.217553] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-08T19:36:43.807353] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T19:36:44.017567] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-08T19:36:44.714263] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:36:44.817532] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-08T19:36:45.308987] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:36:45.617573] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-08T19:36:46.417561] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-08T19:36:47.117032] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T19:36:47.121005] [INFO ] [REMOTE ] INVH: Full fetch complete (76743 records). [2025-10-08T19:36:47.121131] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-08T19:36:47.219227] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-08T19:36:47.534718] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-08T19:36:47.534947] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-08T19:36:47.536095] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-08T19:36:47.536287] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-08T19:36:47.548333] [DEBUG] [LOCAL ] INVH: Trimmed 76743 records to 53162 (keeping 200 days of data) [2025-10-08T19:36:47.570891] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-08T19:36:47.709041] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T19:36:47.713955] [INFO ] [REMOTE ] INSW: Full fetch complete (60233 records). [2025-10-08T19:36:47.714614] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-08T19:36:48.032815] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-08T19:36:48.314938] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-08T19:36:48.316822] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-08T19:36:48.317680] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-08T19:36:48.317875] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-08T19:36:48.326077] [DEBUG] [LOCAL ] INSW: Trimmed 60233 records to 39755 (keeping 200 days of data) [2025-10-08T19:36:48.384821] [DEBUG] [LOCAL ] INVH: Primary data saved (53162 records). [2025-10-08T19:36:48.394297] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-08T19:36:48.420480] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INVH took 35.0s. Estimated remaining: 2h 56m 16s. Rate: 7.1 symbols/min [2025-10-08T19:36:48.731347] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:48.759280] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:36:48.786554] [DEBUG] [LOCAL ] INSW: Primary data saved (39755 records). [2025-10-08T19:36:48.786844] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-08T19:36:48.786952] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSW took 44.1s. Estimated remaining: 2h 55m 58s. Rate: 7.1 symbols/min [2025-10-08T19:36:48.823927] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-08T19:36:48.826793] [DEBUG] [LOCAL ] IOT: Loaded 53472 existing records from primary storage. [2025-10-08T19:36:48.827186] [INFO ] [MAIN ] IOT: Loaded 53472 existing records. [2025-10-08T19:36:49.003181] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:49.003382] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-08T19:36:49.003428] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-08T19:36:49.004902] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-08T19:36:49.004963] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-08T19:36:49.357035] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:49.617534] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-08T19:36:49.934135] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T19:36:50.417571] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-08T19:36:50.664139] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-08T19:36:51.217517] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-08T19:36:51.372241] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T19:36:51.483866] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T19:36:52.017608] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-08T19:36:52.817576] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-08T19:36:53.133156] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T19:36:53.617562] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-08T19:36:53.665185] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-08T19:36:54.417563] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-08T19:36:54.456574] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T19:36:54.728225] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:36:54.730802] [INFO ] [REMOTE ] INVX: Full fetch complete (43746 records). [2025-10-08T19:36:54.730889] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-08T19:36:55.178321] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-08T19:36:55.178415] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-08T19:36:55.179204] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-08T19:36:55.179276] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-08T19:36:55.180394] [DEBUG] [LOCAL ] INVX: Trimmed 43746 records to 29189 (keeping 200 days of data) [2025-10-08T19:36:55.228148] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-08T19:36:55.356093] [DEBUG] [LOCAL ] INVX: Primary data saved (29189 records). [2025-10-08T19:36:55.356281] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-08T19:36:55.356391] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 25.6s. Estimated remaining: 2h 55m 48s. Rate: 7.1 symbols/min [2025-10-08T19:36:56.987897] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T19:36:56.999100] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-08T19:36:57.194193] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-08T19:36:57.205483] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-08T19:36:58.689921] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:36:58.702110] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-08T19:36:59.888525] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-08T19:36:59.900407] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-08T19:37:00.060370] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T19:37:00.073133] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-08T19:37:01.942357] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T19:37:01.953885] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-08T19:37:02.267275] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-08T19:37:02.278244] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-08T19:37:03.656197] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:37:03.667386] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-08T19:37:05.102912] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-08T19:37:05.114799] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-08T19:37:05.277755] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T19:37:05.289481] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-08T19:37:07.251887] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-08T19:37:07.263335] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-08T19:37:07.883708] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-08T19:37:07.895519] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-08T19:37:08.862639] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:37:08.874508] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-08T19:37:10.513535] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:37:10.529906] [INFO ] [REMOTE ] IOT: Full fetch complete (77394 records). [2025-10-08T19:37:10.548056] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-08T19:37:10.549712] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-08T19:37:10.620450] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-08T19:37:10.963348] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-08T19:37:10.963445] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-08T19:37:10.964453] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-08T19:37:10.964522] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-08T19:37:10.966192] [DEBUG] [LOCAL ] IOT: Trimmed 77394 records to 53475 (keeping 200 days of data) [2025-10-08T19:37:11.300134] [DEBUG] [LOCAL ] IOT: Primary data saved (53475 records). [2025-10-08T19:37:11.300269] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-08T19:37:11.300351] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. IOT took 22.9s. Estimated remaining: 2h 55m 48s. Rate: 7.1 symbols/min [2025-10-08T19:37:13.196048] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-08T19:37:13.205447] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-08T19:37:13.205702] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-08T19:37:13.671918] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-08T19:37:13.672046] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-08T19:37:13.673212] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-08T19:37:13.673285] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-08T19:37:13.674929] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-08T19:37:14.010616] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-08T19:37:14.010800] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-08T19:37:14.010885] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 38.6s. Estimated remaining: 2h 55m 33s. Rate: 7.1 symbols/min [2025-10-08T19:37:14.750190] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:14.862353] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:14.852912] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:14.989211] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:15.030821] [DEBUG] [LOCAL ] IPI: Loaded 21533 existing records from primary storage. [2025-10-08T19:37:15.033701] [INFO ] [MAIN ] IPI: Loaded 21533 existing records. [2025-10-08T19:37:15.055576] [DEBUG] [LOCAL ] IQI: Loaded 18006 existing records from primary storage. [2025-10-08T19:37:15.056122] [INFO ] [MAIN ] IQI: Loaded 18006 existing records. [2025-10-08T19:37:15.393013] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-08T19:37:15.492486] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-08T19:37:15.582947] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:15.594411] [DEBUG] [LOCAL ] IP: Loaded 53319 existing records from primary storage. [2025-10-08T19:37:15.625708] [INFO ] [MAIN ] IP: Loaded 53319 existing records. [2025-10-08T19:37:15.625459] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-08T19:37:15.695170] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-08T19:37:15.897501] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-08T19:37:15.892264] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:15.958101] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-08T19:37:15.970415] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-08T19:37:16.057018] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-08T19:37:16.075396] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:16.130249] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-08T19:37:16.146035] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-08T19:37:16.140723] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-08T19:37:16.158437] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-08T19:37:16.236178] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:16.231749] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-08T19:37:16.258079] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-08T19:37:16.258168] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-08T19:37:16.338795] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-08T19:37:16.539140] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-08T19:37:16.620012] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-08T19:37:17.249520] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:17.286677] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-08T19:37:17.481412] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:17.502183] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-08T19:37:17.535238] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:17.541626] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-08T19:37:17.683839] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:17.684143] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-08T19:37:18.351140] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T19:37:18.354925] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-08T19:37:18.932269] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T19:37:18.937881] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-08T19:37:19.053787] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:37:19.064566] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-08T19:37:19.214848] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T19:37:19.218624] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-08T19:37:19.711433] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:37:19.715808] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-08T19:37:19.781224] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-08T19:37:19.792782] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-08T19:37:19.831268] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T19:37:19.835534] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-08T19:37:20.498677] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T19:37:20.509722] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-08T19:37:20.556859] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T19:37:20.562336] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-08T19:37:20.667495] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T19:37:20.672981] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-08T19:37:21.166290] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T19:37:21.177022] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-08T19:37:21.546103] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T19:37:21.552473] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-08T19:37:21.649799] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T19:37:21.654752] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-08T19:37:22.060619] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T19:37:22.070677] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-08T19:37:22.460413] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:37:22.471273] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-08T19:37:22.487742] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:37:22.494980] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-08T19:37:22.509171] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T19:37:23.217530] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-08T19:37:23.263735] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T19:37:23.777908] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:37:23.873913] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T19:37:23.874994] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T19:37:24.017539] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-08T19:37:24.817516] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-08T19:37:24.955756] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T19:37:25.617547] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-08T19:37:26.426330] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-08T19:37:26.451426] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:37:27.217529] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-08T19:37:27.443990] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T19:37:27.467407] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T19:37:28.017555] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-08T19:37:28.688608] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T19:37:28.730113] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:37:28.817562] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-08T19:37:29.617519] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-08T19:37:30.417562] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-08T19:37:30.675603] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T19:37:30.689546] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T19:37:31.217616] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-08T19:37:31.882311] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T19:37:32.017617] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-08T19:37:32.199635] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T19:37:32.817527] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-08T19:37:33.595001] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:37:33.617508] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-08T19:37:34.417562] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-08T19:37:34.521259] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:37:35.217557] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-08T19:37:35.502772] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T19:37:35.533530] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T19:37:36.017562] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-08T19:37:36.819264] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-08T19:37:36.822232] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:37:37.325004] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T19:37:37.617571] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-08T19:37:37.796917] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T19:37:38.417567] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-08T19:37:39.180581] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T19:37:39.185295] [INFO ] [REMOTE ] IPG: Full fetch complete (77253 records). [2025-10-08T19:37:39.185422] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-08T19:37:39.222770] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-08T19:37:39.499381] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:37:39.545495] [INFO ] [REMOTE ] IQI: Full fetch complete (26790 records). [2025-10-08T19:37:39.548431] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-08T19:37:39.668963] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-08T19:37:39.687353] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-08T19:37:39.690912] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-08T19:37:39.691345] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-08T19:37:39.767718] [DEBUG] [LOCAL ] IPG: Trimmed 77253 records to 53330 (keeping 200 days of data) [2025-10-08T19:37:40.051549] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-08T19:37:40.084218] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-08T19:37:40.089079] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-08T19:37:40.095214] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-08T19:37:40.096580] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-08T19:37:40.104218] [DEBUG] [LOCAL ] IQI: Trimmed 26790 records to 17978 (keeping 200 days of data) [2025-10-08T19:37:40.322860] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T19:37:40.392884] [INFO ] [REMOTE ] IPI: Full fetch complete (29582 records). [2025-10-08T19:37:40.399196] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-08T19:37:40.736141] [DEBUG] [LOCAL ] IQI: Primary data saved (17978 records). [2025-10-08T19:37:40.750055] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-10-08T19:37:40.750177] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-08T19:37:40.755556] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-08T19:37:40.760908] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPG took 26.7s. Estimated remaining: 2h 55m 45s. Rate: 7.1 symbols/min [2025-10-08T19:37:40.800960] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IQI took 26.8s. Estimated remaining: 2h 55m 27s. Rate: 7.1 symbols/min [2025-10-08T19:37:40.900559] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-08T19:37:40.918312] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-08T19:37:40.969083] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-08T19:37:41.012106] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-08T19:37:41.049437] [DEBUG] [LOCAL ] IPI: Trimmed 29582 records to 21556 (keeping 200 days of data) [2025-10-08T19:37:41.223250] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:41.250216] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:41.353974] [DEBUG] [LOCAL ] IPI: Primary data saved (21556 records). [2025-10-08T19:37:41.354210] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-08T19:37:41.354387] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IPI took 27.3s. Estimated remaining: 2h 55m 10s. Rate: 7.1 symbols/min [2025-10-08T19:37:41.413972] [DEBUG] [LOCAL ] IQV: Loaded 50087 existing records from primary storage. [2025-10-08T19:37:41.434419] [INFO ] [MAIN ] IQV: Loaded 50087 existing records. [2025-10-08T19:37:41.472881] [DEBUG] [LOCAL ] IR: Loaded 52740 existing records from primary storage. [2025-10-08T19:37:41.497281] [INFO ] [MAIN ] IR: Loaded 52740 existing records. [2025-10-08T19:37:41.717276] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:41.900924] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:41.941609] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-08T19:37:41.952327] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-08T19:37:41.983800] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:41.978926] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-08T19:37:41.984542] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-08T19:37:41.996176] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-08T19:37:41.996388] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-08T19:37:42.043348] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-08T19:37:42.043599] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-08T19:37:42.348491] [DEBUG] [LOCAL ] IRM: Loaded 49283 existing records from primary storage. [2025-10-08T19:37:42.400425] [INFO ] [MAIN ] IRM: Loaded 49283 existing records. [2025-10-08T19:37:42.468957] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-08T19:37:42.692851] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-08T19:37:42.936954] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:42.989098] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-08T19:37:42.983635] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:43.015910] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-08T19:37:43.027779] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-08T19:37:43.062844] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:43.063201] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-08T19:37:43.056244] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-08T19:37:43.064492] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-08T19:37:43.424983] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:43.425334] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-08T19:37:44.358742] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T19:37:44.370274] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-08T19:37:44.728832] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:37:44.826913] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-08T19:37:44.832515] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:37:45.151079] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T19:37:45.617611] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-08T19:37:46.118700] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T19:37:46.122773] [INFO ] [REMOTE ] IP: Full fetch complete (77169 records). [2025-10-08T19:37:46.122906] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-08T19:37:46.433058] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-08T19:37:46.541573] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-08T19:37:46.541848] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-08T19:37:46.543014] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-08T19:37:46.543122] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-08T19:37:46.545169] [DEBUG] [LOCAL ] IP: Trimmed 77169 records to 53317 (keeping 200 days of data) [2025-10-08T19:37:46.670456] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T19:37:46.915275] [DEBUG] [LOCAL ] IP: Primary data saved (53317 records). [2025-10-08T19:37:46.915421] [INFO ] [MAIN ] IP: Full history saved. [2025-10-08T19:37:46.915505] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 32.9s. Estimated remaining: 2h 54m 59s. Rate: 7.1 symbols/min [2025-10-08T19:37:47.089842] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:47.117872] [DEBUG] [LOCAL ] IRS: Loaded 22364 existing records from primary storage. [2025-10-08T19:37:47.118351] [INFO ] [MAIN ] IRS: Loaded 22364 existing records. [2025-10-08T19:37:47.218638] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-08T19:37:47.302243] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:47.311612] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-08T19:37:47.324376] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-08T19:37:47.328528] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-08T19:37:47.328452] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T19:37:47.328676] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-08T19:37:47.686087] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:48.017511] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-08T19:37:48.309277] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T19:37:48.401366] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T19:37:48.817558] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-08T19:37:48.989512] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T19:37:49.617546] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-08T19:37:50.417542] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-08T19:37:50.478735] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T19:37:51.072349] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T19:37:51.217575] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-08T19:37:51.576839] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:37:52.017560] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-08T19:37:52.330097] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T19:37:52.817599] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-08T19:37:53.617521] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-08T19:37:53.727199] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:37:54.417580] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-08T19:37:54.701427] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T19:37:54.741382] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T19:37:55.217573] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-08T19:37:56.022675] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-08T19:37:56.048298] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:37:56.770278] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T19:37:56.817542] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-08T19:37:57.617729] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-08T19:37:57.839726] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T19:37:58.343682] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:37:58.366525] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:37:58.417613] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-08T19:37:59.217564] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-08T19:37:59.934463] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:38:00.017545] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-08T19:38:00.822703] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-08T19:38:00.858209] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:38:01.617603] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-08T19:38:01.837752] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T19:38:02.417547] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-08T19:38:02.526166] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T19:38:02.773274] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T19:38:03.217547] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-08T19:38:03.958323] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T19:38:04.017556] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-08T19:38:04.762341] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:38:04.817568] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-08T19:38:05.034586] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T19:38:05.617630] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-08T19:38:06.234833] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:38:06.417587] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-08T19:38:06.442634] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T19:38:07.217630] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-08T19:38:08.031161] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-08T19:38:08.034674] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T19:38:08.177447] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:38:08.817567] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-08T19:38:09.344960] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T19:38:09.617547] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-08T19:38:10.416198] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:38:10.425720] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-08T19:38:11.217563] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-08T19:38:11.367277] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T19:38:11.380963] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T19:38:12.017596] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-08T19:38:12.817550] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-08T19:38:13.001486] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T19:38:13.617548] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-08T19:38:13.931447] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T19:38:14.417521] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-08T19:38:14.454627] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:38:14.458625] [INFO ] [REMOTE ] IQV: Full fetch complete (72148 records). [2025-10-08T19:38:14.458773] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-08T19:38:14.754961] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T19:38:14.880022] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-08T19:38:14.880105] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-08T19:38:14.881058] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-08T19:38:14.881123] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-08T19:38:14.882549] [DEBUG] [LOCAL ] IQV: Trimmed 72148 records to 50072 (keeping 200 days of data) [2025-10-08T19:38:15.195412] [DEBUG] [LOCAL ] IQV: Primary data saved (50072 records). [2025-10-08T19:38:15.195580] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-08T19:38:15.195775] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQV took 34.4s. Estimated remaining: 2h 55m 12s. Rate: 7.1 symbols/min [2025-10-08T19:38:15.227013] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-08T19:38:15.365172] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:15.410359] [DEBUG] [LOCAL ] IRT: Loaded 50400 existing records from primary storage. [2025-10-08T19:38:15.410711] [INFO ] [MAIN ] IRT: Loaded 50400 existing records. [2025-10-08T19:38:15.582869] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:15.583066] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-08T19:38:15.583115] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-08T19:38:15.584273] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-08T19:38:15.584337] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-08T19:38:15.935948] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:16.017509] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-08T19:38:16.093114] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T19:38:16.097141] [INFO ] [REMOTE ] IR: Full fetch complete (76230 records). [2025-10-08T19:38:16.097316] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-08T19:38:16.484042] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-08T19:38:16.484324] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-08T19:38:16.485528] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-08T19:38:16.485720] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-08T19:38:16.487275] [DEBUG] [LOCAL ] IR: Trimmed 76230 records to 52750 (keeping 200 days of data) [2025-10-08T19:38:16.755092] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T19:38:16.824401] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-08T19:38:16.872254] [DEBUG] [LOCAL ] IR: Primary data saved (52750 records). [2025-10-08T19:38:16.872422] [INFO ] [MAIN ] IR: Full history saved. [2025-10-08T19:38:16.872510] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IR took 36.0s. Estimated remaining: 2h 54m 56s. Rate: 7.1 symbols/min [2025-10-08T19:38:17.052965] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:17.070887] [DEBUG] [LOCAL ] ISD: Loaded 15796 existing records from primary storage. [2025-10-08T19:38:17.071216] [INFO ] [MAIN ] ISD: Loaded 15796 existing records. [2025-10-08T19:38:17.340764] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:17.341187] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-08T19:38:17.341361] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-08T19:38:17.342252] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-08T19:38:17.342434] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-08T19:38:17.495823] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:38:17.622708] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-08T19:38:17.856486] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:17.905537] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:38:17.908080] [INFO ] [REMOTE ] IRS: Full fetch complete (32335 records). [2025-10-08T19:38:17.908165] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-08T19:38:18.269944] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-08T19:38:18.270030] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-08T19:38:18.270728] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-08T19:38:18.270791] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-08T19:38:18.271575] [DEBUG] [LOCAL ] IRS: Trimmed 32335 records to 22476 (keeping 200 days of data) [2025-10-08T19:38:18.401709] [DEBUG] [LOCAL ] IRS: Primary data saved (22476 records). [2025-10-08T19:38:18.401847] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-08T19:38:18.401930] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRS took 31.5s. Estimated remaining: 2h 54m 40s. Rate: 7.1 symbols/min [2025-10-08T19:38:18.422674] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-08T19:38:18.570708] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:18.610684] [DEBUG] [LOCAL ] IT: Loaded 42202 existing records from primary storage. [2025-10-08T19:38:18.610993] [INFO ] [MAIN ] IT: Loaded 42202 existing records. [2025-10-08T19:38:18.782712] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:18.782925] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-08T19:38:18.782971] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-08T19:38:18.783180] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-08T19:38:18.783238] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-08T19:38:19.139377] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:19.217509] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-08T19:38:19.285931] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T19:38:19.652935] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:38:20.017570] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-08T19:38:20.320963] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T19:38:20.817545] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-08T19:38:21.088638] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T19:38:21.617567] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-08T19:38:22.351946] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:38:22.417542] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-08T19:38:23.027491] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:38:23.217563] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-08T19:38:23.870958] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:38:24.017554] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-08T19:38:24.629595] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:38:24.633938] [INFO ] [REMOTE ] IRM: Full fetch complete (72303 records). [2025-10-08T19:38:24.634075] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-08T19:38:24.822800] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-08T19:38:25.077901] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-08T19:38:25.078000] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-08T19:38:25.078982] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-08T19:38:25.079047] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-08T19:38:25.080495] [DEBUG] [LOCAL ] IRM: Trimmed 72303 records to 49267 (keeping 200 days of data) [2025-10-08T19:38:25.394514] [DEBUG] [LOCAL ] IRM: Primary data saved (49267 records). [2025-10-08T19:38:25.394699] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-08T19:38:25.394801] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IRM took 44.0s. Estimated remaining: 2h 54m 30s. Rate: 7.1 symbols/min [2025-10-08T19:38:25.581671] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T19:38:25.598589] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:25.617507] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-08T19:38:25.645099] [DEBUG] [LOCAL ] ITGR: Loaded 31277 existing records from primary storage. [2025-10-08T19:38:25.645394] [INFO ] [MAIN ] ITGR: Loaded 31277 existing records. [2025-10-08T19:38:25.820633] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:25.820912] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-08T19:38:25.820960] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-08T19:38:25.821428] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-08T19:38:25.821486] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-08T19:38:26.175199] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:26.193681] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T19:38:26.417530] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-08T19:38:26.802300] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:38:27.217520] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-08T19:38:27.347075] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T19:38:28.017566] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-08T19:38:28.080811] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T19:38:28.817539] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-08T19:38:29.020081] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T19:38:29.617557] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-08T19:38:29.674272] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T19:38:30.417544] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-08T19:38:31.184379] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:38:31.217562] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-08T19:38:32.013798] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T19:38:32.023194] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-08T19:38:32.483787] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T19:38:32.817586] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-08T19:38:33.074747] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T19:38:33.617562] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-08T19:38:34.204859] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:38:34.417602] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-08T19:38:35.121608] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:38:35.217550] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-08T19:38:36.017585] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-08T19:38:36.092062] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:38:36.687180] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T19:38:36.817534] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-08T19:38:37.012869] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T19:38:37.617580] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-08T19:38:38.368625] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:38:38.417544] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-08T19:38:38.533804] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T19:38:39.217566] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-08T19:38:40.010227] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T19:38:40.014568] [INFO ] [REMOTE ] IRT: Full fetch complete (72762 records). [2025-10-08T19:38:40.014749] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-08T19:38:40.026603] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-08T19:38:40.152045] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T19:38:40.437468] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-08T19:38:40.437562] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-08T19:38:40.438551] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-08T19:38:40.438621] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-08T19:38:40.440167] [DEBUG] [LOCAL ] IRT: Trimmed 72762 records to 50424 (keeping 200 days of data) [2025-10-08T19:38:40.751333] [DEBUG] [LOCAL ] IRT: Primary data saved (50424 records). [2025-10-08T19:38:40.751499] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-08T19:38:40.751589] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRT took 25.6s. Estimated remaining: 2h 54m 29s. Rate: 7.1 symbols/min [2025-10-08T19:38:40.826829] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-08T19:38:40.923951] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:40.960307] [DEBUG] [LOCAL ] ITT: Loaded 32663 existing records from primary storage. [2025-10-08T19:38:40.960594] [INFO ] [MAIN ] ITT: Loaded 32663 existing records. [2025-10-08T19:38:41.140573] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:41.140850] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-08T19:38:41.140898] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-08T19:38:41.141141] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-08T19:38:41.141198] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-08T19:38:41.521111] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:41.565908] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:38:41.617543] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-08T19:38:42.382142] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T19:38:42.417541] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-08T19:38:42.690287] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T19:38:43.217598] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-08T19:38:43.938721] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T19:38:44.017505] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-08T19:38:44.446218] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:38:44.817530] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-08T19:38:45.590391] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T19:38:45.594835] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T19:38:45.617492] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-08T19:38:46.417568] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-08T19:38:47.217522] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-08T19:38:47.293231] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T19:38:47.296709] [INFO ] [REMOTE ] IT: Full fetch complete (56681 records). [2025-10-08T19:38:47.296810] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-08T19:38:47.666624] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T19:38:47.714356] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-08T19:38:47.714903] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-08T19:38:47.715942] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-08T19:38:47.716010] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-08T19:38:47.717419] [DEBUG] [LOCAL ] IT: Trimmed 56681 records to 42164 (keeping 200 days of data) [2025-10-08T19:38:47.981851] [DEBUG] [LOCAL ] IT: Primary data saved (42164 records). [2025-10-08T19:38:47.981990] [INFO ] [MAIN ] IT: Full history saved. [2025-10-08T19:38:47.982084] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IT took 29.6s. Estimated remaining: 2h 54m 20s. Rate: 7.1 symbols/min [2025-10-08T19:38:48.024088] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-08T19:38:48.162685] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:48.211915] [DEBUG] [LOCAL ] ITUB: Loaded 53315 existing records from primary storage. [2025-10-08T19:38:48.212276] [INFO ] [MAIN ] ITUB: Loaded 53315 existing records. [2025-10-08T19:38:48.392229] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:48.392470] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-08T19:38:48.392548] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-08T19:38:48.392900] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-08T19:38:48.393022] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-08T19:38:48.502354] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:38:48.769313] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:48.817490] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-08T19:38:49.099828] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T19:38:49.617617] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-08T19:38:50.297878] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:38:50.417564] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-08T19:38:50.840855] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T19:38:51.217519] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-08T19:38:51.273127] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T19:38:52.017580] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-08T19:38:52.380394] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:38:52.817580] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-08T19:38:53.324589] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:38:53.478326] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T19:38:53.480304] [INFO ] [REMOTE ] ISD: Full fetch complete (24125 records). [2025-10-08T19:38:53.480383] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-08T19:38:53.622799] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-08T19:38:53.848352] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-08T19:38:53.848433] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-08T19:38:53.849002] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-08T19:38:53.849066] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-08T19:38:53.849740] [DEBUG] [LOCAL ] ISD: Trimmed 24125 records to 15838 (keeping 200 days of data) [2025-10-08T19:38:53.953001] [DEBUG] [LOCAL ] ISD: Primary data saved (15838 records). [2025-10-08T19:38:53.953147] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-08T19:38:53.953234] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ISD took 37.1s. Estimated remaining: 2h 54m 9s. Rate: 7.1 symbols/min [2025-10-08T19:38:54.130795] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:54.176954] [DEBUG] [LOCAL ] ITW: Loaded 45729 existing records from primary storage. [2025-10-08T19:38:54.177270] [INFO ] [MAIN ] ITW: Loaded 45729 existing records. [2025-10-08T19:38:54.350847] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:54.351116] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-08T19:38:54.351169] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-08T19:38:54.351417] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-08T19:38:54.351474] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-08T19:38:54.422705] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-08T19:38:54.704511] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:55.163170] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T19:38:55.217495] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-08T19:38:55.744434] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:38:56.017573] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-08T19:38:56.744155] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T19:38:56.817520] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-08T19:38:57.015322] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T19:38:57.617550] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-08T19:38:58.417529] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-08T19:38:58.656719] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T19:38:58.679223] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:38:59.217577] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-08T19:38:59.827295] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T19:39:00.017682] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-08T19:39:00.568123] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T19:39:00.817695] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-08T19:39:01.617523] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-08T19:39:01.892025] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T19:39:02.417573] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-08T19:39:02.725415] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T19:39:02.830676] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T19:39:02.833253] [INFO ] [REMOTE ] ITGR: Full fetch complete (42248 records). [2025-10-08T19:39:02.833352] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-08T19:39:03.216771] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-08T19:39:03.216857] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-08T19:39:03.217671] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-08T19:39:03.217593] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-08T19:39:03.218810] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-08T19:39:03.219879] [DEBUG] [LOCAL ] ITGR: Trimmed 42248 records to 31212 (keeping 200 days of data) [2025-10-08T19:39:03.418293] [DEBUG] [LOCAL ] ITGR: Primary data saved (31212 records). [2025-10-08T19:39:03.418466] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-08T19:39:03.418616] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ITGR took 38.0s. Estimated remaining: 2h 54m 1s. Rate: 7.1 symbols/min [2025-10-08T19:39:03.605472] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:03.651565] [DEBUG] [LOCAL ] IVR: Loaded 48059 existing records from primary storage. [2025-10-08T19:39:03.651984] [INFO ] [MAIN ] IVR: Loaded 48059 existing records. [2025-10-08T19:39:03.849719] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:03.850012] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-08T19:39:03.850096] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-08T19:39:03.850401] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-08T19:39:03.850483] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-08T19:39:04.019630] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-08T19:39:04.117145] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T19:39:04.267777] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:04.817515] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-08T19:39:04.849251] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T19:39:05.622632] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-08T19:39:05.643669] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T19:39:06.348468] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T19:39:06.417510] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-08T19:39:06.763156] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T19:39:07.217572] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-08T19:39:08.017601] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-08T19:39:08.337115] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T19:39:08.817597] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-08T19:39:08.948957] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:39:08.978986] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:39:09.617561] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-08T19:39:10.417605] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-08T19:39:10.505743] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T19:39:10.680521] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T19:39:11.217560] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-08T19:39:11.713373] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T19:39:12.017545] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-08T19:39:12.817510] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-08T19:39:12.924025] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T19:39:13.560743] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:39:13.617527] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-08T19:39:14.417566] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-08T19:39:14.475116] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T19:39:15.121518] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:39:15.217526] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-08T19:39:15.753513] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T19:39:16.017604] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-08T19:39:16.692872] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T19:39:16.817548] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-08T19:39:17.317536] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:39:17.617546] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-08T19:39:18.056864] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T19:39:18.417547] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-08T19:39:19.217550] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-08T19:39:19.541560] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T19:39:19.547532] [INFO ] [REMOTE ] ITUB: Full fetch complete (77157 records). [2025-10-08T19:39:19.547823] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-08T19:39:19.972221] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-08T19:39:19.972325] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-08T19:39:19.973383] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-08T19:39:19.973518] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-08T19:39:19.975640] [DEBUG] [LOCAL ] ITUB: Trimmed 77157 records to 53313 (keeping 200 days of data) [2025-10-08T19:39:20.026167] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-08T19:39:20.111240] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T19:39:20.339467] [DEBUG] [LOCAL ] ITUB: Primary data saved (53313 records). [2025-10-08T19:39:20.339612] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-08T19:39:20.339722] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITUB took 32.4s. Estimated remaining: 2h 54m 2s. Rate: 7.1 symbols/min [2025-10-08T19:39:20.540691] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:20.575489] [DEBUG] [LOCAL ] IVT: Loaded 30888 existing records from primary storage. [2025-10-08T19:39:20.575849] [INFO ] [MAIN ] IVT: Loaded 30888 existing records. [2025-10-08T19:39:20.823119] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-08T19:39:20.822966] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:20.825096] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-08T19:39:20.825167] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-08T19:39:20.825401] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-08T19:39:20.825490] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-08T19:39:21.207059] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:21.241158] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T19:39:21.313062] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T19:39:21.315768] [INFO ] [REMOTE ] ITT: Full fetch complete (46965 records). [2025-10-08T19:39:21.315913] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-08T19:39:21.622732] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-08T19:39:21.784355] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-08T19:39:21.784455] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-08T19:39:21.785662] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-08T19:39:21.785729] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-08T19:39:21.787168] [DEBUG] [LOCAL ] ITT: Trimmed 46965 records to 32595 (keeping 200 days of data) [2025-10-08T19:39:22.009066] [DEBUG] [LOCAL ] ITT: Primary data saved (32595 records). [2025-10-08T19:39:22.009224] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-08T19:39:22.010203] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 41.3s. Estimated remaining: 2h 53m 46s. Rate: 7.1 symbols/min [2025-10-08T19:39:22.211835] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:22.266994] [DEBUG] [LOCAL ] IVZ: Loaded 53132 existing records from primary storage. [2025-10-08T19:39:22.267462] [INFO ] [MAIN ] IVZ: Loaded 53132 existing records. [2025-10-08T19:39:22.450819] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:22.451057] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-08T19:39:22.452766] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-08T19:39:22.452864] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-08T19:39:22.453252] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-08T19:39:22.453458] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-08T19:39:22.575233] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:39:23.004378] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:23.217519] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-08T19:39:23.328707] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T19:39:23.829007] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:39:24.017611] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-08T19:39:24.813579] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T19:39:24.823408] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-08T19:39:25.617513] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-08T19:39:25.685759] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T19:39:26.137025] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:39:26.417588] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-08T19:39:27.066709] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T19:39:27.217571] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-08T19:39:28.017607] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-08T19:39:28.107672] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T19:39:28.111562] [INFO ] [REMOTE ] IVR: Full fetch complete (69207 records). [2025-10-08T19:39:28.111720] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-08T19:39:28.507183] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-08T19:39:28.507283] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-08T19:39:28.508207] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-08T19:39:28.508279] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-08T19:39:28.509834] [DEBUG] [LOCAL ] IVR: Trimmed 69207 records to 48111 (keeping 200 days of data) [2025-10-08T19:39:28.802508] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:39:28.828207] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-08T19:39:28.843550] [DEBUG] [LOCAL ] IVR: Primary data saved (48111 records). [2025-10-08T19:39:28.843733] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-08T19:39:28.843835] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. IVR took 25.4s. Estimated remaining: 2h 53m 36s. Rate: 7.1 symbols/min [2025-10-08T19:39:29.027457] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:29.049296] [DEBUG] [LOCAL ] IX: Loaded 22307 existing records from primary storage. [2025-10-08T19:39:29.049676] [INFO ] [MAIN ] IX: Loaded 22307 existing records. [2025-10-08T19:39:29.246909] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:29.247141] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-08T19:39:29.247190] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-08T19:39:29.247400] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-08T19:39:29.247459] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-08T19:39:29.630639] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-08T19:39:29.671179] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:29.707761] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T19:39:30.083401] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:39:30.417530] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-08T19:39:31.217622] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-08T19:39:31.489420] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:39:31.489160] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T19:39:32.017586] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-08T19:39:32.228338] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T19:39:32.431337] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-08T19:39:32.817548] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-08T19:39:33.617555] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-08T19:39:34.375272] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T19:39:34.417571] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-08T19:39:34.950813] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:39:35.217561] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-08T19:39:35.935386] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T19:39:36.017546] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-08T19:39:36.563402] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:39:36.817718] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-08T19:39:37.613256] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:39:37.622270] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-08T19:39:38.417520] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-08T19:39:38.465771] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T19:39:38.668828] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:39:39.217524] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-08T19:39:39.263696] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T19:39:40.017622] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-08T19:39:40.817512] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-08T19:39:40.857811] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:39:41.392211] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:39:41.541544] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T19:39:41.617544] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-08T19:39:42.417552] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-08T19:39:42.915877] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T19:39:43.217549] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-08T19:39:43.394007] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T19:39:44.017554] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-08T19:39:44.594592] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:39:44.598013] [INFO ] [REMOTE ] ITW: Full fetch complete (66425 records). [2025-10-08T19:39:44.598141] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-08T19:39:44.824687] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-08T19:39:44.999316] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-08T19:39:44.999405] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-08T19:39:45.000370] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-08T19:39:45.000435] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-08T19:39:45.001761] [DEBUG] [LOCAL ] ITW: Trimmed 66425 records to 45750 (keeping 200 days of data) [2025-10-08T19:39:45.299176] [DEBUG] [LOCAL ] ITW: Primary data saved (45750 records). [2025-10-08T19:39:45.299332] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-08T19:39:45.299455] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITW took 51.3s. Estimated remaining: 2h 53m 36s. Rate: 7.1 symbols/min [2025-10-08T19:39:45.476583] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:45.503712] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:39:45.549552] [DEBUG] [LOCAL ] J: Loaded 40213 existing records from primary storage. [2025-10-08T19:39:45.550017] [INFO ] [MAIN ] J: Loaded 40213 existing records. [2025-10-08T19:39:45.622693] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-08T19:39:45.760135] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:45.761480] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:39:45.761686] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-08T19:39:45.767578] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-08T19:39:45.768134] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-08T19:39:45.768191] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-08T19:39:46.116965] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:46.417550] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-08T19:39:46.681540] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T19:39:46.685942] [INFO ] [REMOTE ] IVT: Full fetch complete (45624 records). [2025-10-08T19:39:46.686092] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-08T19:39:47.097254] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-08T19:39:47.097337] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-08T19:39:47.098145] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-08T19:39:47.098240] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-08T19:39:47.099426] [DEBUG] [LOCAL ] IVT: Trimmed 45624 records to 30981 (keeping 200 days of data) [2025-10-08T19:39:47.218716] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-08T19:39:47.304883] [DEBUG] [LOCAL ] IVT: Primary data saved (30981 records). [2025-10-08T19:39:47.305033] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-08T19:39:47.305169] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVT took 27.0s. Estimated remaining: 2h 53m 21s. Rate: 7.1 symbols/min [2025-10-08T19:39:47.488934] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:47.518328] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T19:39:47.565524] [DEBUG] [LOCAL ] JBGS: Loaded 42319 existing records from primary storage. [2025-10-08T19:39:47.565864] [INFO ] [MAIN ] JBGS: Loaded 42319 existing records. [2025-10-08T19:39:47.747740] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:47.747986] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-08T19:39:47.748034] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-08T19:39:47.748246] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-08T19:39:47.748304] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-08T19:39:48.022747] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-08T19:39:48.145810] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:48.305529] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T19:39:48.817569] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-08T19:39:49.625795] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-08T19:39:49.646023] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T19:39:49.898552] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T19:39:50.417573] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-08T19:39:50.968232] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:39:51.217608] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-08T19:39:52.017583] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-08T19:39:52.162571] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:39:52.383953] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:39:52.817631] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-08T19:39:52.946463] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T19:39:53.617599] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-08T19:39:54.417735] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-08T19:39:54.418995] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T19:39:54.680076] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T19:39:55.217587] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-08T19:39:56.017542] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-08T19:39:56.131154] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T19:39:56.513004] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:39:56.817616] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-08T19:39:57.616517] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T19:39:57.625097] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-08T19:39:58.317108] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:39:58.417530] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-08T19:39:59.087283] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:39:59.217569] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-08T19:39:59.925066] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:40:00.017588] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-08T19:40:00.817573] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-08T19:40:00.830057] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T19:40:00.834113] [INFO ] [REMOTE ] IVZ: Full fetch complete (76815 records). [2025-10-08T19:40:00.834227] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-08T19:40:01.233303] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-08T19:40:01.233513] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-08T19:40:01.234810] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-08T19:40:01.234919] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-08T19:40:01.237373] [DEBUG] [LOCAL ] IVZ: Trimmed 76815 records to 53114 (keeping 200 days of data) [2025-10-08T19:40:01.375331] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T19:40:01.614011] [DEBUG] [LOCAL ] IVZ: Primary data saved (53114 records). [2025-10-08T19:40:01.614171] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-08T19:40:01.614286] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVZ took 39.6s. Estimated remaining: 2h 53m 19s. Rate: 7.1 symbols/min [2025-10-08T19:40:01.626022] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-08T19:40:01.810629] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:01.854180] [DEBUG] [LOCAL ] JBI: Loaded 43410 existing records from primary storage. [2025-10-08T19:40:01.854550] [INFO ] [MAIN ] JBI: Loaded 43410 existing records. [2025-10-08T19:40:02.040763] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:02.040996] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-08T19:40:02.041044] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-08T19:40:02.041306] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-08T19:40:02.041376] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-08T19:40:02.428897] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-08T19:40:02.487211] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:02.784139] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T19:40:02.875299] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-08T19:40:03.217597] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-08T19:40:04.017513] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-08T19:40:04.052187] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T19:40:04.817600] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-08T19:40:04.881023] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T19:40:05.281750] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T19:40:05.431959] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T19:40:05.617598] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-08T19:40:06.417535] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-08T19:40:06.568100] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T19:40:06.570710] [INFO ] [REMOTE ] IX: Full fetch complete (27704 records). [2025-10-08T19:40:06.570892] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-08T19:40:06.981562] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-08T19:40:06.981731] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-08T19:40:06.982706] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-08T19:40:06.982775] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-08T19:40:06.984143] [DEBUG] [LOCAL ] IX: Trimmed 27704 records to 22302 (keeping 200 days of data) [2025-10-08T19:40:07.149379] [DEBUG] [LOCAL ] IX: Primary data saved (22302 records). [2025-10-08T19:40:07.149586] [INFO ] [MAIN ] IX: Full history saved. [2025-10-08T19:40:07.149726] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IX took 38.3s. Estimated remaining: 2h 53m 7s. Rate: 7.1 symbols/min [2025-10-08T19:40:07.231208] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-08T19:40:07.357574] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:07.415197] [DEBUG] [LOCAL ] JBL: Loaded 48387 existing records from primary storage. [2025-10-08T19:40:07.415736] [INFO ] [MAIN ] JBL: Loaded 48387 existing records. [2025-10-08T19:40:07.610062] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:07.610595] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-08T19:40:07.610771] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-08T19:40:07.611159] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-08T19:40:07.611230] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-08T19:40:07.909432] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:40:08.040615] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-08T19:40:08.047037] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:08.683687] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T19:40:08.817584] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-08T19:40:09.149912] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:40:09.617591] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-08T19:40:09.807943] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T19:40:10.417574] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-08T19:40:11.112249] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T19:40:11.217571] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-08T19:40:11.996062] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:40:12.017582] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-08T19:40:12.328150] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T19:40:12.817556] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-08T19:40:13.439398] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:40:13.442618] [INFO ] [REMOTE ] JBGS: Full fetch complete (59414 records). [2025-10-08T19:40:13.442750] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-08T19:40:13.630235] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-08T19:40:13.844129] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-08T19:40:13.844227] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-08T19:40:13.845061] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-08T19:40:13.845125] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-08T19:40:13.846461] [DEBUG] [LOCAL ] JBGS: Trimmed 59414 records to 42213 (keeping 200 days of data) [2025-10-08T19:40:14.101321] [DEBUG] [LOCAL ] JBGS: Primary data saved (42213 records). [2025-10-08T19:40:14.101474] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-08T19:40:14.101562] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. JBGS took 26.8s. Estimated remaining: 2h 52m 57s. Rate: 7.1 symbols/min [2025-10-08T19:40:14.279862] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:14.307152] [DEBUG] [LOCAL ] JBND: Loaded 26404 existing records from primary storage. [2025-10-08T19:40:14.307430] [INFO ] [MAIN ] JBND: Loaded 26404 existing records. [2025-10-08T19:40:14.429524] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-08T19:40:14.492100] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:14.492668] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-08T19:40:14.492890] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-08T19:40:14.493184] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-08T19:40:14.493341] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-08T19:40:14.624352] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T19:40:14.908223] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:15.009868] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T19:40:15.217559] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-08T19:40:15.708842] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T19:40:16.017556] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-08T19:40:16.550287] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:40:16.817578] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-08T19:40:17.623931] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-08T19:40:17.647318] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T19:40:17.806420] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T19:40:18.417636] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-08T19:40:19.057734] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:40:19.062597] [INFO ] [REMOTE ] J: Full fetch complete (59191 records). [2025-10-08T19:40:19.062799] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-08T19:40:19.222742] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-08T19:40:19.476576] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-08T19:40:19.476681] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-08T19:40:19.477580] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-08T19:40:19.477665] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-08T19:40:19.478890] [DEBUG] [LOCAL ] J: Trimmed 59191 records to 40192 (keeping 200 days of data) [2025-10-08T19:40:19.734500] [DEBUG] [LOCAL ] J: Primary data saved (40192 records). [2025-10-08T19:40:19.734629] [INFO ] [MAIN ] J: Full history saved. [2025-10-08T19:40:19.734744] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. J took 34.4s. Estimated remaining: 2h 52m 46s. Rate: 7.1 symbols/min [2025-10-08T19:40:19.909010] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:19.909170] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-08T19:40:19.909206] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-08T19:40:19.909336] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-08T19:40:19.909380] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-08T19:40:19.909420] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-08T19:40:19.909452] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-08T19:40:20.018742] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-08T19:40:20.289458] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:20.320840] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T19:40:20.817571] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-08T19:40:20.956631] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T19:40:21.027503] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:40:21.027864] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-08T19:40:21.027956] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:40:21.028022] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-08T19:40:21.028086] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:40:21.028158] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-08T19:40:21.028223] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-08T19:40:21.028258] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-08T19:40:21.028297] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-08T19:40:21.028386] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBS took 1.3s. Estimated remaining: 2h 52m 30s. Rate: 7.1 symbols/min [2025-10-08T19:40:21.202308] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:21.202558] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-08T19:40:21.202626] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-08T19:40:21.202789] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-08T19:40:21.202849] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-08T19:40:21.202997] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-08T19:40:21.203162] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-08T19:40:21.351027] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T19:40:21.618581] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-08T19:40:21.621709] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:22.377162] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T19:40:22.417540] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-08T19:40:23.217582] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-08T19:40:23.482179] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T19:40:24.017548] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-08T19:40:24.817525] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-08T19:40:25.004395] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:40:25.005209] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-08T19:40:25.005359] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:40:25.007520] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T19:40:25.007627] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-08T19:40:25.011679] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:40:25.018286] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-08T19:40:25.019019] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-08T19:40:25.019483] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-08T19:40:25.019553] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-08T19:40:25.019606] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBTM took 4.0s. Estimated remaining: 2h 52m 17s. Rate: 7.1 symbols/min [2025-10-08T19:40:25.208421] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:25.224548] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:40:25.235854] [DEBUG] [LOCAL ] JCE: Loaded 7029 existing records from primary storage. [2025-10-08T19:40:25.236057] [INFO ] [MAIN ] JCE: Loaded 7029 existing records. [2025-10-08T19:40:25.410855] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:25.411059] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-08T19:40:25.411107] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-08T19:40:25.411337] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-08T19:40:25.411395] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-08T19:40:25.622746] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-08T19:40:25.765002] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:26.417611] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-08T19:40:27.217525] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-08T19:40:27.301228] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:40:27.702106] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-08T19:40:28.022834] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-08T19:40:28.038799] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T19:40:28.556219] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T19:40:28.817561] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-08T19:40:29.617586] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-08T19:40:29.902309] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T19:40:30.417572] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-08T19:40:31.067530] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:40:31.217527] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-08T19:40:31.794057] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T19:40:31.867146] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:40:32.017604] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-08T19:40:32.817612] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-08T19:40:33.545233] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T19:40:33.617513] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-08T19:40:33.636714] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T19:40:34.417552] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-08T19:40:34.960605] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T19:40:35.217520] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-08T19:40:35.304333] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T19:40:36.017556] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-08T19:40:36.656776] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:40:36.817582] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-08T19:40:37.311693] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T19:40:37.617575] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-08T19:40:37.861219] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T19:40:38.112706] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T19:40:38.417594] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-08T19:40:39.217554] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-08T19:40:39.989095] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T19:40:40.017547] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-08T19:40:40.572581] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T19:40:40.575904] [INFO ] [REMOTE ] JBI: Full fetch complete (64155 records). [2025-10-08T19:40:40.576027] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-08T19:40:40.691201] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T19:40:40.822734] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-08T19:40:40.985188] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-08T19:40:40.985283] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-08T19:40:40.986194] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-08T19:40:40.986262] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-08T19:40:40.987692] [DEBUG] [LOCAL ] JBI: Trimmed 64155 records to 43319 (keeping 200 days of data) [2025-10-08T19:40:41.234527] [DEBUG] [LOCAL ] JBI: Primary data saved (43319 records). [2025-10-08T19:40:41.234689] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-08T19:40:41.234788] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBI took 39.6s. Estimated remaining: 2h 52m 17s. Rate: 7.1 symbols/min [2025-10-08T19:40:41.407324] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:41.459557] [DEBUG] [LOCAL ] JCI: Loaded 53538 existing records from primary storage. [2025-10-08T19:40:41.460034] [INFO ] [MAIN ] JCI: Loaded 53538 existing records. [2025-10-08T19:40:41.617736] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-08T19:40:41.639176] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:41.640335] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-08T19:40:41.640388] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-08T19:40:41.640601] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-08T19:40:41.640702] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-08T19:40:42.004780] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:42.266333] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T19:40:42.417504] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-08T19:40:42.682985] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T19:40:43.135734] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T19:40:43.217546] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-08T19:40:44.017573] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-08T19:40:44.593526] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T19:40:44.754459] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T19:40:44.758183] [INFO ] [REMOTE ] JBL: Full fetch complete (70387 records). [2025-10-08T19:40:44.758301] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-08T19:40:44.822725] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-08T19:40:45.169434] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-08T19:40:45.169525] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-08T19:40:45.170515] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-08T19:40:45.170584] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-08T19:40:45.172026] [DEBUG] [LOCAL ] JBL: Trimmed 70387 records to 48364 (keeping 200 days of data) [2025-10-08T19:40:45.484561] [DEBUG] [LOCAL ] JBL: Primary data saved (48364 records). [2025-10-08T19:40:45.484770] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-08T19:40:45.484881] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBL took 38.3s. Estimated remaining: 2h 52m 4s. Rate: 7.1 symbols/min [2025-10-08T19:40:45.623491] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-08T19:40:45.657289] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:45.704363] [DEBUG] [LOCAL ] JEF: Loaded 50041 existing records from primary storage. [2025-10-08T19:40:45.704741] [INFO ] [MAIN ] JEF: Loaded 50041 existing records. [2025-10-08T19:40:45.891950] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:45.892183] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-08T19:40:45.892233] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-08T19:40:45.892512] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-08T19:40:45.892573] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-08T19:40:46.195148] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:40:46.285577] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:46.417596] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-08T19:40:47.217590] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-08T19:40:47.457589] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T19:40:48.024620] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-08T19:40:48.030527] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T19:40:48.272613] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T19:40:48.817602] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-08T19:40:49.432605] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T19:40:49.464527] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T19:40:49.617549] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-08T19:40:50.417553] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-08T19:40:51.209095] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:40:51.218886] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-08T19:40:51.591369] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T19:40:51.594283] [INFO ] [REMOTE ] JBND: Full fetch complete (34806 records). [2025-10-08T19:40:51.594367] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-08T19:40:51.894920] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T19:40:51.924809] [INFO ] [REMOTE ] JCE: Full fetch complete (9640 records). [2025-10-08T19:40:51.943424] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-08T19:40:52.026291] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-08T19:40:52.026506] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-08T19:40:52.038071] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-08T19:40:52.058094] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-08T19:40:52.070066] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-08T19:40:52.090097] [DEBUG] [LOCAL ] JBND: Trimmed 34806 records to 26515 (keeping 200 days of data) [2025-10-08T19:40:52.480829] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-08T19:40:52.482232] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-08T19:40:52.485433] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-08T19:40:52.486762] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-08T19:40:52.491198] [DEBUG] [LOCAL ] JCE: Trimmed 9640 records to 7134 (keeping 200 days of data) [2025-10-08T19:40:52.573256] [DEBUG] [LOCAL ] JCE: Primary data saved (7134 records). [2025-10-08T19:40:52.573873] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-08T19:40:52.573997] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JCE took 27.6s. Estimated remaining: 2h 51m 54s. Rate: 7.1 symbols/min [2025-10-08T19:40:52.714289] [DEBUG] [LOCAL ] JBND: Primary data saved (26515 records). [2025-10-08T19:40:52.734246] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-08T19:40:52.760525] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBND took 38.7s. Estimated remaining: 2h 51m 37s. Rate: 7.1 symbols/min [2025-10-08T19:40:52.760429] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:52.824797] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-08T19:40:52.938158] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:52.958765] [DEBUG] [LOCAL ] JEQ: Loaded 8664 existing records from primary storage. [2025-10-08T19:40:52.959735] [INFO ] [MAIN ] JEQ: Loaded 8664 existing records. [2025-10-08T19:40:53.043512] [DEBUG] [LOCAL ] JELD: Loaded 46120 existing records from primary storage. [2025-10-08T19:40:53.092008] [INFO ] [MAIN ] JELD: Loaded 46120 existing records. [2025-10-08T19:40:53.288215] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:53.299076] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-08T19:40:53.299476] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-08T19:40:53.315428] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-08T19:40:53.325778] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-08T19:40:53.468862] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:53.479701] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-08T19:40:53.496020] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-08T19:40:53.496675] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-08T19:40:53.502455] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-08T19:40:54.127379] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:54.149518] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-08T19:40:54.149030] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:54.183970] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-08T19:40:54.417576] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-08T19:40:54.718348] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T19:40:55.217508] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-08T19:40:55.656859] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-08T19:40:55.691265] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:40:55.794425] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:40:56.017563] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-08T19:40:56.817615] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-08T19:40:57.429278] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T19:40:57.629061] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-08T19:40:57.657841] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T19:40:58.417560] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-08T19:40:58.850103] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T19:40:59.194800] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:40:59.217506] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-08T19:41:00.017573] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-08T19:41:00.817616] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-08T19:41:01.039937] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T19:41:01.513604] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T19:41:01.617710] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-08T19:41:02.054120] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-08T19:41:02.417570] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-08T19:41:02.654603] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:41:03.026018] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-08T19:41:03.217587] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-08T19:41:04.017584] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-08T19:41:04.817505] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-08T19:41:04.957553] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T19:41:05.426198] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:41:05.617562] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-08T19:41:06.200249] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:41:06.417558] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-08T19:41:07.118191] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T19:41:07.217572] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-08T19:41:08.017639] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-08T19:41:08.147785] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T19:41:08.458480] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T19:41:08.740823] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T19:41:08.817579] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-08T19:41:09.420434] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:41:09.617554] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-08T19:41:10.417613] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-08T19:41:11.194341] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:41:11.217494] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-08T19:41:11.688084] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T19:41:12.017600] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-08T19:41:12.817519] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-08T19:41:13.061492] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T19:41:13.599483] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:41:13.617498] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-08T19:41:14.078923] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T19:41:14.080959] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T19:41:14.417558] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-08T19:41:15.007911] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T19:41:15.217541] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-08T19:41:16.017625] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-08T19:41:16.346627] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T19:41:16.817566] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-08T19:41:17.617581] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-08T19:41:17.698157] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T19:41:18.364239] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T19:41:18.417507] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-08T19:41:19.217510] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-08T19:41:19.500829] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T19:41:20.001745] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:41:20.019485] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-08T19:41:20.023735] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T19:41:20.817609] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-08T19:41:21.617573] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-08T19:41:21.744538] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:41:21.748337] [INFO ] [REMOTE ] JEF: Full fetch complete (73020 records). [2025-10-08T19:41:21.748437] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-08T19:41:22.223328] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-08T19:41:22.223675] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-08T19:41:22.225954] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-08T19:41:22.226046] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-08T19:41:22.228554] [DEBUG] [LOCAL ] JEF: Trimmed 73020 records to 50129 (keeping 200 days of data) [2025-10-08T19:41:22.335758] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T19:41:22.339777] [INFO ] [REMOTE ] JEQ: Full fetch complete (11882 records). [2025-10-08T19:41:22.340863] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-08T19:41:22.418056] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-08T19:41:22.638153] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T19:41:22.923358] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-08T19:41:22.924826] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-08T19:41:22.927094] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-08T19:41:22.928221] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-08T19:41:22.941306] [DEBUG] [LOCAL ] JEQ: Trimmed 11882 records to 8667 (keeping 200 days of data) [2025-10-08T19:41:23.067767] [DEBUG] [LOCAL ] JEQ: Primary data saved (8667 records). [2025-10-08T19:41:23.068497] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-08T19:41:23.069011] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JEQ took 30.3s. Estimated remaining: 2h 51m 52s. Rate: 7.1 symbols/min [2025-10-08T19:41:23.174607] [DEBUG] [LOCAL ] JEF: Primary data saved (50129 records). [2025-10-08T19:41:23.174782] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-08T19:41:23.174873] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JEF took 37.7s. Estimated remaining: 2h 51m 34s. Rate: 7.1 symbols/min [2025-10-08T19:41:23.227799] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-08T19:41:23.362615] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:23.440372] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:23.468537] [DEBUG] [LOCAL ] JFR: Loaded 31002 existing records from primary storage. [2025-10-08T19:41:23.468920] [INFO ] [MAIN ] JFR: Loaded 31002 existing records. [2025-10-08T19:41:23.553915] [DEBUG] [LOCAL ] JGH: Loaded 11315 existing records from primary storage. [2025-10-08T19:41:23.572877] [INFO ] [MAIN ] JGH: Loaded 11315 existing records. [2025-10-08T19:41:23.793167] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:23.858485] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-08T19:41:23.864755] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-08T19:41:23.864596] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:23.865631] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-08T19:41:23.865767] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-08T19:41:23.866057] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-08T19:41:23.866184] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-08T19:41:23.871369] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-08T19:41:23.914545] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-08T19:41:24.621410] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-08T19:41:24.704437] [INFO ] [REMOTE ] JCI: Full fetch complete (77410 records). [2025-10-08T19:41:24.673088] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:24.706483] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T19:41:24.704288] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:24.705337] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-08T19:41:24.705738] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-08T19:41:24.723938] [INFO ] [REMOTE ] JELD: Full fetch complete (64136 records). [2025-10-08T19:41:24.752850] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-08T19:41:24.819532] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-08T19:41:25.478562] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-08T19:41:25.485139] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-08T19:41:25.513002] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-08T19:41:25.516257] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-08T19:41:25.605826] [DEBUG] [LOCAL ] JCI: Trimmed 77410 records to 53539 (keeping 200 days of data) [2025-10-08T19:41:25.634777] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-08T19:41:25.634952] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-08T19:41:25.635623] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-08T19:41:25.635772] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-08T19:41:25.691402] [DEBUG] [LOCAL ] JELD: Trimmed 64136 records to 46112 (keeping 200 days of data) [2025-10-08T19:41:26.093453] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T19:41:26.115006] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-08T19:41:26.119463] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T19:41:26.289927] [DEBUG] [LOCAL ] JELD: Primary data saved (46112 records). [2025-10-08T19:41:26.290937] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-08T19:41:26.291385] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JELD took 33.7s. Estimated remaining: 2h 51m 20s. Rate: 7.1 symbols/min [2025-10-08T19:41:26.421715] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-08T19:41:26.477525] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:26.496568] [DEBUG] [LOCAL ] JCI: Primary data saved (53539 records). [2025-10-08T19:41:26.496880] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-08T19:41:26.496992] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JCI took 45.3s. Estimated remaining: 2h 51m 3s. Rate: 7.1 symbols/min [2025-10-08T19:41:26.684061] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:26.710981] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T19:41:26.714961] [DEBUG] [LOCAL ] JHG: Loaded 47590 existing records from primary storage. [2025-10-08T19:41:26.715495] [INFO ] [MAIN ] JHG: Loaded 47590 existing records. [2025-10-08T19:41:26.802550] [DEBUG] [LOCAL ] JHI: Loaded 3696 existing records from primary storage. [2025-10-08T19:41:26.823549] [INFO ] [MAIN ] JHI: Loaded 3696 existing records. [2025-10-08T19:41:27.046698] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:27.067189] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-08T19:41:27.076487] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-08T19:41:27.090218] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:27.090431] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-08T19:41:27.090480] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-08T19:41:27.090566] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-08T19:41:27.090717] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-08T19:41:27.121963] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-08T19:41:27.137128] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-08T19:41:27.233081] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-08T19:41:27.657736] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:27.830304] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:27.836314] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T19:41:27.870818] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T19:41:28.017548] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-08T19:41:28.594808] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T19:41:28.817577] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-08T19:41:29.275109] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T19:41:29.617546] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-08T19:41:30.352585] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:41:30.417556] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-08T19:41:31.217538] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-08T19:41:31.287400] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T19:41:32.017553] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-08T19:41:32.817576] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-08T19:41:33.053436] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T19:41:33.429162] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T19:41:33.430487] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:41:33.617579] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-08T19:41:34.417567] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-08T19:41:34.960425] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T19:41:35.167806] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:41:35.217509] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-08T19:41:36.017572] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-08T19:41:36.185703] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T19:41:36.487148] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T19:41:36.817572] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-08T19:41:37.617554] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-08T19:41:38.182445] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T19:41:38.325117] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T19:41:38.417550] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-08T19:41:38.863748] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T19:41:39.217557] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-08T19:41:39.829784] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T19:41:40.017546] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-08T19:41:40.795879] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T19:41:40.817495] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-08T19:41:41.449960] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T19:41:41.617582] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-08T19:41:42.417569] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-08T19:41:42.536951] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T19:41:42.538486] [INFO ] [REMOTE ] JGH: Full fetch complete (15159 records). [2025-10-08T19:41:42.538611] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-08T19:41:42.908888] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-08T19:41:42.908981] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-08T19:41:42.909375] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-08T19:41:42.909419] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-08T19:41:42.910123] [DEBUG] [LOCAL ] JGH: Trimmed 15159 records to 11365 (keeping 200 days of data) [2025-10-08T19:41:42.983162] [DEBUG] [LOCAL ] JGH: Primary data saved (11365 records). [2025-10-08T19:41:42.983341] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-08T19:41:42.983469] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JGH took 19.8s. Estimated remaining: 2h 51m 3s. Rate: 7.1 symbols/min [2025-10-08T19:41:43.159927] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:43.165908] [DEBUG] [LOCAL ] JHS: Loaded 2876 existing records from primary storage. [2025-10-08T19:41:43.166122] [INFO ] [MAIN ] JHS: Loaded 2876 existing records. [2025-10-08T19:41:43.223991] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-08T19:41:43.358834] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:43.359102] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-08T19:41:43.359153] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-08T19:41:43.359292] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-08T19:41:43.359330] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-08T19:41:43.705775] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T19:41:43.775581] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:44.017561] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-08T19:41:44.521197] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:41:44.817605] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-08T19:41:45.266822] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:41:45.617597] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-08T19:41:46.034067] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T19:41:46.274304] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T19:41:46.417534] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-08T19:41:47.217550] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-08T19:41:47.628388] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-08T19:41:47.889206] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:41:48.017553] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-08T19:41:48.464471] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-08T19:41:48.817595] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-08T19:41:49.617561] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-08T19:41:50.012979] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T19:41:50.417523] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-08T19:41:50.727534] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:41:50.797523] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T19:41:51.217552] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-08T19:41:51.771558] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T19:41:52.017568] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-08T19:41:52.604576] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T19:41:52.817592] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-08T19:41:53.617634] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-08T19:41:54.173206] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:41:54.187466] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T19:41:54.417626] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-08T19:41:54.869183] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T19:41:55.217580] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-08T19:41:55.748541] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T19:41:56.017574] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-08T19:41:56.467692] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T19:41:56.817597] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-08T19:41:57.617578] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-08T19:41:58.217934] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T19:41:58.427367] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-08T19:41:58.442387] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:41:58.874225] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T19:41:59.217603] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-08T19:41:59.816931] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T19:41:59.818364] [INFO ] [REMOTE ] JHI: Full fetch complete (5328 records). [2025-10-08T19:41:59.818870] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-08T19:42:00.024705] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-08T19:42:00.194730] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-08T19:42:00.194819] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-08T19:42:00.194992] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-08T19:42:00.195035] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-08T19:42:00.195401] [DEBUG] [LOCAL ] JHI: Trimmed 5328 records to 3717 (keeping 200 days of data) [2025-10-08T19:42:00.218145] [DEBUG] [LOCAL ] JHI: Primary data saved (3717 records). [2025-10-08T19:42:00.218214] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-08T19:42:00.218308] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JHI took 33.7s. Estimated remaining: 2h 51m 4s. Rate: 7.1 symbols/min [2025-10-08T19:42:00.391148] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:00.442819] [DEBUG] [LOCAL ] JHX: Loaded 52906 existing records from primary storage. [2025-10-08T19:42:00.443239] [INFO ] [MAIN ] JHX: Loaded 52906 existing records. [2025-10-08T19:42:00.617870] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:00.618094] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-08T19:42:00.618156] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-08T19:42:00.618377] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-08T19:42:00.618436] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-08T19:42:00.822719] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-08T19:42:00.969899] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:01.570006] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T19:42:01.611347] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T19:42:01.621484] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-08T19:42:02.417582] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-08T19:42:02.668940] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T19:42:03.217604] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-08T19:42:03.968959] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:42:04.017567] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-08T19:42:04.568609] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T19:42:04.817559] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-08T19:42:05.471433] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:42:05.474960] [INFO ] [REMOTE ] JHG: Full fetch complete (68246 records). [2025-10-08T19:42:05.475069] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-08T19:42:05.626041] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-08T19:42:05.877139] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-08T19:42:05.877234] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-08T19:42:05.878150] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-08T19:42:05.878217] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-08T19:42:05.879723] [DEBUG] [LOCAL ] JHG: Trimmed 68246 records to 47568 (keeping 200 days of data) [2025-10-08T19:42:06.103498] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T19:42:06.108373] [INFO ] [REMOTE ] JFR: Full fetch complete (48331 records). [2025-10-08T19:42:06.109096] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-08T19:42:06.420041] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-08T19:42:06.538321] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-08T19:42:06.539227] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-08T19:42:06.540481] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-08T19:42:06.541370] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-08T19:42:06.545981] [DEBUG] [LOCAL ] JFR: Trimmed 48331 records to 31030 (keeping 200 days of data) [2025-10-08T19:42:06.656102] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T19:42:06.727298] [DEBUG] [LOCAL ] JHG: Primary data saved (47568 records). [2025-10-08T19:42:06.727965] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-08T19:42:06.728394] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JHG took 40.4s. Estimated remaining: 2h 50m 54s. Rate: 7.1 symbols/min [2025-10-08T19:42:06.927220] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:06.932934] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T19:42:07.010571] [DEBUG] [LOCAL ] JILL: Loaded 16381 existing records from primary storage. [2025-10-08T19:42:07.016047] [INFO ] [MAIN ] JILL: Loaded 16381 existing records. [2025-10-08T19:42:07.125434] [DEBUG] [LOCAL ] JFR: Primary data saved (31030 records). [2025-10-08T19:42:07.141253] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-08T19:42:07.151682] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JFR took 44.1s. Estimated remaining: 2h 50m 37s. Rate: 7.1 symbols/min [2025-10-08T19:42:07.222666] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-08T19:42:07.250132] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:07.279103] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-08T19:42:07.284613] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-08T19:42:07.316170] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-08T19:42:07.318719] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-08T19:42:07.498688] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:07.784094] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:07.799809] [DEBUG] [LOCAL ] JKS: Loaded 39913 existing records from primary storage. [2025-10-08T19:42:07.800144] [INFO ] [MAIN ] JKS: Loaded 39913 existing records. [2025-10-08T19:42:08.000822] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:08.001067] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-08T19:42:08.001115] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-08T19:42:08.001358] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-08T19:42:08.001415] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-08T19:42:08.022757] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-08T19:42:08.297779] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T19:42:08.380161] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:08.817579] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-08T19:42:08.936555] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T19:42:09.406220] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T19:42:09.617573] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-08T19:42:10.417582] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-08T19:42:10.508288] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T19:42:11.217573] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-08T19:42:11.597330] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:42:12.017583] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-08T19:42:12.635067] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:42:12.683209] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T19:42:12.817558] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-08T19:42:13.617497] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-08T19:42:13.720681] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T19:42:14.036965] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T19:42:14.417579] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-08T19:42:15.217560] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-08T19:42:16.017564] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-08T19:42:16.142224] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T19:42:16.353356] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:42:16.817566] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-08T19:42:17.459446] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T19:42:17.617603] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-08T19:42:18.131946] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T19:42:18.132831] [INFO ] [REMOTE ] JHS: Full fetch complete (4464 records). [2025-10-08T19:42:18.132919] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-08T19:42:18.428022] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-08T19:42:18.540704] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-08T19:42:18.550250] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-08T19:42:18.550447] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-08T19:42:18.550728] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-08T19:42:18.552237] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T19:42:18.552804] [DEBUG] [LOCAL ] JHS: Trimmed 4464 records to 2900 (keeping 200 days of data) [2025-10-08T19:42:18.579569] [DEBUG] [LOCAL ] JHS: Primary data saved (2900 records). [2025-10-08T19:42:18.579682] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-08T19:42:18.579820] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHS took 35.6s. Estimated remaining: 2h 50m 32s. Rate: 7.1 symbols/min [2025-10-08T19:42:18.757840] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:18.792130] [DEBUG] [LOCAL ] JLL: Loaded 31486 existing records from primary storage. [2025-10-08T19:42:18.792423] [INFO ] [MAIN ] JLL: Loaded 31486 existing records. [2025-10-08T19:42:18.981236] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:18.981468] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-08T19:42:18.981516] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-08T19:42:18.981737] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-08T19:42:18.981797] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-08T19:42:19.235500] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-08T19:42:19.276065] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T19:42:19.381225] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:20.017582] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-08T19:42:20.817553] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-08T19:42:21.056432] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T19:42:21.316592] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T19:42:21.617589] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-08T19:42:22.139774] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:42:22.417558] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-08T19:42:22.624509] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T19:42:23.217592] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-08T19:42:23.638049] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T19:42:23.968624] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T19:42:24.017584] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-08T19:42:24.817575] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-08T19:42:25.617587] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-08T19:42:25.707519] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T19:42:26.285883] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T19:42:26.417583] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-08T19:42:26.537531] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:42:27.217613] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-08T19:42:27.983371] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:42:28.017508] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-08T19:42:28.632453] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:42:28.817561] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-08T19:42:29.355578] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T19:42:29.573765] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:42:29.617499] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-08T19:42:30.286513] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T19:42:30.288053] [INFO ] [REMOTE ] JILL: Full fetch complete (22645 records). [2025-10-08T19:42:30.288126] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-08T19:42:30.430452] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-08T19:42:30.716138] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-08T19:42:30.716320] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-08T19:42:30.717210] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-08T19:42:30.717280] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-08T19:42:30.717989] [DEBUG] [LOCAL ] JILL: Trimmed 22645 records to 16249 (keeping 200 days of data) [2025-10-08T19:42:30.819226] [DEBUG] [LOCAL ] JILL: Primary data saved (16249 records). [2025-10-08T19:42:30.819374] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-08T19:42:30.819496] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JILL took 24.1s. Estimated remaining: 2h 50m 27s. Rate: 7.1 symbols/min [2025-10-08T19:42:31.217596] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-08T19:42:31.875722] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:42:32.017541] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-08T19:42:32.754586] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:42:32.817499] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-08T19:42:33.617517] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-08T19:42:34.096603] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-08T19:42:34.296811] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:42:34.417542] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-08T19:42:35.085583] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T19:42:35.217570] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-08T19:42:35.461077] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T19:42:36.017562] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-08T19:42:36.199187] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T19:42:36.817560] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-08T19:42:37.238398] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T19:42:37.617570] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-08T19:42:38.410957] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T19:42:38.421425] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-08T19:42:38.500949] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T19:42:39.217571] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-08T19:42:39.618952] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:42:39.622339] [INFO ] [REMOTE ] JKS: Full fetch complete (58745 records). [2025-10-08T19:42:39.622467] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-08T19:42:40.023396] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-08T19:42:40.027314] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-08T19:42:40.027373] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-08T19:42:40.028440] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-08T19:42:40.028639] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-08T19:42:40.030026] [DEBUG] [LOCAL ] JKS: Trimmed 58745 records to 39841 (keeping 200 days of data) [2025-10-08T19:42:40.274537] [DEBUG] [LOCAL ] JKS: Primary data saved (39841 records). [2025-10-08T19:42:40.274727] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-08T19:42:40.274827] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JKS took 33.1s. Estimated remaining: 2h 50m 20s. Rate: 7.1 symbols/min [2025-10-08T19:42:40.712085] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T19:42:40.717951] [INFO ] [REMOTE ] JHX: Full fetch complete (59891 records). [2025-10-08T19:42:40.718132] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-08T19:42:41.134145] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-08T19:42:41.134273] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-08T19:42:41.135240] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-08T19:42:41.135326] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-08T19:42:41.136950] [DEBUG] [LOCAL ] JHX: Trimmed 59891 records to 53151 (keeping 200 days of data) [2025-10-08T19:42:41.369566] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T19:42:41.380928] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-08T19:42:41.498920] [DEBUG] [LOCAL ] JHX: Primary data saved (53151 records). [2025-10-08T19:42:41.499086] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-08T19:42:41.499175] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 41.3s. Estimated remaining: 2h 50m 4s. Rate: 7.1 symbols/min [2025-10-08T19:42:42.824859] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T19:42:42.832792] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-08T19:42:44.200142] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T19:42:44.206912] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-08T19:42:45.178016] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:42:45.181151] [INFO ] [REMOTE ] JLL: Full fetch complete (44738 records). [2025-10-08T19:42:45.181438] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-08T19:42:45.741992] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-08T19:42:45.742135] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-08T19:42:45.742987] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-08T19:42:45.743064] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-08T19:42:45.744409] [DEBUG] [LOCAL ] JLL: Trimmed 44738 records to 31422 (keeping 200 days of data) [2025-10-08T19:42:45.983354] [DEBUG] [LOCAL ] JLL: Primary data saved (31422 records). [2025-10-08T19:42:45.983517] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-08T19:42:45.983607] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JLL took 27.4s. Estimated remaining: 2h 49m 51s. Rate: 7.1 symbols/min [2025-10-08T19:42:46.679153] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:46.688232] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:46.709704] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-08T19:42:46.758705] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-08T19:42:46.750243] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:46.784800] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-08T19:42:46.786070] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-08T19:42:46.786569] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-08T19:42:46.785922] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:46.786802] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-08T19:42:46.803695] [DEBUG] [LOCAL ] JLS: Loaded 4146 existing records from primary storage. [2025-10-08T19:42:46.809473] [INFO ] [MAIN ] JLS: Loaded 4146 existing records. [2025-10-08T19:42:47.198483] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:47.209242] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-08T19:42:47.209561] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-08T19:42:47.242343] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-08T19:42:47.254563] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-08T19:42:47.243993] [DEBUG] [LOCAL ] JMIA: Loaded 50814 existing records from primary storage. [2025-10-08T19:42:47.317329] [INFO ] [MAIN ] JMIA: Loaded 50814 existing records. [2025-10-08T19:42:47.388533] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-08T19:42:47.428487] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-08T19:42:47.984472] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:47.967037] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:48.001033] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-08T19:42:48.001477] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-08T19:42:48.011869] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-08T19:42:48.137145] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-08T19:42:48.156484] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:48.158854] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-08T19:42:48.179957] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-08T19:42:48.210943] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-08T19:42:48.313185] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:48.335678] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-08T19:42:48.346952] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-08T19:42:48.336017] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-08T19:42:48.794286] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T19:42:48.832157] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-08T19:42:48.877274] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:48.896452] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-08T19:42:49.021602] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T19:42:49.031111] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-08T19:42:49.028664] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:49.032749] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-08T19:42:49.175104] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T19:42:49.176196] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-08T19:42:49.576568] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T19:42:49.578784] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-08T19:42:49.584614] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T19:42:49.617499] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-08T19:42:49.950542] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-08T19:42:49.985062] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T19:42:50.417514] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-08T19:42:50.722718] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-08T19:42:50.856968] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-08T19:42:51.186315] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-08T19:42:51.217527] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-08T19:42:52.017551] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-08T19:42:52.817523] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-08T19:42:53.441420] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T19:42:53.444669] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-08T19:42:53.617510] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-08T19:42:53.676521] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T19:42:54.417603] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-08T19:42:55.021056] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T19:42:55.217588] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-08T19:42:55.952084] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-08T19:42:56.017605] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-08T19:42:56.731163] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T19:42:56.817510] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-08T19:42:57.617552] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-08T19:42:58.092029] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T19:42:58.206369] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-08T19:42:58.355922] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:42:58.417630] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-08T19:42:58.781801] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-08T19:42:59.217607] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-08T19:43:00.017617] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-08T19:43:00.817562] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-08T19:43:01.583343] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T19:43:01.603462] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T19:43:01.617525] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-08T19:43:01.860985] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T19:43:01.905485] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-08T19:43:02.417591] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-08T19:43:03.217567] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-08T19:43:04.017572] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-08T19:43:04.220468] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T19:43:04.350610] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-08T19:43:04.817587] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-08T19:43:05.490934] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-08T19:43:05.617608] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-08T19:43:05.971293] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-08T19:43:05.972147] [INFO ] [REMOTE ] JMM: Full fetch complete (2313 records). [2025-10-08T19:43:05.972224] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-08T19:43:06.180568] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-08T19:43:06.180966] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:43:06.181056] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:43:06.181135] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-08T19:43:06.181243] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-08T19:43:06.181304] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-08T19:43:06.181374] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-08T19:43:06.181467] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 20.2s. Estimated remaining: 2h 49m 55s. Rate: 7.1 symbols/min [2025-10-08T19:43:06.361873] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:06.414143] [DEBUG] [LOCAL ] JOBY: Loaded 53801 existing records from primary storage. [2025-10-08T19:43:06.414522] [INFO ] [MAIN ] JOBY: Loaded 53801 existing records. [2025-10-08T19:43:06.425428] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-08T19:43:06.599187] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:06.599615] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-08T19:43:06.599761] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-08T19:43:06.600106] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-08T19:43:06.600175] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-08T19:43:06.743110] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T19:43:07.018210] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:07.217577] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-08T19:43:08.017598] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-08T19:43:08.532923] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T19:43:08.630105] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T19:43:08.817607] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-08T19:43:09.617576] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-08T19:43:09.663449] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-08T19:43:10.417567] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-08T19:43:10.916456] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-08T19:43:11.000682] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T19:43:11.217549] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-08T19:43:11.507252] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T19:43:12.017563] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-08T19:43:12.817584] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-08T19:43:13.190401] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-08T19:43:13.301830] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T19:43:13.617569] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-08T19:43:14.417578] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-08T19:43:14.592607] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-08T19:43:15.217555] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-08T19:43:15.397545] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T19:43:16.017589] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-08T19:43:16.242903] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T19:43:16.817550] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-08T19:43:17.231533] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-08T19:43:17.256438] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-08T19:43:17.617557] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-08T19:43:18.047275] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T19:43:18.076161] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-08T19:43:18.080087] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-08T19:43:18.080217] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-08T19:43:18.422753] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-08T19:43:18.470063] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-08T19:43:18.470145] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-08T19:43:18.471175] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-08T19:43:18.471286] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-08T19:43:18.473198] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-10-08T19:43:18.835156] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-08T19:43:18.835400] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-08T19:43:18.835520] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JNJ took 32.8s. Estimated remaining: 2h 49m 51s. Rate: 7.1 symbols/min [2025-10-08T19:43:18.939741] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T19:43:18.946330] [INFO ] [REMOTE ] JLS: Full fetch complete (5816 records). [2025-10-08T19:43:18.956672] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-08T19:43:19.116297] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:19.222629] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-08T19:43:19.324751] [DEBUG] [LOCAL ] JOE: Loaded 23982 existing records from primary storage. [2025-10-08T19:43:19.335798] [INFO ] [MAIN ] JOE: Loaded 23982 existing records. [2025-10-08T19:43:19.521816] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-08T19:43:19.527537] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-08T19:43:19.543126] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-08T19:43:19.548301] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-08T19:43:19.572921] [DEBUG] [LOCAL ] JLS: Trimmed 5816 records to 4144 (keeping 200 days of data) [2025-10-08T19:43:19.613191] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:19.621254] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-08T19:43:19.621591] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-08T19:43:19.622386] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-08T19:43:19.622695] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-08T19:43:19.787450] [DEBUG] [LOCAL ] JLS: Primary data saved (4144 records). [2025-10-08T19:43:19.816004] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-08T19:43:19.881676] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JLS took 33.9s. Estimated remaining: 2h 49m 35s. Rate: 7.1 symbols/min [2025-10-08T19:43:20.029639] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-08T19:43:20.123958] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:20.178092] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:20.187130] [DEBUG] [LOCAL ] JOF: Loaded 6917 existing records from primary storage. [2025-10-08T19:43:20.187347] [INFO ] [MAIN ] JOF: Loaded 6917 existing records. [2025-10-08T19:43:20.363310] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:20.363521] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-08T19:43:20.363578] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-08T19:43:20.363794] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-08T19:43:20.363855] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-08T19:43:20.739410] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:20.817497] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-08T19:43:21.288320] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T19:43:21.459830] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-08T19:43:21.617553] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-08T19:43:22.194126] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T19:43:22.417526] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-08T19:43:22.606754] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-08T19:43:23.217567] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-08T19:43:24.017589] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-08T19:43:24.340530] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T19:43:24.344412] [INFO ] [REMOTE ] JMIA: Full fetch complete (73286 records). [2025-10-08T19:43:24.344519] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-08T19:43:24.639574] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T19:43:24.740216] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-08T19:43:24.740328] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-08T19:43:24.741277] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-08T19:43:24.741342] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-08T19:43:24.742849] [DEBUG] [LOCAL ] JMIA: Trimmed 73286 records to 50849 (keeping 200 days of data) [2025-10-08T19:43:24.822899] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-08T19:43:25.042980] [DEBUG] [LOCAL ] JMIA: Primary data saved (50849 records). [2025-10-08T19:43:25.043139] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-08T19:43:25.043230] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JMIA took 39.0s. Estimated remaining: 2h 49m 23s. Rate: 7.1 symbols/min [2025-10-08T19:43:25.210151] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:25.245366] [DEBUG] [LOCAL ] JPC: Loaded 37176 existing records from primary storage. [2025-10-08T19:43:25.245720] [INFO ] [MAIN ] JPC: Loaded 37176 existing records. [2025-10-08T19:43:25.434621] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:25.435172] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-08T19:43:25.435461] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-08T19:43:25.435879] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-08T19:43:25.435945] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-08T19:43:25.537499] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T19:43:25.628453] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-08T19:43:25.818825] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:25.849909] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-08T19:43:26.417550] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-08T19:43:26.858949] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:43:27.217559] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-08T19:43:27.840767] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T19:43:28.017553] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-08T19:43:28.774243] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-08T19:43:28.817512] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-08T19:43:29.338210] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:43:29.617554] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-08T19:43:30.327416] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T19:43:30.417573] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-08T19:43:31.217542] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-08T19:43:31.706572] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T19:43:31.795453] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T19:43:31.859487] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-08T19:43:32.017546] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-08T19:43:32.699456] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T19:43:32.817627] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-08T19:43:33.348356] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T19:43:33.617555] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-08T19:43:34.417565] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-08T19:43:35.163220] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T19:43:35.167323] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T19:43:35.217513] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-08T19:43:36.017585] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-08T19:43:36.387087] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T19:43:36.817601] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-08T19:43:37.617578] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-08T19:43:37.647607] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T19:43:38.417543] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-08T19:43:38.570664] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-08T19:43:39.052002] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T19:43:39.217516] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-08T19:43:39.386373] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T19:43:40.017593] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-08T19:43:40.626060] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:43:40.817630] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-08T19:43:41.320029] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:43:41.518722] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T19:43:41.520035] [INFO ] [REMOTE ] JOF: Full fetch complete (9517 records). [2025-10-08T19:43:41.520112] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-08T19:43:41.622808] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-08T19:43:41.943067] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-08T19:43:41.943190] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-08T19:43:41.943548] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-08T19:43:41.943692] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-08T19:43:41.944414] [DEBUG] [LOCAL ] JOF: Trimmed 9517 records to 6878 (keeping 200 days of data) [2025-10-08T19:43:42.001267] [DEBUG] [LOCAL ] JOF: Primary data saved (6878 records). [2025-10-08T19:43:42.001485] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-08T19:43:42.001617] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOF took 22.1s. Estimated remaining: 2h 49m 24s. Rate: 7.1 symbols/min [2025-10-08T19:43:42.184758] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:42.251848] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-08T19:43:42.252382] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-08T19:43:42.422723] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-08T19:43:42.457014] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:42.457547] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-08T19:43:42.457611] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-08T19:43:42.458062] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-08T19:43:42.458126] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-08T19:43:42.851965] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:42.983605] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T19:43:43.217589] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-08T19:43:43.703543] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:43:44.017577] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-08T19:43:44.817557] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-08T19:43:45.517316] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-08T19:43:45.595224] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T19:43:45.617495] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-08T19:43:46.275167] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-08T19:43:46.417594] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-08T19:43:46.651781] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T19:43:47.217608] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-08T19:43:47.770800] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T19:43:48.017601] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-08T19:43:48.177798] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:43:48.817557] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-08T19:43:49.157728] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T19:43:49.617621] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-08T19:43:50.417608] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-08T19:43:50.877811] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:43:51.217537] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-08T19:43:51.562610] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-08T19:43:52.017574] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-08T19:43:52.349206] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T19:43:52.352689] [INFO ] [REMOTE ] JPC: Full fetch complete (55472 records). [2025-10-08T19:43:52.352873] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-08T19:43:52.751964] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-08T19:43:52.752150] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-08T19:43:52.753272] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-08T19:43:52.753574] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-08T19:43:52.761720] [DEBUG] [LOCAL ] JPC: Trimmed 55472 records to 37230 (keeping 200 days of data) [2025-10-08T19:43:52.771045] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T19:43:52.827165] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-08T19:43:52.902073] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-08T19:43:53.059458] [DEBUG] [LOCAL ] JPC: Primary data saved (37230 records). [2025-10-08T19:43:53.059669] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-08T19:43:53.059801] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JPC took 28.0s. Estimated remaining: 2h 49m 18s. Rate: 7.1 symbols/min [2025-10-08T19:43:53.226752] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:53.264726] [DEBUG] [LOCAL ] JQC: Loaded 34440 existing records from primary storage. [2025-10-08T19:43:53.265081] [INFO ] [MAIN ] JQC: Loaded 34440 existing records. [2025-10-08T19:43:53.444631] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:53.444920] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-08T19:43:53.444982] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-08T19:43:53.445260] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-08T19:43:53.445317] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-08T19:43:53.623257] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-08T19:43:53.843560] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:53.844696] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T19:43:54.417591] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-08T19:43:55.217526] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-08T19:43:55.393269] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T19:43:55.395276] [INFO ] [REMOTE ] JOE: Full fetch complete (35819 records). [2025-10-08T19:43:55.395353] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-08T19:43:55.794931] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-08T19:43:55.795036] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-08T19:43:55.795932] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-08T19:43:55.796004] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-08T19:43:55.797203] [DEBUG] [LOCAL ] JOE: Trimmed 35819 records to 23935 (keeping 200 days of data) [2025-10-08T19:43:55.952773] [DEBUG] [LOCAL ] JOE: Primary data saved (23935 records). [2025-10-08T19:43:55.952914] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-08T19:43:55.953032] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOE took 37.1s. Estimated remaining: 2h 49m 4s. Rate: 7.1 symbols/min [2025-10-08T19:43:56.023873] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-08T19:43:56.181355] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:56.191289] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-08T19:43:56.203189] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-08T19:43:56.203406] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-08T19:43:56.309696] [DEBUG] [LOCAL ] JRI: Loaded 15101 existing records from primary storage. [2025-10-08T19:43:56.320892] [INFO ] [MAIN ] JRI: Loaded 15101 existing records. [2025-10-08T19:43:56.736874] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:56.752790] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-08T19:43:56.759628] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-08T19:43:56.775795] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-08T19:43:56.775969] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-08T19:43:57.046171] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-08T19:43:57.060900] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-08T19:43:57.091242] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-08T19:43:57.174154] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-08T19:43:57.256913] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53801 (keeping 200 days of data) [2025-10-08T19:43:57.350947] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:57.398852] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:43:57.395710] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-08T19:43:57.468139] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-08T19:43:57.617838] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-08T19:43:57.706917] [DEBUG] [LOCAL ] JOBY: Primary data saved (53801 records). [2025-10-08T19:43:57.707087] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-08T19:43:57.707220] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JOBY took 51.5s. Estimated remaining: 2h 48m 49s. Rate: 7.1 symbols/min [2025-10-08T19:43:57.873917] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:57.887900] [DEBUG] [LOCAL ] JRS: Loaded 11483 existing records from primary storage. [2025-10-08T19:43:57.888153] [INFO ] [MAIN ] JRS: Loaded 11483 existing records. [2025-10-08T19:43:58.079000] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:58.079248] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-08T19:43:58.079295] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-08T19:43:58.079478] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-08T19:43:58.079536] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-08T19:43:58.420534] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-08T19:43:58.474493] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T19:43:58.480135] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:59.217610] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-08T19:43:59.574023] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T19:43:59.854375] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-08T19:43:59.892972] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T19:44:00.017558] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-08T19:44:00.817534] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-08T19:44:01.015539] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:44:01.617569] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-08T19:44:02.417542] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-08T19:44:02.891964] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:44:03.072934] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-08T19:44:03.188893] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T19:44:03.217546] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-08T19:44:04.017558] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-08T19:44:04.048226] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T19:44:04.817702] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-08T19:44:05.518616] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T19:44:05.617557] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-08T19:44:05.840342] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T19:44:06.417613] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-08T19:44:06.554278] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T19:44:07.217547] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-08T19:44:07.983927] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T19:44:08.017494] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-08T19:44:08.612533] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-08T19:44:08.716733] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T19:44:08.817551] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-08T19:44:09.617579] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-08T19:44:09.920868] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T19:44:10.417553] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-08T19:44:11.048305] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T19:44:11.204947] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T19:44:11.217488] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-08T19:44:12.002684] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T19:44:12.017511] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-08T19:44:12.817551] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-08T19:44:12.872635] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T19:44:13.455298] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T19:44:13.617556] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-08T19:44:14.417559] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-08T19:44:15.217589] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-08T19:44:15.822800] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-08T19:44:15.872940] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T19:44:15.964313] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T19:44:16.017501] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-08T19:44:16.817564] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-08T19:44:17.309360] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:44:17.617521] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-08T19:44:17.778103] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T19:44:17.779945] [INFO ] [REMOTE ] JRI: Full fetch complete (23260 records). [2025-10-08T19:44:17.780040] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-08T19:44:18.147291] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-08T19:44:18.147399] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-08T19:44:18.148038] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-08T19:44:18.148102] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-08T19:44:18.148771] [DEBUG] [LOCAL ] JRI: Trimmed 23260 records to 15167 (keeping 200 days of data) [2025-10-08T19:44:18.243020] [DEBUG] [LOCAL ] JRI: Primary data saved (15167 records). [2025-10-08T19:44:18.243168] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-08T19:44:18.243253] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JRI took 22.3s. Estimated remaining: 2h 48m 53s. Rate: 7.1 symbols/min [2025-10-08T19:44:18.409684] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:18.417518] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-08T19:44:18.458113] [DEBUG] [LOCAL ] JXN: Loaded 45206 existing records from primary storage. [2025-10-08T19:44:18.458759] [INFO ] [MAIN ] JXN: Loaded 45206 existing records. [2025-10-08T19:44:18.642418] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:18.642780] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-08T19:44:18.642851] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-08T19:44:18.643241] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-08T19:44:18.643298] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-08T19:44:18.995499] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:19.003112] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T19:44:19.217507] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-08T19:44:19.477711] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T19:44:20.017538] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-08T19:44:20.687431] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T19:44:20.817522] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-08T19:44:21.234000] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T19:44:21.617555] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-08T19:44:22.313417] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T19:44:22.339968] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:44:22.417508] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-08T19:44:23.217574] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-08T19:44:23.861270] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-08T19:44:23.983904] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T19:44:24.017554] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-08T19:44:24.817572] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-08T19:44:25.554836] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:44:25.617587] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-08T19:44:26.417576] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-08T19:44:26.677935] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:44:26.983243] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-08T19:44:27.217592] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-08T19:44:27.234279] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:44:28.017551] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-08T19:44:28.817513] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-08T19:44:28.897719] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T19:44:29.567575] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-08T19:44:29.572234] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-08T19:44:29.572359] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-08T19:44:29.622679] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-08T19:44:29.977188] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-08T19:44:29.977269] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-08T19:44:29.978256] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-08T19:44:29.978321] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-08T19:44:29.979810] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-10-08T19:44:30.330426] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-08T19:44:30.330625] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-08T19:44:30.330766] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JPM took 48.3s. Estimated remaining: 2h 48m 48s. Rate: 7.1 symbols/min [2025-10-08T19:44:30.422172] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-08T19:44:30.507361] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:30.518858] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T19:44:30.521852] [INFO ] [REMOTE ] JRS: Full fetch complete (16351 records). [2025-10-08T19:44:30.522055] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-08T19:44:30.868046] [DEBUG] [LOCAL ] K: Loaded 50101 existing records from primary storage. [2025-10-08T19:44:30.897716] [INFO ] [MAIN ] K: Loaded 50101 existing records. [2025-10-08T19:44:30.931404] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-08T19:44:31.149707] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-08T19:44:31.150047] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-08T19:44:31.155834] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-08T19:44:31.155927] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-08T19:44:31.201913] [DEBUG] [LOCAL ] JRS: Trimmed 16351 records to 11551 (keeping 200 days of data) [2025-10-08T19:44:31.229424] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-08T19:44:31.237094] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:31.237375] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-08T19:44:31.237440] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-08T19:44:31.264891] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-08T19:44:31.271204] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-08T19:44:31.496319] [DEBUG] [LOCAL ] JRS: Primary data saved (11551 records). [2025-10-08T19:44:31.522498] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-08T19:44:31.546528] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRS took 33.8s. Estimated remaining: 2h 48m 32s. Rate: 7.1 symbols/min [2025-10-08T19:44:31.791596] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:31.794833] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T19:44:31.919415] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:31.939383] [DEBUG] [LOCAL ] KAI: Loaded 13296 existing records from primary storage. [2025-10-08T19:44:31.939736] [INFO ] [MAIN ] KAI: Loaded 13296 existing records. [2025-10-08T19:44:32.022723] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-08T19:44:32.123842] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:32.124067] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-08T19:44:32.124144] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-08T19:44:32.124410] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-08T19:44:32.124471] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-08T19:44:32.475031] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:32.817582] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-08T19:44:32.856079] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:44:33.218841] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:44:33.222570] [INFO ] [REMOTE ] JQC: Full fetch complete (49441 records). [2025-10-08T19:44:33.222705] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-08T19:44:33.622726] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-08T19:44:33.701040] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-08T19:44:33.701178] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-08T19:44:33.702616] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-08T19:44:33.702882] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-08T19:44:33.712802] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T19:44:33.716547] [DEBUG] [LOCAL ] JQC: Trimmed 49441 records to 34236 (keeping 200 days of data) [2025-10-08T19:44:33.955096] [DEBUG] [LOCAL ] JQC: Primary data saved (34236 records). [2025-10-08T19:44:33.955317] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-08T19:44:33.955439] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JQC took 40.9s. Estimated remaining: 2h 48m 18s. Rate: 7.1 symbols/min [2025-10-08T19:44:34.144331] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:34.187128] [DEBUG] [LOCAL ] KAR: Loaded 40083 existing records from primary storage. [2025-10-08T19:44:34.187564] [INFO ] [MAIN ] KAR: Loaded 40083 existing records. [2025-10-08T19:44:34.380510] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:34.380902] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-08T19:44:34.380967] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-08T19:44:34.381235] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-08T19:44:34.381295] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-08T19:44:34.426389] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-08T19:44:34.769389] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:35.006560] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:44:35.217604] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-08T19:44:35.687491] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T19:44:36.017525] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-08T19:44:36.817572] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-08T19:44:36.886787] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:44:36.960398] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T19:44:37.617554] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-08T19:44:38.095047] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:44:38.417598] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-08T19:44:38.921049] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T19:44:39.217579] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-08T19:44:39.827568] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T19:44:39.909943] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T19:44:40.017549] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-08T19:44:40.817592] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-08T19:44:41.156961] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T19:44:41.617525] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-08T19:44:42.122268] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T19:44:42.417617] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-08T19:44:42.886229] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T19:44:43.217617] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-08T19:44:43.457364] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T19:44:44.017554] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-08T19:44:44.671713] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:44:44.778334] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T19:44:44.817558] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-08T19:44:45.617566] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-08T19:44:46.221201] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:44:46.288974] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T19:44:46.417734] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-08T19:44:47.217577] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-08T19:44:48.017611] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-08T19:44:48.060413] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T19:44:48.510681] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T19:44:48.817513] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-08T19:44:48.974162] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T19:44:49.617591] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-08T19:44:50.296303] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T19:44:50.356617] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T19:44:50.417572] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-08T19:44:51.217633] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-08T19:44:52.017602] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-08T19:44:52.098587] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T19:44:52.546308] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:44:52.673484] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T19:44:52.817579] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-08T19:44:53.617685] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-08T19:44:53.633767] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:44:54.417568] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-08T19:44:54.994492] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:44:54.997626] [INFO ] [REMOTE ] JXN: Full fetch complete (65128 records). [2025-10-08T19:44:54.997763] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-08T19:44:55.222719] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-08T19:44:55.384737] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-08T19:44:55.384900] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-08T19:44:55.385801] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-08T19:44:55.385863] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-08T19:44:55.387208] [DEBUG] [LOCAL ] JXN: Trimmed 65128 records to 45065 (keeping 200 days of data) [2025-10-08T19:44:55.642424] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T19:44:55.707958] [DEBUG] [LOCAL ] JXN: Primary data saved (45065 records). [2025-10-08T19:44:55.708122] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-08T19:44:55.708232] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 37.5s. Estimated remaining: 2h 48m 23s. Rate: 7.1 symbols/min [2025-10-08T19:44:55.875141] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:55.897810] [DEBUG] [LOCAL ] KB: Loaded 23640 existing records from primary storage. [2025-10-08T19:44:55.898076] [INFO ] [MAIN ] KB: Loaded 23640 existing records. [2025-10-08T19:44:56.020894] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-08T19:44:56.080831] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:56.081010] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-08T19:44:56.081056] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-08T19:44:56.081321] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-08T19:44:56.081380] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-08T19:44:56.205043] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T19:44:56.449865] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:56.817561] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-08T19:44:57.169121] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T19:44:57.617558] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-08T19:44:57.771916] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T19:44:58.417637] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-08T19:44:59.067091] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T19:44:59.211330] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T19:44:59.220394] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-08T19:45:00.017569] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-08T19:45:00.684234] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T19:45:00.685695] [INFO ] [REMOTE ] KAI: Full fetch complete (18780 records). [2025-10-08T19:45:00.685771] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-08T19:45:00.818680] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-08T19:45:01.078189] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-08T19:45:01.078415] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-08T19:45:01.079020] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-08T19:45:01.089375] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-08T19:45:01.109396] [DEBUG] [LOCAL ] KAI: Trimmed 18780 records to 13277 (keeping 200 days of data) [2025-10-08T19:45:01.148115] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T19:45:01.211309] [DEBUG] [LOCAL ] KAI: Primary data saved (13277 records). [2025-10-08T19:45:01.211474] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-08T19:45:01.211565] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 29.6s. Estimated remaining: 2h 48m 11s. Rate: 7.1 symbols/min [2025-10-08T19:45:01.400456] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:01.424276] [DEBUG] [LOCAL ] KBDC: Loaded 21539 existing records from primary storage. [2025-10-08T19:45:01.424586] [INFO ] [MAIN ] KBDC: Loaded 21539 existing records. [2025-10-08T19:45:01.623228] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-08T19:45:01.628628] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:01.629761] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-08T19:45:01.629836] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-08T19:45:01.630111] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-08T19:45:01.630182] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-08T19:45:02.039164] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:02.090592] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:45:02.417603] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-08T19:45:02.818794] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T19:45:03.217561] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-08T19:45:03.481757] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T19:45:04.017576] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-08T19:45:04.167940] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T19:45:04.817590] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-08T19:45:05.351109] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T19:45:05.617564] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-08T19:45:05.865241] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T19:45:06.417565] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-08T19:45:07.217531] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-08T19:45:07.261603] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T19:45:07.662359] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T19:45:08.022512] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-08T19:45:08.025916] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T19:45:08.817602] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-08T19:45:09.228960] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T19:45:09.617579] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-08T19:45:09.842699] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T19:45:10.417558] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-08T19:45:10.853582] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T19:45:11.217543] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-08T19:45:11.357924] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T19:45:12.017590] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-08T19:45:12.461734] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T19:45:12.817557] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-08T19:45:13.063603] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T19:45:13.617587] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-08T19:45:14.243911] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:45:14.248001] [INFO ] [REMOTE ] K: Full fetch complete (72107 records). [2025-10-08T19:45:14.248178] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-08T19:45:14.424345] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-08T19:45:14.560924] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T19:45:14.659685] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-08T19:45:14.659793] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-08T19:45:14.660756] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-08T19:45:14.660823] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-08T19:45:14.662318] [DEBUG] [LOCAL ] K: Trimmed 72107 records to 50112 (keeping 200 days of data) [2025-10-08T19:45:14.978040] [DEBUG] [LOCAL ] K: Primary data saved (50112 records). [2025-10-08T19:45:14.978186] [INFO ] [MAIN ] K: Full history saved. [2025-10-08T19:45:14.978274] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. K took 44.6s. Estimated remaining: 2h 48m 8s. Rate: 7.1 symbols/min [2025-10-08T19:45:15.142734] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:15.188108] [DEBUG] [LOCAL ] KBH: Loaded 48893 existing records from primary storage. [2025-10-08T19:45:15.188465] [INFO ] [MAIN ] KBH: Loaded 48893 existing records. [2025-10-08T19:45:15.222986] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-08T19:45:15.364850] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:15.365085] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-08T19:45:15.365135] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-08T19:45:15.365402] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-08T19:45:15.365462] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-08T19:45:15.719137] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:15.983542] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T19:45:16.017521] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-08T19:45:16.349896] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T19:45:16.817556] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-08T19:45:17.191550] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T19:45:17.194781] [INFO ] [REMOTE ] KAR: Full fetch complete (56843 records). [2025-10-08T19:45:17.194870] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-08T19:45:17.604633] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-08T19:45:17.604751] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-08T19:45:17.605703] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-08T19:45:17.605769] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-08T19:45:17.607019] [DEBUG] [LOCAL ] KAR: Trimmed 56843 records to 40090 (keeping 200 days of data) [2025-10-08T19:45:17.656636] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-08T19:45:17.862049] [DEBUG] [LOCAL ] KAR: Primary data saved (40090 records). [2025-10-08T19:45:17.862186] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-08T19:45:17.862267] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 43.9s. Estimated remaining: 2h 47m 54s. Rate: 7.1 symbols/min [2025-10-08T19:45:18.071074] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:18.114451] [DEBUG] [LOCAL ] KBR: Loaded 47906 existing records from primary storage. [2025-10-08T19:45:18.114812] [INFO ] [MAIN ] KBR: Loaded 47906 existing records. [2025-10-08T19:45:18.301145] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:18.301666] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-08T19:45:18.301750] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-08T19:45:18.302161] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-08T19:45:18.302240] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-08T19:45:18.420762] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-08T19:45:18.626828] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T19:45:18.723119] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:18.768301] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T19:45:19.217515] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-08T19:45:19.515251] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T19:45:20.017547] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-08T19:45:20.278675] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T19:45:20.280392] [INFO ] [REMOTE ] KB: Full fetch complete (33826 records). [2025-10-08T19:45:20.280467] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-08T19:45:20.678939] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-08T19:45:20.679021] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-08T19:45:20.679670] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-08T19:45:20.679731] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-08T19:45:20.680481] [DEBUG] [LOCAL ] KB: Trimmed 33826 records to 23644 (keeping 200 days of data) [2025-10-08T19:45:20.822399] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-08T19:45:20.832130] [DEBUG] [LOCAL ] KB: Primary data saved (23644 records). [2025-10-08T19:45:20.832249] [INFO ] [MAIN ] KB: Full history saved. [2025-10-08T19:45:20.832361] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 25.1s. Estimated remaining: 2h 47m 40s. Rate: 7.1 symbols/min [2025-10-08T19:45:21.054310] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:21.115280] [DEBUG] [LOCAL ] KD: Loaded 52329 existing records from primary storage. [2025-10-08T19:45:21.115930] [INFO ] [MAIN ] KD: Loaded 52329 existing records. [2025-10-08T19:45:21.329694] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:21.329981] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-08T19:45:21.330167] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-08T19:45:21.330756] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-08T19:45:21.330866] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-08T19:45:21.567404] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T19:45:21.624583] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-08T19:45:21.752076] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:21.790734] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T19:45:22.417545] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-08T19:45:23.217553] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-08T19:45:23.559747] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T19:45:23.839010] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:45:24.017559] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-08T19:45:24.764372] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:45:24.817555] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-08T19:45:25.197183] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T19:45:25.617556] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-08T19:45:26.363141] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T19:45:26.417556] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-08T19:45:27.217521] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-08T19:45:27.340448] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T19:45:28.017522] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-08T19:45:28.103047] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:45:28.817534] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-08T19:45:28.995272] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T19:45:29.149923] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T19:45:29.617545] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-08T19:45:30.393611] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:45:30.417513] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-08T19:45:30.832325] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T19:45:30.835620] [INFO ] [REMOTE ] KBDC: Full fetch complete (29415 records). [2025-10-08T19:45:30.835804] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-08T19:45:31.222686] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-08T19:45:31.287212] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-08T19:45:31.287296] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-08T19:45:31.287966] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-08T19:45:31.288030] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-08T19:45:31.289025] [DEBUG] [LOCAL ] KBDC: Trimmed 29415 records to 21569 (keeping 200 days of data) [2025-10-08T19:45:31.425088] [DEBUG] [LOCAL ] KBDC: Primary data saved (21569 records). [2025-10-08T19:45:31.425224] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-08T19:45:31.425328] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 30.2s. Estimated remaining: 2h 47m 34s. Rate: 7.1 symbols/min [2025-10-08T19:45:31.591773] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:31.599885] [DEBUG] [LOCAL ] KEN: Loaded 4674 existing records from primary storage. [2025-10-08T19:45:31.600095] [INFO ] [MAIN ] KEN: Loaded 4674 existing records. [2025-10-08T19:45:31.780190] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:31.780485] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-08T19:45:31.780546] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-08T19:45:31.780837] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-08T19:45:31.780896] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-08T19:45:32.022719] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-08T19:45:32.145466] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:32.177878] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T19:45:32.539575] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T19:45:32.817606] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-08T19:45:33.530932] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:45:33.617538] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-08T19:45:34.417530] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-08T19:45:34.675547] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T19:45:35.052520] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:45:35.217622] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-08T19:45:35.915211] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:45:36.017563] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-08T19:45:36.668022] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T19:45:36.817559] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-08T19:45:37.308509] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T19:45:37.461772] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T19:45:37.617566] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-08T19:45:38.417604] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-08T19:45:39.217636] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-08T19:45:39.347784] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T19:45:39.772253] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T19:45:39.806235] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T19:45:40.017529] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-08T19:45:40.817606] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-08T19:45:41.617565] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-08T19:45:41.688931] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T19:45:42.430746] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-08T19:45:42.433466] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:45:42.886714] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T19:45:42.974211] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:45:43.217639] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-08T19:45:43.724125] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-08T19:45:44.017596] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-08T19:45:44.817564] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-08T19:45:44.873979] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T19:45:45.617561] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-08T19:45:46.234425] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T19:45:46.236080] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T19:45:46.417530] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-08T19:45:47.217558] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-08T19:45:47.836618] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T19:45:48.017519] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-08T19:45:48.277750] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T19:45:48.817558] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-08T19:45:49.375378] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T19:45:49.617631] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-08T19:45:50.028450] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-08T19:45:50.180315] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T19:45:50.417594] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-08T19:45:51.009894] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T19:45:51.217555] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-08T19:45:52.017571] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-08T19:45:52.586416] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T19:45:52.622911] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:45:52.626830] [INFO ] [REMOTE ] KBR: Full fetch complete (69785 records). [2025-10-08T19:45:52.626975] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-08T19:45:52.824865] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-08T19:45:53.034630] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-08T19:45:53.034760] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-08T19:45:53.035743] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-08T19:45:53.035813] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-08T19:45:53.037469] [DEBUG] [LOCAL ] KBR: Trimmed 69785 records to 47850 (keeping 200 days of data) [2025-10-08T19:45:53.334856] [DEBUG] [LOCAL ] KBR: Primary data saved (47850 records). [2025-10-08T19:45:53.335018] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-08T19:45:53.335126] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBR took 35.5s. Estimated remaining: 2h 47m 39s. Rate: 7.1 symbols/min [2025-10-08T19:45:53.504440] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:53.536966] [DEBUG] [LOCAL ] KEP: Loaded 31291 existing records from primary storage. [2025-10-08T19:45:53.537249] [INFO ] [MAIN ] KEP: Loaded 31291 existing records. [2025-10-08T19:45:53.625270] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-08T19:45:53.753258] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:53.753538] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-08T19:45:53.753598] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-08T19:45:53.753905] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-08T19:45:53.753976] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-08T19:45:54.103404] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:54.252303] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:45:54.256250] [INFO ] [REMOTE ] KBH: Full fetch complete (70817 records). [2025-10-08T19:45:54.256359] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-08T19:45:54.350308] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T19:45:54.361808] [INFO ] [REMOTE ] KEN: Full fetch complete (5937 records). [2025-10-08T19:45:54.361911] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-08T19:45:54.433896] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-08T19:45:54.970254] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-08T19:45:54.988267] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-08T19:45:55.001396] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-08T19:45:55.009713] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-08T19:45:55.031800] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-08T19:45:55.031872] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-08T19:45:55.032038] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-08T19:45:55.032323] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-08T19:45:55.033019] [DEBUG] [LOCAL ] KEN: Trimmed 5937 records to 4677 (keeping 200 days of data) [2025-10-08T19:45:55.034065] [DEBUG] [LOCAL ] KBH: Trimmed 70817 records to 48855 (keeping 200 days of data) [2025-10-08T19:45:55.156009] [DEBUG] [LOCAL ] KEN: Primary data saved (4677 records). [2025-10-08T19:45:55.156591] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-08T19:45:55.157238] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KEN took 23.7s. Estimated remaining: 2h 47m 24s. Rate: 7.1 symbols/min [2025-10-08T19:45:55.222774] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-08T19:45:55.342887] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:55.478705] [DEBUG] [LOCAL ] KEX: Loaded 38453 existing records from primary storage. [2025-10-08T19:45:55.479509] [INFO ] [MAIN ] KEX: Loaded 38453 existing records. [2025-10-08T19:45:55.669105] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:55.670725] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-08T19:45:55.671328] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-08T19:45:55.672691] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-08T19:45:55.673045] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-08T19:45:56.056966] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:56.058227] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-08T19:45:56.119927] [DEBUG] [LOCAL ] KBH: Primary data saved (48855 records). [2025-10-08T19:45:56.120093] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-08T19:45:56.120182] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBH took 41.1s. Estimated remaining: 2h 47m 8s. Rate: 7.1 symbols/min [2025-10-08T19:45:56.297245] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:56.297527] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-08T19:45:56.297582] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-08T19:45:56.297718] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-08T19:45:56.297805] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-08T19:45:56.297868] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-08T19:45:56.297903] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-08T19:45:56.678819] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:45:56.682940] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:56.725908] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-08T19:45:56.817551] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-08T19:45:57.547008] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T19:45:57.617527] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-08T19:45:58.417523] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-08T19:45:58.679842] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T19:45:59.217531] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-08T19:45:59.403359] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T19:45:59.534123] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T19:46:00.017567] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-08T19:46:00.127289] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T19:46:00.817576] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-08T19:46:01.617569] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-08T19:46:01.996513] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-08T19:46:02.000485] [INFO ] [REMOTE ] KD: Full fetch complete (75708 records). [2025-10-08T19:46:02.000634] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-08T19:46:02.403590] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-08T19:46:02.404184] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-08T19:46:02.405170] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-08T19:46:02.405578] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-08T19:46:02.417580] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-08T19:46:02.419973] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T19:46:02.426878] [DEBUG] [LOCAL ] KD: Trimmed 75708 records to 52320 (keeping 200 days of data) [2025-10-08T19:46:02.544347] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:46:02.787623] [DEBUG] [LOCAL ] KD: Primary data saved (52320 records). [2025-10-08T19:46:02.787819] [INFO ] [MAIN ] KD: Full history saved. [2025-10-08T19:46:02.787922] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KD took 42.0s. Estimated remaining: 2h 46m 58s. Rate: 7.1 symbols/min [2025-10-08T19:46:02.966999] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:03.009821] [DEBUG] [LOCAL ] KEYS: Loaded 43149 existing records from primary storage. [2025-10-08T19:46:03.010130] [INFO ] [MAIN ] KEYS: Loaded 43149 existing records. [2025-10-08T19:46:03.183157] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:03.183338] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-08T19:46:03.183384] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-08T19:46:03.183704] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-08T19:46:03.183761] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-08T19:46:03.225359] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-08T19:46:03.536507] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:03.696818] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:46:04.017737] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-08T19:46:04.094259] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T19:46:04.817618] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-08T19:46:05.458117] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:46:05.617593] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-08T19:46:06.002100] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T19:46:06.417570] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-08T19:46:07.208903] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T19:46:07.217613] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-08T19:46:07.497760] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T19:46:08.017544] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-08T19:46:08.566735] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T19:46:08.817547] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-08T19:46:09.583022] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:46:09.617505] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-08T19:46:10.162978] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:46:10.417598] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-08T19:46:10.632147] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T19:46:11.217560] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-08T19:46:11.825149] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:46:12.017593] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-08T19:46:12.817512] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-08T19:46:13.090979] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T19:46:13.213564] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T19:46:13.617605] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-08T19:46:14.295252] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:46:14.417543] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-08T19:46:15.194632] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:46:15.217514] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-08T19:46:15.993409] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:46:16.017517] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-08T19:46:16.477452] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:46:16.817562] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-08T19:46:17.617513] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-08T19:46:17.870151] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:46:18.261066] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T19:46:18.417556] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-08T19:46:18.897685] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T19:46:18.901012] [INFO ] [REMOTE ] KEX: Full fetch complete (55826 records). [2025-10-08T19:46:18.901135] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-08T19:46:19.227328] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-08T19:46:19.281788] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-08T19:46:19.281881] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-08T19:46:19.282734] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-08T19:46:19.282798] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-08T19:46:19.284026] [DEBUG] [LOCAL ] KEX: Trimmed 55826 records to 38497 (keeping 200 days of data) [2025-10-08T19:46:19.524570] [DEBUG] [LOCAL ] KEX: Primary data saved (38497 records). [2025-10-08T19:46:19.524820] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-08T19:46:19.524964] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEX took 24.4s. Estimated remaining: 2h 46m 58s. Rate: 7.1 symbols/min [2025-10-08T19:46:19.697728] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:19.703086] [DEBUG] [LOCAL ] KF: Loaded 2377 existing records from primary storage. [2025-10-08T19:46:19.703264] [INFO ] [MAIN ] KF: Loaded 2377 existing records. [2025-10-08T19:46:19.894735] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T19:46:19.900517] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:19.907309] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-08T19:46:19.907517] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-08T19:46:19.908017] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-08T19:46:19.908084] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-08T19:46:20.022756] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-08T19:46:20.266760] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:20.586746] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T19:46:20.817560] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-08T19:46:21.464913] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T19:46:21.617513] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-08T19:46:21.873666] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T19:46:22.417546] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-08T19:46:22.816560] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:46:22.824763] [INFO ] [REMOTE ] KEP: Full fetch complete (41887 records). [2025-10-08T19:46:22.824947] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-08T19:46:22.937891] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T19:46:23.219960] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-08T19:46:23.219501] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-08T19:46:23.220952] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-08T19:46:23.221702] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-08T19:46:23.221774] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-08T19:46:23.222915] [DEBUG] [LOCAL ] KEP: Trimmed 41887 records to 31433 (keeping 200 days of data) [2025-10-08T19:46:23.414521] [DEBUG] [LOCAL ] KEP: Primary data saved (31433 records). [2025-10-08T19:46:23.414715] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-08T19:46:23.414885] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEP took 30.1s. Estimated remaining: 2h 46m 45s. Rate: 7.1 symbols/min [2025-10-08T19:46:23.584184] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:23.605215] [DEBUG] [LOCAL ] KFRC: Loaded 19897 existing records from primary storage. [2025-10-08T19:46:23.605516] [INFO ] [MAIN ] KFRC: Loaded 19897 existing records. [2025-10-08T19:46:23.789077] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:23.789481] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-08T19:46:23.789553] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-08T19:46:23.789998] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-08T19:46:23.790058] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-08T19:46:24.026303] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-08T19:46:24.146092] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:24.435829] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T19:46:24.817523] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-08T19:46:25.134673] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T19:46:25.310097] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T19:46:25.617590] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-08T19:46:26.417590] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-08T19:46:27.059059] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T19:46:27.217621] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-08T19:46:27.329876] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T19:46:28.017561] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-08T19:46:28.583296] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T19:46:28.817508] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-08T19:46:28.931777] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:46:29.617570] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-08T19:46:30.417560] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-08T19:46:30.460385] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T19:46:30.582919] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T19:46:30.760140] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-08T19:46:31.217598] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-08T19:46:31.522710] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-08T19:46:32.017605] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-08T19:46:32.817699] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-08T19:46:33.523310] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:46:33.591140] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:46:33.617516] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-08T19:46:34.417555] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-08T19:46:34.555452] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T19:46:34.759938] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T19:46:35.217592] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-08T19:46:36.017577] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-08T19:46:36.445606] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T19:46:36.817529] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-08T19:46:37.298294] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-08T19:46:37.302576] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-08T19:46:37.302752] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-08T19:46:37.498606] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T19:46:37.499375] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:46:37.499446] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:46:37.499522] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-08T19:46:37.499602] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-08T19:46:37.499683] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-08T19:46:37.499810] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-08T19:46:37.499915] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEY took 41.4s. Estimated remaining: 2h 46m 42s. Rate: 7.1 symbols/min [2025-10-08T19:46:37.622768] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-08T19:46:37.675997] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:37.686811] [DEBUG] [LOCAL ] KFS: Loaded 8525 existing records from primary storage. [2025-10-08T19:46:37.687138] [INFO ] [MAIN ] KFS: Loaded 8525 existing records. [2025-10-08T19:46:37.882413] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:37.889580] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-08T19:46:37.890274] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-08T19:46:37.890191] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T19:46:37.894257] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-08T19:46:37.895063] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-08T19:46:38.174782] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T19:46:38.196377] [INFO ] [REMOTE ] KF: Full fetch complete (3560 records). [2025-10-08T19:46:38.196603] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-08T19:46:38.419668] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-08T19:46:38.423789] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:38.747770] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-08T19:46:38.747883] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-08T19:46:38.748054] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-08T19:46:38.748096] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-08T19:46:38.748524] [DEBUG] [LOCAL ] KF: Trimmed 3560 records to 2375 (keeping 200 days of data) [2025-10-08T19:46:38.765738] [DEBUG] [LOCAL ] KF: Primary data saved (2375 records). [2025-10-08T19:46:38.765890] [INFO ] [MAIN ] KF: Full history saved. [2025-10-08T19:46:38.766023] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 19.2s. Estimated remaining: 2h 46m 27s. Rate: 7.1 symbols/min [2025-10-08T19:46:38.948972] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:38.949214] [DEBUG] [LOCAL ] KFY: No existing data file found in primary storage. [2025-10-08T19:46:38.949253] [WARN ] [MAIN ] KFY: No existing data found, performing full refresh instead. [2025-10-08T19:46:38.949371] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-08T19:46:38.949411] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-08T19:46:38.949451] [DEBUG] [LOCAL ] KFY: No primary data file found to delete. [2025-10-08T19:46:38.949482] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-08T19:46:39.222809] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-08T19:46:39.325103] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:40.017508] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-08T19:46:40.138814] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T19:46:40.287215] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T19:46:40.817606] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-08T19:46:41.035369] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T19:46:41.617556] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-08T19:46:42.154165] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T19:46:42.175112] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-08T19:46:42.417582] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-08T19:46:43.040797] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T19:46:43.217576] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-08T19:46:44.017530] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-08T19:46:44.037293] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T19:46:44.817571] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-08T19:46:45.232349] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T19:46:45.381728] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T19:46:45.617567] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-08T19:46:46.188615] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T19:46:46.417606] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-08T19:46:47.217595] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-08T19:46:47.938470] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T19:46:48.017610] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-08T19:46:48.363177] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T19:46:48.802148] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T19:46:48.817501] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-08T19:46:49.366229] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-08T19:46:49.617577] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-08T19:46:50.417602] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-08T19:46:50.901873] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T19:46:51.152392] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T19:46:51.217550] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-08T19:46:52.017528] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-08T19:46:52.062398] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T19:46:52.817527] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-08T19:46:53.182282] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:46:53.617608] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-08T19:46:53.849751] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:46:54.417562] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-08T19:46:55.183615] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T19:46:55.217504] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-08T19:46:55.613973] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T19:46:56.017602] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-08T19:46:56.635539] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:46:56.638837] [INFO ] [REMOTE ] KEYS: Full fetch complete (62654 records). [2025-10-08T19:46:56.638945] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-08T19:46:56.826599] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-08T19:46:57.029997] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-08T19:46:57.030163] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-08T19:46:57.031152] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-08T19:46:57.031294] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-08T19:46:57.032559] [DEBUG] [LOCAL ] KEYS: Trimmed 62654 records to 43126 (keeping 200 days of data) [2025-10-08T19:46:57.266041] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T19:46:57.326848] [DEBUG] [LOCAL ] KEYS: Primary data saved (43126 records). [2025-10-08T19:46:57.326981] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-08T19:46:57.327059] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEYS took 54.5s. Estimated remaining: 2h 46m 28s. Rate: 7.1 symbols/min [2025-10-08T19:46:57.496595] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:57.548377] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-08T19:46:57.548754] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-08T19:46:57.622806] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-08T19:46:57.739368] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:57.745791] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-08T19:46:57.745936] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-08T19:46:57.746670] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T19:46:57.748851] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-08T19:46:57.749551] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-08T19:46:58.101484] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:58.417545] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-08T19:46:59.084687] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T19:46:59.135294] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T19:46:59.217548] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-08T19:46:59.660864] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T19:47:00.017561] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-08T19:47:00.817563] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-08T19:47:01.067305] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T19:47:01.069542] [INFO ] [REMOTE ] KFRC: Full fetch complete (26077 records). [2025-10-08T19:47:01.069672] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-08T19:47:01.457263] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-08T19:47:01.457373] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-08T19:47:01.458019] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-08T19:47:01.458081] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-08T19:47:01.458938] [DEBUG] [LOCAL ] KFRC: Trimmed 26077 records to 20015 (keeping 200 days of data) [2025-10-08T19:47:01.580862] [DEBUG] [LOCAL ] KFRC: Primary data saved (20015 records). [2025-10-08T19:47:01.580998] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-08T19:47:01.581091] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KFRC took 38.2s. Estimated remaining: 2h 46m 16s. Rate: 7.1 symbols/min [2025-10-08T19:47:01.623448] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-08T19:47:01.759152] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:01.808831] [DEBUG] [LOCAL ] KGS: Loaded 45896 existing records from primary storage. [2025-10-08T19:47:01.809269] [INFO ] [MAIN ] KGS: Loaded 45896 existing records. [2025-10-08T19:47:02.007333] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:02.007664] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-08T19:47:02.007813] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-08T19:47:02.014678] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-08T19:47:02.025913] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-08T19:47:02.094875] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:47:02.392830] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:02.417495] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-08T19:47:03.217538] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-08T19:47:03.527327] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T19:47:03.611797] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T19:47:03.882950] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T19:47:04.017543] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-08T19:47:04.817554] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-08T19:47:05.356432] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T19:47:05.617523] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-08T19:47:06.397941] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T19:47:06.417490] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-08T19:47:07.096978] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:47:07.217553] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-08T19:47:08.017596] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-08T19:47:08.267847] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T19:47:08.594828] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T19:47:08.736236] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T19:47:08.737434] [INFO ] [REMOTE ] KFS: Full fetch complete (10716 records). [2025-10-08T19:47:08.737506] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-08T19:47:08.822772] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-08T19:47:09.099513] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-08T19:47:09.099594] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-08T19:47:09.099908] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-08T19:47:09.099968] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-08T19:47:09.100557] [DEBUG] [LOCAL ] KFS: Trimmed 10716 records to 8566 (keeping 200 days of data) [2025-10-08T19:47:09.150256] [DEBUG] [LOCAL ] KFS: Primary data saved (8566 records). [2025-10-08T19:47:09.150395] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-08T19:47:09.150481] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 31.7s. Estimated remaining: 2h 46m 6s. Rate: 7.1 symbols/min [2025-10-08T19:47:09.322514] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:09.373812] [DEBUG] [LOCAL ] KIM: Loaded 53026 existing records from primary storage. [2025-10-08T19:47:09.374131] [INFO ] [MAIN ] KIM: Loaded 53026 existing records. [2025-10-08T19:47:09.552606] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:09.552824] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-08T19:47:09.552880] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-08T19:47:09.554631] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-08T19:47:09.554741] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-08T19:47:09.622638] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-08T19:47:09.911616] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:10.349782] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:47:10.417507] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-08T19:47:11.217580] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-08T19:47:11.312675] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:47:11.558958] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T19:47:12.017550] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-08T19:47:12.113394] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T19:47:12.817700] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-08T19:47:13.617562] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-08T19:47:13.912712] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T19:47:14.172596] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T19:47:14.417546] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-08T19:47:14.900154] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T19:47:15.217600] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-08T19:47:15.669195] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T19:47:15.671737] [INFO ] [REMOTE ] KFY: Full fetch complete (43227 records). [2025-10-08T19:47:15.671832] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-08T19:47:16.018470] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-08T19:47:16.111475] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-08T19:47:16.111683] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-08T19:47:16.112419] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-08T19:47:16.112477] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-08T19:47:16.113478] [DEBUG] [LOCAL ] KFY: Trimmed 43227 records to 29870 (keeping 200 days of data) [2025-10-08T19:47:16.299339] [DEBUG] [LOCAL ] KFY: Primary data saved (29870 records). [2025-10-08T19:47:16.299502] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-08T19:47:16.299633] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFY took 37.5s. Estimated remaining: 2h 45m 57s. Rate: 7.1 symbols/min [2025-10-08T19:47:16.465830] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:16.487377] [DEBUG] [LOCAL ] KIO: Loaded 21383 existing records from primary storage. [2025-10-08T19:47:16.487662] [INFO ] [MAIN ] KIO: Loaded 21383 existing records. [2025-10-08T19:47:16.665714] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:16.666036] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-08T19:47:16.666106] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-08T19:47:16.667066] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-08T19:47:16.667149] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-08T19:47:16.812325] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T19:47:16.822805] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-08T19:47:17.084431] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:17.313507] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T19:47:17.617562] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-08T19:47:18.417575] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-08T19:47:18.755810] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T19:47:19.061888] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-08T19:47:19.217586] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-08T19:47:20.003209] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T19:47:20.017509] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-08T19:47:20.817538] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-08T19:47:20.872114] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T19:47:21.322030] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T19:47:21.617533] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-08T19:47:22.417557] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-08T19:47:22.742195] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T19:47:23.132481] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T19:47:23.201257] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:47:23.217552] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-08T19:47:24.017677] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-08T19:47:24.590122] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:47:24.817582] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-08T19:47:25.617528] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-08T19:47:25.718441] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T19:47:26.051636] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:47:26.417617] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-08T19:47:27.190866] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T19:47:27.217500] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-08T19:47:27.985991] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:47:28.017503] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-08T19:47:28.538847] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T19:47:28.543379] [INFO ] [REMOTE ] KGS: Full fetch complete (66359 records). [2025-10-08T19:47:28.543605] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-08T19:47:28.822754] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-08T19:47:28.989030] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-08T19:47:28.989200] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-08T19:47:28.991089] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-08T19:47:28.991175] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-08T19:47:28.993125] [DEBUG] [LOCAL ] KGS: Trimmed 66359 records to 45924 (keeping 200 days of data) [2025-10-08T19:47:29.321300] [DEBUG] [LOCAL ] KGS: Primary data saved (45924 records). [2025-10-08T19:47:29.321487] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-08T19:47:29.321621] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGS took 27.7s. Estimated remaining: 2h 45m 53s. Rate: 7.1 symbols/min [2025-10-08T19:47:29.513401] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:29.544526] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:47:29.606713] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-10-08T19:47:29.607105] [INFO ] [MAIN ] KKR: Loaded 53502 existing records. [2025-10-08T19:47:29.627603] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-08T19:47:29.789851] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:29.790072] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-08T19:47:29.790118] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-08T19:47:29.792035] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-08T19:47:29.792097] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-08T19:47:30.107878] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T19:47:30.177685] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:30.417561] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-08T19:47:31.217527] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-08T19:47:31.470133] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T19:47:31.661914] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T19:47:32.017590] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-08T19:47:32.639231] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T19:47:32.817578] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-08T19:47:33.617576] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-08T19:47:34.144923] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-08T19:47:34.417600] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-08T19:47:34.675702] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T19:47:34.714907] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T19:47:35.217625] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-08T19:47:36.017517] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-08T19:47:36.152230] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T19:47:36.413673] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T19:47:36.817584] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-08T19:47:37.588098] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:47:37.617727] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-08T19:47:38.417574] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-08T19:47:38.581032] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:47:38.835977] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T19:47:38.840581] [INFO ] [REMOTE ] KGC: Full fetch complete (77701 records). [2025-10-08T19:47:38.840778] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-08T19:47:39.222789] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-08T19:47:39.349381] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-08T19:47:39.349488] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-08T19:47:39.350561] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-08T19:47:39.350635] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-08T19:47:39.352313] [DEBUG] [LOCAL ] KGC: Trimmed 77701 records to 53699 (keeping 200 days of data) [2025-10-08T19:47:39.702444] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-08T19:47:39.702597] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-08T19:47:39.702708] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 42.4s. Estimated remaining: 2h 45m 46s. Rate: 7.1 symbols/min [2025-10-08T19:47:39.877532] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:39.885326] [DEBUG] [LOCAL ] KKRS: Loaded 5718 existing records from primary storage. [2025-10-08T19:47:39.885611] [INFO ] [MAIN ] KKRS: Loaded 5718 existing records. [2025-10-08T19:47:40.018730] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-08T19:47:40.084622] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:40.085092] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-08T19:47:40.085167] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-08T19:47:40.085828] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-08T19:47:40.085913] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-08T19:47:40.308422] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T19:47:40.498134] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T19:47:40.550251] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:40.817564] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-08T19:47:41.413727] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T19:47:41.532859] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T19:47:41.617526] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-08T19:47:42.417603] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-08T19:47:42.965842] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T19:47:43.217559] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-08T19:47:43.432454] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T19:47:44.017551] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-08T19:47:44.308463] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:47:44.817611] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-08T19:47:45.617587] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-08T19:47:45.856156] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T19:47:46.146506] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T19:47:46.417578] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-08T19:47:46.512416] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T19:47:47.217585] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-08T19:47:47.232429] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T19:47:47.234629] [INFO ] [REMOTE ] KIO: Full fetch complete (31500 records). [2025-10-08T19:47:47.234891] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-08T19:47:47.608958] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-08T19:47:47.609090] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-08T19:47:47.609756] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-08T19:47:47.609818] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-08T19:47:47.610677] [DEBUG] [LOCAL ] KIO: Trimmed 31500 records to 21461 (keeping 200 days of data) [2025-10-08T19:47:47.744972] [DEBUG] [LOCAL ] KIO: Primary data saved (21461 records). [2025-10-08T19:47:47.745136] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-08T19:47:47.745263] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIO took 31.4s. Estimated remaining: 2h 45m 37s. Rate: 7.1 symbols/min [2025-10-08T19:47:47.922564] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:47.922819] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-08T19:47:47.922877] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-08T19:47:47.923014] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-08T19:47:47.923058] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-08T19:47:47.923104] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-08T19:47:47.923138] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-08T19:47:48.022787] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-08T19:47:48.342904] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:48.817532] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-08T19:47:49.014603] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:47:49.015036] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-08T19:47:49.015159] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:47:49.015214] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-08T19:47:49.015248] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:47:49.015287] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-08T19:47:49.015346] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-08T19:47:49.015488] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-08T19:47:49.015573] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-08T19:47:49.015725] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KKRT took 1.3s. Estimated remaining: 2h 45m 22s. Rate: 7.1 symbols/min [2025-10-08T19:47:49.199390] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:49.199770] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-08T19:47:49.199899] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-08T19:47:49.200065] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-08T19:47:49.200134] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-08T19:47:49.200221] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-08T19:47:49.200324] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-08T19:47:49.578146] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:49.593301] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-08T19:47:49.617499] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-08T19:47:50.112586] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-08T19:47:50.116581] [INFO ] [REMOTE ] KIM: Full fetch complete (76814 records). [2025-10-08T19:47:50.116755] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-08T19:47:50.422827] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-08T19:47:50.512591] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-08T19:47:50.512716] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-08T19:47:50.513916] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-08T19:47:50.513982] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-08T19:47:50.515512] [DEBUG] [LOCAL ] KIM: Trimmed 76814 records to 53001 (keeping 200 days of data) [2025-10-08T19:47:50.708254] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:47:50.734893] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-08T19:47:50.735462] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:47:50.735547] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-08T19:47:50.736370] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:47:50.737044] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-08T19:47:50.737573] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-08T19:47:50.737669] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-08T19:47:50.738250] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-08T19:47:50.738878] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KLAR took 1.7s. Estimated remaining: 2h 45m 7s. Rate: 7.1 symbols/min [2025-10-08T19:47:50.940677] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:50.987911] [DEBUG] [LOCAL ] KLC: Loaded 36880 existing records from primary storage. [2025-10-08T19:47:50.990906] [INFO ] [MAIN ] KLC: Loaded 36880 existing records. [2025-10-08T19:47:51.233861] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-08T19:47:51.241429] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:51.244300] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-08T19:47:51.244717] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-08T19:47:51.246684] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-08T19:47:51.247187] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-08T19:47:51.662781] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:51.667703] [DEBUG] [LOCAL ] KIM: Primary data saved (53001 records). [2025-10-08T19:47:51.667997] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-08T19:47:51.668127] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KIM took 42.5s. Estimated remaining: 2h 44m 51s. Rate: 7.1 symbols/min [2025-10-08T19:47:51.858512] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:51.863869] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T19:47:51.898338] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-08T19:47:51.963035] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-08T19:47:51.963405] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-08T19:47:52.027725] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-08T19:47:52.168942] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:52.169171] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-08T19:47:52.169218] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-08T19:47:52.170920] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-08T19:47:52.170995] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-08T19:47:52.559956] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:52.636901] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-08T19:47:52.817585] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-08T19:47:53.617598] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-08T19:47:53.974863] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T19:47:53.994743] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T19:47:54.417572] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-08T19:47:55.217569] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-08T19:47:56.017532] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-08T19:47:56.440582] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T19:47:56.466856] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T19:47:56.499830] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T19:47:56.817578] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-08T19:47:57.617551] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-08T19:47:58.417538] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-08T19:47:58.654964] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T19:47:59.217571] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-08T19:47:59.511282] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T19:47:59.643064] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T19:47:59.644739] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-08T19:48:00.017574] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-08T19:48:00.817585] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-08T19:48:01.494052] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:48:01.617584] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-08T19:48:02.260317] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T19:48:02.417537] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-08T19:48:02.818919] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T19:48:03.217557] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-08T19:48:04.017550] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-08T19:48:04.362425] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T19:48:04.451678] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T19:48:04.817554] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-08T19:48:05.617558] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-08T19:48:05.915758] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T19:48:06.190749] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T19:48:06.417572] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-08T19:48:06.860127] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T19:48:06.861049] [INFO ] [REMOTE ] KKRS: Full fetch complete (7755 records). [2025-10-08T19:48:06.861140] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-08T19:48:07.220155] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-08T19:48:07.277478] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-08T19:48:07.277591] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-08T19:48:07.278070] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-08T19:48:07.278149] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-08T19:48:07.279076] [DEBUG] [LOCAL ] KKRS: Trimmed 7755 records to 5729 (keeping 200 days of data) [2025-10-08T19:48:07.338222] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-08T19:48:07.359978] [DEBUG] [LOCAL ] KKRS: Primary data saved (5729 records). [2025-10-08T19:48:07.360120] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-08T19:48:07.360208] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KKRS took 27.7s. Estimated remaining: 2h 44m 50s. Rate: 7.1 symbols/min [2025-10-08T19:48:08.017556] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-08T19:48:08.651749] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:48:08.817574] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-08T19:48:09.617544] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-08T19:48:09.701120] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:48:09.870142] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T19:48:10.417547] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-08T19:48:11.075440] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:48:11.217550] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-08T19:48:11.726162] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T19:48:12.017518] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-08T19:48:12.626143] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:48:12.630250] [INFO ] [REMOTE ] KKR: Full fetch complete (77452 records). [2025-10-08T19:48:12.630406] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-08T19:48:12.827453] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-08T19:48:13.038092] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-08T19:48:13.038178] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-08T19:48:13.039189] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-08T19:48:13.039259] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-08T19:48:13.040784] [DEBUG] [LOCAL ] KKR: Trimmed 77452 records to 53502 (keeping 200 days of data) [2025-10-08T19:48:13.386496] [DEBUG] [LOCAL ] KKR: Primary data saved (53502 records). [2025-10-08T19:48:13.386680] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-08T19:48:13.387535] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKR took 44.1s. Estimated remaining: 2h 44m 39s. Rate: 7.1 symbols/min [2025-10-08T19:48:13.796917] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T19:48:13.808511] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-08T19:48:14.480124] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T19:48:14.489728] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-08T19:48:15.419495] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:48:15.431405] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-08T19:48:15.546956] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T19:48:16.017538] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-08T19:48:17.459505] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:48:17.462719] [INFO ] [REMOTE ] KLC: Full fetch complete (50576 records). [2025-10-08T19:48:17.462860] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-08T19:48:17.807564] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-08T19:48:17.874306] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-08T19:48:17.911996] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-08T19:48:17.912072] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-08T19:48:17.912880] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-08T19:48:17.912971] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-08T19:48:17.914305] [DEBUG] [LOCAL ] KLC: Trimmed 50576 records to 36726 (keeping 200 days of data) [2025-10-08T19:48:18.135354] [DEBUG] [LOCAL ] KLC: Primary data saved (36726 records). [2025-10-08T19:48:18.135539] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-08T19:48:18.135705] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLC took 27.4s. Estimated remaining: 2h 44m 27s. Rate: 7.1 symbols/min [2025-10-08T19:48:19.866008] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-08T19:48:19.877533] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-08T19:48:21.578359] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T19:48:21.590390] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-08T19:48:23.219218] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T19:48:23.225313] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-08T19:48:23.225463] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-08T19:48:23.636436] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-08T19:48:23.636528] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-08T19:48:23.637569] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-08T19:48:23.637724] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-08T19:48:23.639413] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-10-08T19:48:23.977970] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-08T19:48:23.978157] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-08T19:48:23.978271] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KMI took 32.3s. Estimated remaining: 2h 44m 16s. Rate: 7.1 symbols/min [2025-10-08T19:48:24.582428] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:24.643770] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:24.795538] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:24.793395] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:24.799418] [DEBUG] [LOCAL ] KMPB: Loaded 3812 existing records from primary storage. [2025-10-08T19:48:24.800614] [INFO ] [MAIN ] KMPB: Loaded 3812 existing records. [2025-10-08T19:48:25.046303] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:25.049406] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-08T19:48:25.063017] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-08T19:48:25.061341] [DEBUG] [LOCAL ] KMT: Loaded 43017 existing records from primary storage. [2025-10-08T19:48:25.064192] [INFO ] [MAIN ] KMT: Loaded 43017 existing records. [2025-10-08T19:48:25.069519] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-08T19:48:25.097397] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-08T19:48:25.113860] [DEBUG] [LOCAL ] KMPR: Loaded 39271 existing records from primary storage. [2025-10-08T19:48:25.130925] [INFO ] [MAIN ] KMPR: Loaded 39271 existing records. [2025-10-08T19:48:25.121322] [DEBUG] [LOCAL ] KMX: Loaded 53191 existing records from primary storage. [2025-10-08T19:48:25.259282] [INFO ] [MAIN ] KMX: Loaded 53191 existing records. [2025-10-08T19:48:25.712061] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:25.738440] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-08T19:48:25.777837] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-08T19:48:25.838967] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-08T19:48:25.859866] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-08T19:48:25.959093] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:26.005963] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-08T19:48:26.029380] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-08T19:48:26.017806] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:26.050781] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-08T19:48:26.095889] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-08T19:48:26.096121] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-08T19:48:26.116079] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-08T19:48:26.121401] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-08T19:48:26.145867] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-08T19:48:26.281898] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:26.377612] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-08T19:48:27.100347] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T19:48:27.179030] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-08T19:48:27.152336] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:27.200885] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-08T19:48:27.229189] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:27.241543] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-08T19:48:27.310351] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:27.310783] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-08T19:48:27.701116] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T19:48:27.702409] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-08T19:48:28.322705] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T19:48:28.324014] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-08T19:48:28.464732] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T19:48:28.470314] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-08T19:48:28.624424] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:48:28.634215] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-08T19:48:28.748820] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T19:48:28.750466] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-08T19:48:29.048678] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-08T19:48:29.050086] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-08T19:48:29.087200] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T19:48:29.097752] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-08T19:48:29.306551] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T19:48:29.312500] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-08T19:48:29.350423] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-08T19:48:29.617579] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-08T19:48:29.668554] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T19:48:30.089297] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T19:48:30.309209] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:48:30.417521] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-08T19:48:30.832676] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:48:31.217572] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-08T19:48:31.734587] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T19:48:31.951100] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:48:32.017539] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-08T19:48:32.817599] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-08T19:48:33.195569] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:48:33.392374] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T19:48:33.617569] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-08T19:48:34.417600] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-08T19:48:35.068555] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T19:48:35.107680] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T19:48:35.217611] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-08T19:48:36.017568] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-08T19:48:36.318605] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T19:48:36.817608] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-08T19:48:37.142876] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T19:48:37.279327] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T19:48:37.280355] [INFO ] [REMOTE ] KMPB: Full fetch complete (5157 records). [2025-10-08T19:48:37.280439] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-08T19:48:37.625037] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-08T19:48:37.671628] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-08T19:48:37.671751] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-08T19:48:37.671937] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-08T19:48:37.671977] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-08T19:48:37.672418] [DEBUG] [LOCAL ] KMPB: Trimmed 5157 records to 3832 (keeping 200 days of data) [2025-10-08T19:48:37.697211] [DEBUG] [LOCAL ] KMPB: Primary data saved (3832 records). [2025-10-08T19:48:37.697341] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-08T19:48:37.697470] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 13.7s. Estimated remaining: 2h 44m 13s. Rate: 7.1 symbols/min [2025-10-08T19:48:37.874457] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:37.914978] [DEBUG] [LOCAL ] KN: Loaded 38610 existing records from primary storage. [2025-10-08T19:48:37.915307] [INFO ] [MAIN ] KN: Loaded 38610 existing records. [2025-10-08T19:48:38.101997] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:38.102287] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-08T19:48:38.102350] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-08T19:48:38.103071] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-08T19:48:38.103133] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-08T19:48:38.422891] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-08T19:48:38.486826] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:39.081092] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T19:48:39.217566] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-08T19:48:39.558891] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T19:48:40.017537] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-08T19:48:40.559047] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:48:40.817547] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-08T19:48:41.269846] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T19:48:41.617600] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-08T19:48:42.000456] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T19:48:42.417617] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-08T19:48:42.710903] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T19:48:43.217620] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-08T19:48:43.420626] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T19:48:44.017526] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-08T19:48:44.826422] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-08T19:48:44.832025] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T19:48:45.485919] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T19:48:45.617569] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-08T19:48:46.417516] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-08T19:48:46.636925] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T19:48:47.165554] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T19:48:47.217501] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-08T19:48:47.831160] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:48:48.017502] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-08T19:48:48.605513] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T19:48:48.817577] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-08T19:48:49.453574] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:48:49.457487] [INFO ] [REMOTE ] KMT: Full fetch complete (62020 records). [2025-10-08T19:48:49.457764] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-08T19:48:49.642784] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-08T19:48:49.873048] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-08T19:48:49.873231] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-08T19:48:49.874186] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-08T19:48:49.874252] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-08T19:48:49.875702] [DEBUG] [LOCAL ] KMT: Trimmed 62020 records to 42969 (keeping 200 days of data) [2025-10-08T19:48:50.017691] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T19:48:50.186418] [DEBUG] [LOCAL ] KMT: Primary data saved (42969 records). [2025-10-08T19:48:50.186636] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-08T19:48:50.186814] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMT took 26.2s. Estimated remaining: 2h 44m 8s. Rate: 7.1 symbols/min [2025-10-08T19:48:50.352528] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:50.387665] [DEBUG] [LOCAL ] KNF: Loaded 36138 existing records from primary storage. [2025-10-08T19:48:50.387993] [INFO ] [MAIN ] KNF: Loaded 36138 existing records. [2025-10-08T19:48:50.422877] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-08T19:48:50.571565] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:50.571866] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-08T19:48:50.571936] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-08T19:48:50.573041] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-08T19:48:50.573144] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-08T19:48:50.963191] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:51.217550] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-08T19:48:51.795531] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T19:48:52.019733] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-08T19:48:52.023035] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:48:52.468156] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T19:48:52.817569] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-08T19:48:53.617570] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-08T19:48:53.980273] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T19:48:54.033154] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T19:48:54.037579] [INFO ] [REMOTE ] KMPR: Full fetch complete (51969 records). [2025-10-08T19:48:54.037805] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-08T19:48:54.417684] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-08T19:48:54.435933] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-08T19:48:54.436021] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-08T19:48:54.436918] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-08T19:48:54.436986] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-08T19:48:54.438177] [DEBUG] [LOCAL ] KMPR: Trimmed 51969 records to 39350 (keeping 200 days of data) [2025-10-08T19:48:54.687692] [DEBUG] [LOCAL ] KMPR: Primary data saved (39350 records). [2025-10-08T19:48:54.687974] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-08T19:48:54.688135] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMPR took 30.7s. Estimated remaining: 2h 43m 56s. Rate: 7.1 symbols/min [2025-10-08T19:48:54.886250] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T19:48:54.888710] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:54.897510] [DEBUG] [LOCAL ] KNOP: No existing data file found in primary storage. [2025-10-08T19:48:54.897627] [WARN ] [MAIN ] KNOP: No existing data found, performing full refresh instead. [2025-10-08T19:48:54.897792] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-08T19:48:54.897836] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-08T19:48:54.897876] [DEBUG] [LOCAL ] KNOP: No primary data file found to delete. [2025-10-08T19:48:54.897909] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-08T19:48:55.222794] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-08T19:48:55.280135] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:56.017595] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-08T19:48:56.220784] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T19:48:56.817571] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-08T19:48:56.959390] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T19:48:57.165507] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T19:48:57.423841] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T19:48:57.617555] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-08T19:48:58.201176] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T19:48:58.417578] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-08T19:48:59.217602] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-08T19:48:59.698370] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:49:00.017556] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-08T19:49:00.817542] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-08T19:49:01.002589] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T19:49:01.434407] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T19:49:01.537728] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-08T19:49:01.617564] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-08T19:49:02.417560] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-08T19:49:02.921801] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:49:03.217581] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-08T19:49:04.017506] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-08T19:49:04.275185] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:49:04.360102] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T19:49:04.540581] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T19:49:04.817566] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-08T19:49:05.617563] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-08T19:49:06.183782] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:49:06.417609] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-08T19:49:07.100233] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T19:49:07.217557] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-08T19:49:07.701403] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:49:08.017563] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-08T19:49:08.165524] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T19:49:08.817590] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-08T19:49:09.617577] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-08T19:49:09.736723] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T19:49:09.740787] [INFO ] [REMOTE ] KMX: Full fetch complete (76099 records). [2025-10-08T19:49:09.740917] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-08T19:49:10.199563] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-08T19:49:10.200505] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-08T19:49:10.201184] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T19:49:10.202252] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-08T19:49:10.202767] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-08T19:49:10.207376] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:49:10.219245] [DEBUG] [LOCAL ] KMX: Trimmed 76099 records to 53215 (keeping 200 days of data) [2025-10-08T19:49:10.422843] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-08T19:49:10.539093] [DEBUG] [LOCAL ] KMX: Primary data saved (53215 records). [2025-10-08T19:49:10.539247] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-08T19:49:10.539343] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMX took 46.6s. Estimated remaining: 2h 43m 55s. Rate: 7.1 symbols/min [2025-10-08T19:49:10.710149] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:10.728419] [DEBUG] [LOCAL ] KNSL: Loaded 18443 existing records from primary storage. [2025-10-08T19:49:10.728761] [INFO ] [MAIN ] KNSL: Loaded 18443 existing records. [2025-10-08T19:49:10.904013] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:49:10.904243] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-08T19:49:10.904288] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-08T19:49:10.904896] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-08T19:49:10.904957] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-08T19:49:11.222688] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-08T19:49:11.258720] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:11.757486] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T19:49:11.903995] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T19:49:12.017511] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-08T19:49:12.817555] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-08T19:49:13.617596] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-08T19:49:14.143007] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T19:49:14.378378] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-08T19:49:14.417496] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-08T19:49:14.735997] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:49:15.174723] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:49:15.217546] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-08T19:49:16.017519] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-08T19:49:16.071765] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T19:49:16.817559] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-08T19:49:17.294028] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:49:17.617563] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-08T19:49:17.883747] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:49:18.417591] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-08T19:49:18.942710] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T19:49:18.945940] [INFO ] [REMOTE ] KN: Full fetch complete (56527 records). [2025-10-08T19:49:18.946072] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-08T19:49:19.222735] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-08T19:49:19.335913] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-08T19:49:19.336004] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-08T19:49:19.336825] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-08T19:49:19.336886] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-08T19:49:19.338009] [DEBUG] [LOCAL ] KN: Trimmed 56527 records to 38528 (keeping 200 days of data) [2025-10-08T19:49:19.440581] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:49:19.443742] [INFO ] [REMOTE ] KNOP: Full fetch complete (14703 records). [2025-10-08T19:49:19.445362] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-08T19:49:19.868561] [DEBUG] [LOCAL ] KN: Primary data saved (38528 records). [2025-10-08T19:49:19.871988] [INFO ] [MAIN ] KN: Full history saved. [2025-10-08T19:49:19.872106] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KN took 42.2s. Estimated remaining: 2h 43m 47s. Rate: 7.1 symbols/min [2025-10-08T19:49:20.057430] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-08T19:49:20.021390] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-08T19:49:20.057631] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-08T19:49:20.058808] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-08T19:49:20.058887] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-08T19:49:20.070492] [DEBUG] [LOCAL ] KNOP: Trimmed 14703 records to 10498 (keeping 200 days of data) [2025-10-08T19:49:20.224467] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:20.235440] [DEBUG] [LOCAL ] KNOP: Primary data saved (10498 records). [2025-10-08T19:49:20.235602] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-08T19:49:20.235724] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KNOP took 25.5s. Estimated remaining: 2h 43m 31s. Rate: 7.1 symbols/min [2025-10-08T19:49:20.410599] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:20.439932] [DEBUG] [LOCAL ] KNTK: Loaded 46489 existing records from primary storage. [2025-10-08T19:49:20.440275] [INFO ] [MAIN ] KNTK: Loaded 46489 existing records. [2025-10-08T19:49:20.646989] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:49:20.647398] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-08T19:49:20.647580] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-08T19:49:20.663369] [DEBUG] [LOCAL ] KNX: Loaded 52597 existing records from primary storage. [2025-10-08T19:49:20.663668] [INFO ] [MAIN ] KNX: Loaded 52597 existing records. [2025-10-08T19:49:20.663717] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-08T19:49:20.663832] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-08T19:49:21.065042] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:49:21.083246] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-08T19:49:21.111627] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-08T19:49:21.163558] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-08T19:49:21.179828] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-08T19:49:21.181171] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-08T19:49:21.326519] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:21.345907] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-08T19:49:21.371291] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T19:49:21.634046] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:21.629167] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-08T19:49:22.417516] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-08T19:49:22.867584] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T19:49:22.970124] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:49:23.217560] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-08T19:49:24.017520] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-08T19:49:24.102694] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T19:49:24.452866] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T19:49:24.456625] [INFO ] [REMOTE ] KNF: Full fetch complete (51003 records). [2025-10-08T19:49:24.456789] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-08T19:49:24.825188] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-08T19:49:24.868757] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-08T19:49:24.868840] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-08T19:49:24.869583] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-08T19:49:24.869624] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-08T19:49:24.870738] [DEBUG] [LOCAL ] KNF: Trimmed 51003 records to 36214 (keeping 200 days of data) [2025-10-08T19:49:25.099453] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T19:49:25.104278] [DEBUG] [LOCAL ] KNF: Primary data saved (36214 records). [2025-10-08T19:49:25.109394] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-08T19:49:25.109510] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNF took 34.9s. Estimated remaining: 2h 43m 19s. Rate: 7.1 symbols/min [2025-10-08T19:49:25.275471] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:25.275706] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-08T19:49:25.275757] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-08T19:49:25.275871] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-08T19:49:25.275912] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-08T19:49:25.275952] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-08T19:49:25.275984] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-08T19:49:25.618764] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-08T19:49:25.622524] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:26.220255] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T19:49:26.417633] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-08T19:49:27.217550] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-08T19:49:27.302959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T19:49:27.492563] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T19:49:28.017611] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-08T19:49:28.364945] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:49:28.817714] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-08T19:49:29.594570] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:49:29.617497] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-08T19:49:30.417581] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-08T19:49:30.538896] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T19:49:31.192358] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:49:31.217511] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-08T19:49:32.017592] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-08T19:49:32.758992] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-08T19:49:32.817530] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-08T19:49:32.883836] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:49:33.617548] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-08T19:49:33.888338] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T19:49:34.417530] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-08T19:49:34.773180] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T19:49:35.148849] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-08T19:49:35.217520] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-08T19:49:36.017521] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-08T19:49:36.105240] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:49:36.793276] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T19:49:36.817497] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-08T19:49:37.518840] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-08T19:49:37.544242] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T19:49:37.617515] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-08T19:49:38.417518] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-08T19:49:38.720936] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T19:49:39.217581] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-08T19:49:40.017549] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-08T19:49:40.288416] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T19:49:40.743975] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-08T19:49:40.817546] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-08T19:49:41.617517] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-08T19:49:41.762404] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T19:49:41.845341] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T19:49:42.417607] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-08T19:49:43.217633] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-08T19:49:44.017706] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-08T19:49:44.128582] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T19:49:44.175578] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-08T19:49:44.187737] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:49:44.190928] [INFO ] [REMOTE ] KNSL: Full fetch complete (26833 records). [2025-10-08T19:49:44.191020] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-08T19:49:44.567609] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-08T19:49:44.567789] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-08T19:49:44.568459] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-08T19:49:44.568501] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-08T19:49:44.569365] [DEBUG] [LOCAL ] KNSL: Trimmed 26833 records to 18414 (keeping 200 days of data) [2025-10-08T19:49:44.688970] [DEBUG] [LOCAL ] KNSL: Primary data saved (18414 records). [2025-10-08T19:49:44.689141] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-08T19:49:44.689250] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNSL took 34.1s. Estimated remaining: 2h 43m 22s. Rate: 7.1 symbols/min [2025-10-08T19:49:44.827541] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-08T19:49:44.861689] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:44.904174] [DEBUG] [LOCAL ] KODK: Loaded 43411 existing records from primary storage. [2025-10-08T19:49:44.904553] [INFO ] [MAIN ] KODK: Loaded 43411 existing records. [2025-10-08T19:49:45.079107] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:49:45.079402] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-08T19:49:45.079450] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-08T19:49:45.080335] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-08T19:49:45.080395] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-08T19:49:45.427384] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:45.617562] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-08T19:49:45.857820] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T19:49:46.417572] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-08T19:49:46.946083] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T19:49:47.217565] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-08T19:49:47.481280] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-08T19:49:47.980900] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:49:48.017521] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-08T19:49:48.546299] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T19:49:48.817615] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-08T19:49:49.617563] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-08T19:49:49.680496] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T19:49:50.417552] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-08T19:49:51.094279] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T19:49:51.173228] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-08T19:49:51.217552] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-08T19:49:51.926091] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T19:49:52.017576] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-08T19:49:52.817604] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-08T19:49:52.918815] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T19:49:53.617617] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-08T19:49:54.265011] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:49:54.417515] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-08T19:49:54.455348] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-08T19:49:55.217707] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-08T19:49:55.271084] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T19:49:55.556663] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:49:56.017591] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-08T19:49:56.678420] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:49:56.817584] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-08T19:49:57.617568] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-08T19:49:57.666219] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T19:49:58.417534] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-08T19:49:58.545896] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:49:58.550983] [INFO ] [REMOTE ] KNX: Full fetch complete (75907 records). [2025-10-08T19:49:58.551169] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-08T19:49:58.979930] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-08T19:49:58.980021] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-08T19:49:58.981021] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-08T19:49:58.981085] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-08T19:49:58.983139] [DEBUG] [LOCAL ] KNX: Trimmed 75907 records to 52596 (keeping 200 days of data) [2025-10-08T19:49:59.091868] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T19:49:59.097229] [INFO ] [REMOTE ] KNTK: Full fetch complete (64969 records). [2025-10-08T19:49:59.097933] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-08T19:49:59.221428] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-08T19:49:59.530161] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-08T19:49:59.530529] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-08T19:49:59.532082] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-08T19:49:59.532166] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-08T19:49:59.535994] [DEBUG] [LOCAL ] KNTK: Trimmed 64969 records to 46585 (keeping 200 days of data) [2025-10-08T19:50:00.036717] [DEBUG] [LOCAL ] KNX: Primary data saved (52596 records). [2025-10-08T19:50:00.050012] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-08T19:50:00.051841] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNX took 39.8s. Estimated remaining: 2h 43m 20s. Rate: 7.1 symbols/min [2025-10-08T19:50:00.198875] [DEBUG] [LOCAL ] KNTK: Primary data saved (46585 records). [2025-10-08T19:50:00.249618] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-08T19:50:00.252362] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:00.252684] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 40.4s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-10-08T19:50:00.440771] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:00.455272] [DEBUG] [LOCAL ] KOF: Loaded 26511 existing records from primary storage. [2025-10-08T19:50:00.455869] [INFO ] [MAIN ] KOF: Loaded 26511 existing records. [2025-10-08T19:50:00.575779] [DEBUG] [LOCAL ] KOP: Loaded 17540 existing records from primary storage. [2025-10-08T19:50:00.592928] [INFO ] [MAIN ] KOP: Loaded 17540 existing records. [2025-10-08T19:50:00.750843] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:00.762307] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-08T19:50:00.773124] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-08T19:50:00.779989] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-08T19:50:00.795855] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-08T19:50:00.930981] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:50:01.072479] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-08T19:50:01.071713] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:01.084055] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-08T19:50:01.089432] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-08T19:50:01.178175] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-08T19:50:01.216445] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-08T19:50:01.508898] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:01.532905] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-08T19:50:01.552460] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (3.13 seconds). [2025-10-08T19:50:01.622612] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-08T19:50:01.841151] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:02.417563] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-08T19:50:02.602450] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:50:02.766442] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T19:50:03.217512] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-08T19:50:03.460013] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T19:50:03.979351] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-08T19:50:04.017518] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-08T19:50:04.042130] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T19:50:04.817568] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-08T19:50:05.005191] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T19:50:05.617510] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-08T19:50:05.781170] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T19:50:06.417516] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-08T19:50:06.629031] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:50:07.217553] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-08T19:50:07.959636] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T19:50:08.017535] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-08T19:50:08.235776] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T19:50:08.817613] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-08T19:50:09.617536] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-08T19:50:09.787242] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T19:50:10.386774] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-08T19:50:10.391886] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-08T19:50:10.392033] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-08T19:50:10.423194] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-08T19:50:10.594437] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T19:50:10.595350] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:50:10.595431] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:50:10.595505] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-08T19:50:10.595578] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-08T19:50:10.595615] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-08T19:50:10.595701] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-08T19:50:10.595795] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KO took 45.5s. Estimated remaining: 2h 42m 57s. Rate: 7.1 symbols/min [2025-10-08T19:50:10.774879] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:10.779900] [DEBUG] [LOCAL ] KORE: Loaded 2093 existing records from primary storage. [2025-10-08T19:50:10.780101] [INFO ] [MAIN ] KORE: Loaded 2093 existing records. [2025-10-08T19:50:10.972048] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:10.972589] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-08T19:50:10.972683] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-08T19:50:10.972872] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-08T19:50:10.972929] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-08T19:50:11.118791] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:50:11.225046] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-08T19:50:11.394715] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:11.681851] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T19:50:12.017564] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-08T19:50:12.817533] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-08T19:50:12.839378] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T19:50:12.843076] [INFO ] [REMOTE ] KODK: Full fetch complete (63345 records). [2025-10-08T19:50:12.843207] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-08T19:50:13.188320] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T19:50:13.283108] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-08T19:50:13.283203] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-08T19:50:13.284147] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-08T19:50:13.284213] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-08T19:50:13.285514] [DEBUG] [LOCAL ] KODK: Trimmed 63345 records to 43452 (keeping 200 days of data) [2025-10-08T19:50:13.534472] [DEBUG] [LOCAL ] KODK: Primary data saved (43452 records). [2025-10-08T19:50:13.534611] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-08T19:50:13.534725] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 28.8s. Estimated remaining: 2h 42m 43s. Rate: 7.1 symbols/min [2025-10-08T19:50:13.622672] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-08T19:50:13.719692] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:13.769718] [DEBUG] [LOCAL ] KOS: Loaded 53067 existing records from primary storage. [2025-10-08T19:50:13.770053] [INFO ] [MAIN ] KOS: Loaded 53067 existing records. [2025-10-08T19:50:13.913898] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T19:50:13.974779] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:13.975005] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-08T19:50:13.975058] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-08T19:50:13.975259] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-08T19:50:13.975315] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-08T19:50:14.341999] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:14.349581] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T19:50:14.417573] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-08T19:50:14.921861] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T19:50:15.217558] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-08T19:50:15.977583] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:50:16.017550] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-08T19:50:16.716988] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T19:50:16.817614] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-08T19:50:17.257942] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T19:50:17.617550] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-08T19:50:18.068043] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T19:50:18.417636] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-08T19:50:18.868971] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T19:50:19.217612] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-08T19:50:20.017537] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-08T19:50:20.463516] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:50:20.625040] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T19:50:20.817608] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-08T19:50:21.617625] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-08T19:50:22.080801] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T19:50:22.188700] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-08T19:50:22.417508] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-08T19:50:23.217573] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-08T19:50:23.429580] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T19:50:24.017518] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-08T19:50:24.371251] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T19:50:24.644441] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T19:50:24.817556] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-08T19:50:25.155544] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T19:50:25.617555] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-08T19:50:26.417559] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-08T19:50:27.217504] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-08T19:50:27.409977] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T19:50:27.506103] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:50:27.666809] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T19:50:28.017550] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-08T19:50:28.442704] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T19:50:28.443733] [INFO ] [REMOTE ] KORE: Full fetch complete (5661 records). [2025-10-08T19:50:28.443828] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-08T19:50:28.822738] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-08T19:50:28.891022] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-08T19:50:28.891111] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-08T19:50:28.891357] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-08T19:50:28.891469] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-08T19:50:28.892071] [DEBUG] [LOCAL ] KORE: Trimmed 5661 records to 2116 (keeping 200 days of data) [2025-10-08T19:50:28.905050] [DEBUG] [LOCAL ] KORE: Primary data saved (2116 records). [2025-10-08T19:50:28.905251] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-08T19:50:28.905373] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KORE took 18.3s. Estimated remaining: 2h 42m 41s. Rate: 7.1 symbols/min [2025-10-08T19:50:29.126863] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:29.187350] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-08T19:50:29.187803] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-08T19:50:29.388697] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:29.388938] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-08T19:50:29.388985] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-08T19:50:29.389397] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-08T19:50:29.389455] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-08T19:50:29.624944] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-08T19:50:29.784047] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:30.417533] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-08T19:50:30.656706] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T19:50:30.857923] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T19:50:31.217554] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-08T19:50:31.451874] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:50:31.453605] [INFO ] [REMOTE ] KOP: Full fetch complete (25521 records). [2025-10-08T19:50:31.453709] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-08T19:50:31.826503] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-08T19:50:31.826673] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-08T19:50:31.827245] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-08T19:50:31.827287] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-08T19:50:31.827941] [DEBUG] [LOCAL ] KOP: Trimmed 25521 records to 17423 (keeping 200 days of data) [2025-10-08T19:50:31.938298] [DEBUG] [LOCAL ] KOP: Primary data saved (17423 records). [2025-10-08T19:50:31.938465] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-08T19:50:31.938620] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 31.7s. Estimated remaining: 2h 42m 28s. Rate: 7.1 symbols/min [2025-10-08T19:50:32.022764] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-08T19:50:32.109364] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:32.157394] [DEBUG] [LOCAL ] KRC: Loaded 48364 existing records from primary storage. [2025-10-08T19:50:32.157760] [INFO ] [MAIN ] KRC: Loaded 48364 existing records. [2025-10-08T19:50:32.332315] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:32.332554] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-08T19:50:32.332600] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-08T19:50:32.333101] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-08T19:50:32.333160] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-08T19:50:32.698352] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:32.727149] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T19:50:32.817564] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-08T19:50:33.298222] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:50:33.617547] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-08T19:50:34.373918] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T19:50:34.417552] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-08T19:50:34.559673] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T19:50:34.562584] [INFO ] [REMOTE ] KOF: Full fetch complete (37657 records). [2025-10-08T19:50:34.562747] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-08T19:50:35.053628] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-08T19:50:35.053799] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-08T19:50:35.054580] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-08T19:50:35.054669] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-08T19:50:35.055829] [DEBUG] [LOCAL ] KOF: Trimmed 37657 records to 26540 (keeping 200 days of data) [2025-10-08T19:50:35.224244] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-08T19:50:35.252325] [DEBUG] [LOCAL ] KOF: Primary data saved (26540 records). [2025-10-08T19:50:35.252442] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-08T19:50:35.252530] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 35.2s. Estimated remaining: 2h 42m 15s. Rate: 7.1 symbols/min [2025-10-08T19:50:35.481079] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:35.533014] [DEBUG] [LOCAL ] KREF: Loaded 37782 existing records from primary storage. [2025-10-08T19:50:35.533423] [INFO ] [MAIN ] KREF: Loaded 37782 existing records. [2025-10-08T19:50:35.742780] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:35.743156] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-08T19:50:35.743327] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-08T19:50:35.743861] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-08T19:50:35.743922] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-08T19:50:36.025242] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-08T19:50:36.140577] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T19:50:36.242493] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:36.765899] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:50:36.817515] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-08T19:50:37.617541] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-08T19:50:37.964592] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T19:50:38.191935] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:50:38.417538] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-08T19:50:39.213928] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T19:50:39.224054] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-08T19:50:39.912932] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T19:50:40.017514] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-08T19:50:40.068769] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T19:50:40.817601] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-08T19:50:41.617512] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-08T19:50:41.733762] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T19:50:42.428166] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-08T19:50:42.440053] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T19:50:42.479016] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T19:50:43.217558] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-08T19:50:44.017531] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-08T19:50:44.152775] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T19:50:44.817516] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-08T19:50:45.081779] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T19:50:45.617577] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-08T19:50:45.662609] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T19:50:46.417525] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-08T19:50:46.636683] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T19:50:47.079588] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:50:47.217545] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-08T19:50:48.021776] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-08T19:50:48.027721] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T19:50:48.817550] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-08T19:50:49.124989] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T19:50:49.617520] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-08T19:50:49.654532] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:50:50.383570] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:50:50.417499] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-08T19:50:51.217504] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-08T19:50:51.264932] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T19:50:52.017566] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-08T19:50:52.745383] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-08T19:50:52.810730] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T19:50:52.824728] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-08T19:50:53.546342] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:50:53.617558] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-08T19:50:54.393747] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T19:50:54.417530] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-08T19:50:54.531949] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T19:50:55.217557] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-08T19:50:56.017522] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-08T19:50:56.213780] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T19:50:56.631280] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T19:50:56.817519] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-08T19:50:57.141289] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:50:57.617554] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-08T19:50:58.417571] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-08T19:50:58.743887] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T19:50:58.792489] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T19:50:59.217627] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-08T19:51:00.017614] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-08T19:51:00.096552] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T19:51:00.521223] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T19:51:00.817549] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-08T19:51:01.432867] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:51:01.617547] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-08T19:51:02.417561] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-08T19:51:02.812054] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-08T19:51:02.845801] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:51:03.217554] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-08T19:51:04.017517] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-08T19:51:04.210964] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T19:51:04.215682] [INFO ] [REMOTE ] KOS: Full fetch complete (76872 records). [2025-10-08T19:51:04.215844] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-08T19:51:04.549763] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T19:51:04.587415] [INFO ] [REMOTE ] KREF: Full fetch complete (52710 records). [2025-10-08T19:51:04.612448] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-08T19:51:04.710455] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-08T19:51:04.721927] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-08T19:51:04.735275] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-08T19:51:04.746748] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-08T19:51:04.816294] [DEBUG] [LOCAL ] KOS: Trimmed 76872 records to 53075 (keeping 200 days of data) [2025-10-08T19:51:04.830840] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-08T19:51:05.195368] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-08T19:51:05.195861] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-08T19:51:05.197528] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-08T19:51:05.197972] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-08T19:51:05.202398] [DEBUG] [LOCAL ] KREF: Trimmed 52710 records to 37756 (keeping 200 days of data) [2025-10-08T19:51:05.568083] [DEBUG] [LOCAL ] KREF: Primary data saved (37756 records). [2025-10-08T19:51:05.568835] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-08T19:51:05.568981] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KREF took 30.3s. Estimated remaining: 2h 42m 27s. Rate: 7.1 symbols/min [2025-10-08T19:51:05.751378] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:05.871017] [DEBUG] [LOCAL ] KRG: Loaded 49208 existing records from primary storage. [2025-10-08T19:51:05.875105] [DEBUG] [LOCAL ] KOS: Primary data saved (53075 records). [2025-10-08T19:51:05.875024] [INFO ] [MAIN ] KRG: Loaded 49208 existing records. [2025-10-08T19:51:05.875278] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-08T19:51:05.887135] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KOS took 52.4s. Estimated remaining: 2h 42m 11s. Rate: 7.1 symbols/min [2025-10-08T19:51:06.206530] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:06.219459] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-08T19:51:06.256315] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-08T19:51:06.250938] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:06.269323] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-08T19:51:06.269487] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-08T19:51:06.269692] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-08T19:51:06.269926] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-08T19:51:06.271970] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-08T19:51:06.270551] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-08T19:51:06.283249] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-08T19:51:06.271748] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-08T19:51:06.302123] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-08T19:51:06.438338] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-08T19:51:06.494865] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T19:51:06.525425] [INFO ] [REMOTE ] KRC: Full fetch complete (69930 records). [2025-10-08T19:51:06.541938] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-08T19:51:07.173183] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:07.202842] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-08T19:51:07.406083] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:07.410031] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-08T19:51:07.523407] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-08T19:51:07.523536] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-08T19:51:07.525110] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-08T19:51:07.525194] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-08T19:51:07.527390] [DEBUG] [LOCAL ] KRC: Trimmed 69930 records to 48354 (keeping 200 days of data) [2025-10-08T19:51:07.671204] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:51:07.674369] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-08T19:51:07.674983] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:51:07.675499] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-08T19:51:07.676165] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:51:07.677542] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-08T19:51:07.678117] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-08T19:51:07.678561] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-08T19:51:07.679139] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-08T19:51:07.679899] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KRMN took 1.8s. Estimated remaining: 2h 41m 56s. Rate: 7.1 symbols/min [2025-10-08T19:51:07.868520] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:08.006105] [DEBUG] [LOCAL ] KRO: Loaded 26164 existing records from primary storage. [2025-10-08T19:51:08.009431] [INFO ] [MAIN ] KRO: Loaded 26164 existing records. [2025-10-08T19:51:08.204609] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:08.206460] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-08T19:51:08.206574] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-08T19:51:08.209321] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-08T19:51:08.209691] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-08T19:51:08.463261] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T19:51:08.527260] [INFO ] [REMOTE ] KR: Full fetch complete (77679 records). [2025-10-08T19:51:08.531839] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-08T19:51:08.753024] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:08.753977] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-08T19:51:08.943083] [DEBUG] [LOCAL ] KRC: Primary data saved (48354 records). [2025-10-08T19:51:08.953481] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-08T19:51:08.971108] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KRC took 37.0s. Estimated remaining: 2h 41m 41s. Rate: 7.1 symbols/min [2025-10-08T19:51:09.338144] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:09.341160] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-08T19:51:09.340713] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-08T19:51:09.341930] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-08T19:51:09.344384] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-08T19:51:09.355230] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-08T19:51:09.355441] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-08T19:51:09.359310] [DEBUG] [LOCAL ] KR: Trimmed 77679 records to 53681 (keeping 200 days of data) [2025-10-08T19:51:09.531435] [DEBUG] [LOCAL ] KRP: Loaded 36699 existing records from primary storage. [2025-10-08T19:51:09.589337] [INFO ] [MAIN ] KRP: Loaded 36699 existing records. [2025-10-08T19:51:09.847742] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:09.859534] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-08T19:51:09.859872] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-08T19:51:09.860259] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-08T19:51:09.860323] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-08T19:51:10.162445] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T19:51:10.227687] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-08T19:51:10.217958] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-08T19:51:10.233164] [INFO ] [MAIN ] KR: Full history saved. [2025-10-08T19:51:10.240989] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KR took 41.3s. Estimated remaining: 2h 41m 26s. Rate: 7.1 symbols/min [2025-10-08T19:51:10.496330] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:10.512906] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-08T19:51:10.596414] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:10.687891] [DEBUG] [LOCAL ] KSS: Loaded 53600 existing records from primary storage. [2025-10-08T19:51:10.689107] [INFO ] [MAIN ] KSS: Loaded 53600 existing records. [2025-10-08T19:51:10.914288] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T19:51:11.072734] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:11.073052] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-08T19:51:11.073122] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-08T19:51:11.073592] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-08T19:51:11.073696] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-08T19:51:11.222907] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-08T19:51:11.528270] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:51:11.612379] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:11.641832] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T19:51:12.017571] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-08T19:51:12.606734] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:51:12.817605] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-08T19:51:13.574991] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T19:51:13.617605] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-08T19:51:14.417562] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-08T19:51:14.549000] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T19:51:15.228877] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-08T19:51:15.235717] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T19:51:15.394434] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T19:51:16.017542] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-08T19:51:16.480356] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T19:51:16.817556] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-08T19:51:17.617537] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-08T19:51:17.802486] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T19:51:18.417547] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-08T19:51:18.452378] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T19:51:19.217533] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-08T19:51:19.284833] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:51:19.823125] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:51:20.017551] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-08T19:51:20.110096] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T19:51:20.817592] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-08T19:51:21.539100] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:51:21.617522] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-08T19:51:21.929059] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T19:51:22.417722] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-08T19:51:22.955921] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T19:51:23.217635] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-08T19:51:23.875437] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T19:51:24.017541] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-08T19:51:24.817589] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-08T19:51:25.106507] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T19:51:25.382017] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T19:51:25.617635] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-08T19:51:26.338718] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T19:51:26.417677] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-08T19:51:27.128515] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:51:27.217626] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-08T19:51:28.017621] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-08T19:51:28.549920] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:51:28.626126] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-08T19:51:28.817632] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-08T19:51:29.593327] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T19:51:29.597847] [INFO ] [REMOTE ] KRG: Full fetch complete (71117 records). [2025-10-08T19:51:29.598017] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-08T19:51:29.623589] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-08T19:51:30.063954] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-08T19:51:30.070549] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-08T19:51:30.082551] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-08T19:51:30.082693] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-08T19:51:30.085395] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T19:51:30.093433] [DEBUG] [LOCAL ] KRG: Trimmed 71117 records to 49171 (keeping 200 days of data) [2025-10-08T19:51:30.404678] [DEBUG] [LOCAL ] KRG: Primary data saved (49171 records). [2025-10-08T19:51:30.404875] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-08T19:51:30.405002] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRG took 24.8s. Estimated remaining: 2h 41m 28s. Rate: 7.1 symbols/min [2025-10-08T19:51:30.427285] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-08T19:51:30.583815] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:30.628596] [DEBUG] [LOCAL ] KT: Loaded 45597 existing records from primary storage. [2025-10-08T19:51:30.628992] [INFO ] [MAIN ] KT: Loaded 45597 existing records. [2025-10-08T19:51:30.813035] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:30.813293] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-08T19:51:30.813341] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-08T19:51:30.813731] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-08T19:51:30.813789] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-08T19:51:31.179994] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:31.217564] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-08T19:51:31.650058] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-08T19:51:31.986219] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:51:32.017503] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-08T19:51:32.792753] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T19:51:32.817561] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-08T19:51:33.135960] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:51:33.617602] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-08T19:51:34.099729] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:51:34.417595] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-08T19:51:35.217540] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-08T19:51:35.662948] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-08T19:51:35.699456] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:51:36.017599] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-08T19:51:36.215632] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T19:51:36.817562] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-08T19:51:37.229122] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T19:51:37.617554] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-08T19:51:38.417520] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-08T19:51:38.645361] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T19:51:38.850825] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T19:51:39.217570] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-08T19:51:39.475560] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:51:40.017553] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-08T19:51:40.817553] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-08T19:51:40.876950] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T19:51:41.617609] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-08T19:51:42.129744] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T19:51:42.140876] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T19:51:42.417620] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-08T19:51:42.686802] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:51:43.217612] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-08T19:51:43.631582] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T19:51:43.634199] [INFO ] [REMOTE ] KRO: Full fetch complete (35061 records). [2025-10-08T19:51:43.634346] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-08T19:51:44.032746] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-08T19:51:44.035540] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-08T19:51:44.035710] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-08T19:51:44.037929] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-08T19:51:44.038023] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-08T19:51:44.039267] [DEBUG] [LOCAL ] KRO: Trimmed 35061 records to 26221 (keeping 200 days of data) [2025-10-08T19:51:44.202781] [DEBUG] [LOCAL ] KRO: Primary data saved (26221 records). [2025-10-08T19:51:44.211909] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-08T19:51:44.212365] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T19:51:44.212677] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRO took 36.5s. Estimated remaining: 2h 41m 25s. Rate: 7.1 symbols/min [2025-10-08T19:51:44.248455] [INFO ] [REMOTE ] KRP: Full fetch complete (54791 records). [2025-10-08T19:51:44.284609] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-08T19:51:44.563565] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:44.818554] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-08T19:51:44.840089] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-08T19:51:44.840251] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-08T19:51:44.841348] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-08T19:51:44.841531] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-08T19:51:44.858054] [DEBUG] [LOCAL ] KTB: Loaded 40697 existing records from primary storage. [2025-10-08T19:51:44.858279] [DEBUG] [LOCAL ] KRP: Trimmed 54791 records to 36701 (keeping 200 days of data) [2025-10-08T19:51:44.859014] [INFO ] [MAIN ] KTB: Loaded 40697 existing records. [2025-10-08T19:51:45.210615] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:45.211389] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-08T19:51:45.211471] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-08T19:51:45.214982] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-08T19:51:45.215070] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-08T19:51:45.767334] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:45.768958] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-08T19:51:45.824937] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T19:51:45.847006] [DEBUG] [LOCAL ] KRP: Primary data saved (36701 records). [2025-10-08T19:51:45.847258] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-08T19:51:45.847387] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 36.9s. Estimated remaining: 2h 41m 10s. Rate: 7.1 symbols/min [2025-10-08T19:51:46.050197] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:46.068015] [DEBUG] [LOCAL ] KTF: Loaded 12066 existing records from primary storage. [2025-10-08T19:51:46.068435] [INFO ] [MAIN ] KTF: Loaded 12066 existing records. [2025-10-08T19:51:46.279674] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:46.279984] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-08T19:51:46.280042] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-08T19:51:46.280311] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-08T19:51:46.280374] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-08T19:51:46.422926] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-08T19:51:46.711740] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:46.977637] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-08T19:51:47.217604] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-08T19:51:47.249742] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:51:48.017562] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-08T19:51:48.060098] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T19:51:48.817532] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-08T19:51:48.992061] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T19:51:49.328245] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:51:49.617578] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-08T19:51:49.900742] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T19:51:50.417608] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-08T19:51:51.142396] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T19:51:51.217577] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-08T19:51:51.986298] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T19:51:52.017585] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-08T19:51:52.151684] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:51:52.155761] [INFO ] [REMOTE ] KSS: Full fetch complete (77628 records). [2025-10-08T19:51:52.155892] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-08T19:51:52.574602] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-08T19:51:52.574856] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-08T19:51:52.576002] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-08T19:51:52.576072] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-08T19:51:52.577740] [DEBUG] [LOCAL ] KSS: Trimmed 77628 records to 53597 (keeping 200 days of data) [2025-10-08T19:51:52.817814] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-08T19:51:52.911596] [DEBUG] [LOCAL ] KSS: Primary data saved (53597 records). [2025-10-08T19:51:52.911775] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-08T19:51:52.911866] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KSS took 42.7s. Estimated remaining: 2h 41m 1s. Rate: 7.1 symbols/min [2025-10-08T19:51:53.085890] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:53.086085] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-08T19:51:53.086131] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-08T19:51:53.086271] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-08T19:51:53.086331] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-08T19:51:53.086379] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-08T19:51:53.086414] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-08T19:51:53.448896] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:53.459337] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T19:51:53.489738] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T19:51:53.617560] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-08T19:51:54.417526] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-08T19:51:55.009699] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T19:51:55.079451] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T19:51:55.217532] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-08T19:51:55.991549] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:51:56.017497] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-08T19:51:56.730025] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T19:51:56.817544] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-08T19:51:57.617517] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-08T19:51:57.759574] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T19:51:58.417561] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-08T19:51:58.519065] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T19:51:59.164011] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:51:59.217501] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-08T19:51:59.842691] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T19:52:00.017550] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-08T19:52:00.694726] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T19:52:00.817539] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-08T19:52:01.571368] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:52:01.617554] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-08T19:52:02.024003] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T19:52:02.417551] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-08T19:52:03.217604] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-08T19:52:03.555147] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T19:52:03.558585] [INFO ] [REMOTE ] KT: Full fetch complete (66485 records). [2025-10-08T19:52:03.558740] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-08T19:52:03.956893] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-08T19:52:03.956977] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-08T19:52:03.957893] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-08T19:52:03.957958] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-08T19:52:03.959316] [DEBUG] [LOCAL ] KT: Trimmed 66485 records to 45551 (keeping 200 days of data) [2025-10-08T19:52:04.021302] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-08T19:52:04.059779] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T19:52:04.253703] [DEBUG] [LOCAL ] KT: Primary data saved (45551 records). [2025-10-08T19:52:04.254062] [INFO ] [MAIN ] KT: Full history saved. [2025-10-08T19:52:04.254154] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 33.8s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-08T19:52:04.422945] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:04.476339] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-08T19:52:04.476711] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-08T19:52:04.652721] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:04.652999] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-08T19:52:04.653046] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-08T19:52:04.653898] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-08T19:52:04.653957] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-08T19:52:04.823329] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-08T19:52:05.039204] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:05.287227] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T19:52:05.389692] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T19:52:05.617575] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-08T19:52:06.417535] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-08T19:52:06.670693] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-08T19:52:06.993357] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:52:07.217600] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-08T19:52:08.017592] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-08T19:52:08.448558] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T19:52:08.711453] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:52:08.817561] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-08T19:52:09.617564] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-08T19:52:10.417577] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-08T19:52:10.487872] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:52:10.969787] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T19:52:11.217534] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-08T19:52:11.297887] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T19:52:12.017569] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-08T19:52:12.059887] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T19:52:12.817598] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-08T19:52:13.576281] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:52:13.617522] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-08T19:52:13.761471] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T19:52:14.301358] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T19:52:14.302791] [INFO ] [REMOTE ] KTF: Full fetch complete (17541 records). [2025-10-08T19:52:14.302874] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-08T19:52:14.422775] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-08T19:52:14.676521] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-08T19:52:14.676607] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-08T19:52:14.677029] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-08T19:52:14.677089] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-08T19:52:14.677632] [DEBUG] [LOCAL ] KTF: Trimmed 17541 records to 12064 (keeping 200 days of data) [2025-10-08T19:52:14.751149] [DEBUG] [LOCAL ] KTF: Primary data saved (12064 records). [2025-10-08T19:52:14.751289] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-08T19:52:14.751373] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KTF took 28.9s. Estimated remaining: 2h 40m 48s. Rate: 7.1 symbols/min [2025-10-08T19:52:14.915410] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:14.968699] [DEBUG] [LOCAL ] KVYO: Loaded 50334 existing records from primary storage. [2025-10-08T19:52:14.969098] [INFO ] [MAIN ] KVYO: Loaded 50334 existing records. [2025-10-08T19:52:15.142274] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:15.142535] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-08T19:52:15.142625] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-08T19:52:15.142864] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-08T19:52:15.142920] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-08T19:52:15.222678] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-08T19:52:15.565908] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:15.933425] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:52:16.017510] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-08T19:52:16.781584] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T19:52:16.817521] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-08T19:52:17.617532] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-08T19:52:17.855128] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T19:52:17.891399] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:52:18.417548] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-08T19:52:18.941526] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T19:52:19.217563] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-08T19:52:20.017625] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-08T19:52:20.227982] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T19:52:20.327753] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T19:52:20.817571] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-08T19:52:21.617564] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-08T19:52:21.689835] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:52:22.295834] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:52:22.417583] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-08T19:52:23.222676] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-08T19:52:23.246275] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T19:52:23.728423] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T19:52:24.017528] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-08T19:52:24.827476] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-08T19:52:24.832957] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T19:52:25.586040] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T19:52:25.617529] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-08T19:52:26.422671] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-08T19:52:26.442704] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T19:52:27.217555] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-08T19:52:27.536890] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T19:52:27.821782] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T19:52:28.017570] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-08T19:52:28.817528] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-08T19:52:29.017449] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T19:52:29.035910] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:52:29.037577] [INFO ] [REMOTE ] KUKE: Full fetch complete (8753 records). [2025-10-08T19:52:29.037675] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-08T19:52:29.230920] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T19:52:29.231200] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:52:29.231270] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:52:29.231318] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-08T19:52:29.231377] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-08T19:52:29.231410] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-08T19:52:29.231448] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-08T19:52:29.231506] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KUKE took 36.3s. Estimated remaining: 2h 40m 46s. Rate: 7.1 symbols/min [2025-10-08T19:52:29.405816] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:29.450272] [DEBUG] [LOCAL ] KW: Loaded 40422 existing records from primary storage. [2025-10-08T19:52:29.450587] [INFO ] [MAIN ] KW: Loaded 40422 existing records. [2025-10-08T19:52:29.629987] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-08T19:52:29.635889] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:29.637120] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-08T19:52:29.637191] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-08T19:52:29.637463] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-08T19:52:29.637530] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-08T19:52:30.028122] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:30.417632] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-08T19:52:31.001986] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-08T19:52:31.007858] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-08T19:52:31.008026] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-08T19:52:31.250154] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-08T19:52:31.421387] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-08T19:52:31.421528] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-08T19:52:31.422583] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-08T19:52:31.422694] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-08T19:52:31.454887] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 53667 (keeping 200 days of data) [2025-10-08T19:52:31.457427] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T19:52:31.816093] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-08T19:52:31.816315] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-08T19:52:31.816461] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KVUE took 27.6s. Estimated remaining: 2h 40m 32s. Rate: 7.1 symbols/min [2025-10-08T19:52:31.993917] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:32.016892] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T19:52:32.024389] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-08T19:52:32.040374] [DEBUG] [LOCAL ] KWR: Loaded 16316 existing records from primary storage. [2025-10-08T19:52:32.040714] [INFO ] [MAIN ] KWR: Loaded 16316 existing records. [2025-10-08T19:52:32.221841] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:32.222131] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-08T19:52:32.222181] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-08T19:52:32.222423] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-08T19:52:32.222481] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-08T19:52:32.558163] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T19:52:32.587981] [INFO ] [REMOTE ] KTB: Full fetch complete (57949 records). [2025-10-08T19:52:32.611096] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-08T19:52:32.705390] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:32.823729] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-08T19:52:33.060929] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-08T19:52:33.061029] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-08T19:52:33.061923] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-08T19:52:33.061989] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-08T19:52:33.063333] [DEBUG] [LOCAL ] KTB: Trimmed 57949 records to 40584 (keeping 200 days of data) [2025-10-08T19:52:33.340009] [DEBUG] [LOCAL ] KTB: Primary data saved (40584 records). [2025-10-08T19:52:33.340166] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-08T19:52:33.340259] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KTB took 49.1s. Estimated remaining: 2h 40m 17s. Rate: 7.1 symbols/min [2025-10-08T19:52:33.526828] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:33.564257] [DEBUG] [LOCAL ] KYN: Loaded 29972 existing records from primary storage. [2025-10-08T19:52:33.564720] [INFO ] [MAIN ] KYN: Loaded 29972 existing records. [2025-10-08T19:52:33.632762] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-08T19:52:33.768020] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:33.782076] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-08T19:52:33.782199] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-08T19:52:33.782857] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-08T19:52:33.783951] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:52:33.782920] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-08T19:52:34.217504] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:34.246043] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T19:52:34.417538] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-08T19:52:34.787026] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T19:52:35.217619] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-08T19:52:35.724053] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:52:36.017606] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-08T19:52:36.535015] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:52:36.817586] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-08T19:52:37.278727] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:52:37.617563] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-08T19:52:38.180988] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T19:52:38.417572] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-08T19:52:39.058827] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T19:52:39.150327] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T19:52:39.217599] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-08T19:52:40.017586] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-08T19:52:40.232058] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:52:40.817604] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-08T19:52:41.175394] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T19:52:41.617547] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-08T19:52:42.417540] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-08T19:52:42.531603] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T19:52:42.561614] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T19:52:43.217580] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-08T19:52:43.696358] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:52:43.958155] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T19:52:44.017537] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-08T19:52:44.817571] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-08T19:52:45.617518] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-08T19:52:46.417609] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-08T19:52:46.578058] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T19:52:46.582909] [INFO ] [REMOTE ] KVYO: Full fetch complete (71760 records). [2025-10-08T19:52:46.583114] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-08T19:52:46.902391] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-08T19:52:47.128562] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-08T19:52:47.128740] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-08T19:52:47.130002] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-08T19:52:47.130070] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-08T19:52:47.131746] [DEBUG] [LOCAL ] KVYO: Trimmed 71760 records to 50429 (keeping 200 days of data) [2025-10-08T19:52:47.230225] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-08T19:52:47.482784] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T19:52:47.505711] [DEBUG] [LOCAL ] KVYO: Primary data saved (50429 records). [2025-10-08T19:52:47.505870] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-08T19:52:47.506985] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KVYO took 32.8s. Estimated remaining: 2h 40m 14s. Rate: 7.1 symbols/min [2025-10-08T19:52:47.727398] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:47.776031] [DEBUG] [LOCAL ] L: Loaded 41121 existing records from primary storage. [2025-10-08T19:52:47.776396] [INFO ] [MAIN ] L: Loaded 41121 existing records. [2025-10-08T19:52:48.018970] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:48.019243] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-08T19:52:48.019794] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-08T19:52:48.020880] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-08T19:52:48.021153] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-08T19:52:48.021215] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-08T19:52:48.417835] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T19:52:48.499941] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:48.817600] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-08T19:52:49.317810] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (3.70 seconds). [2025-10-08T19:52:49.617520] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-08T19:52:49.836241] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T19:52:50.417574] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-08T19:52:50.515700] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-08T19:52:50.832803] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T19:52:51.217531] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-08T19:52:51.707222] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T19:52:52.017610] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-08T19:52:52.614539] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:52:52.817544] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-08T19:52:52.994884] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T19:52:53.617541] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-08T19:52:54.333309] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:52:54.417543] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-08T19:52:55.212687] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:52:55.221126] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-08T19:52:55.546982] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T19:52:56.017564] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-08T19:52:56.109282] [DEBUG] [REMOTE ] L: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-08T19:52:56.109621] [WARN ] [REMOTE ] L: No data returned for month 2025-03 [2025-10-08T19:52:56.109732] [FATAL] [REMOTE ] L: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:52:56.109819] [FATAL] [MAIN ] L: Failed to fetch primary data. [2025-10-08T19:52:56.109883] [WARN ] [MAIN ] L: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:52:56.109960] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-08T19:52:56.110026] [DEBUG] [LOCAL ] L: No primary data file found to delete. [2025-10-08T19:52:56.110063] [INFO ] [LOCAL ] L: Starting deletion of derivative data. [2025-10-08T19:52:56.110312] [DEBUG] [LOCAL ] L: Deleted derivative data file. [2025-10-08T19:52:56.111069] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. L took 8.6s. Estimated remaining: 2h 40m 6s. Rate: 7.1 symbols/min [2025-10-08T19:52:56.296846] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:56.350897] [DEBUG] [LOCAL ] LAC: Loaded 52426 existing records from primary storage. [2025-10-08T19:52:56.351332] [INFO ] [MAIN ] LAC: Loaded 52426 existing records. [2025-10-08T19:52:56.552414] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:56.553961] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:52:56.560245] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-08T19:52:56.560801] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-08T19:52:56.561394] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-08T19:52:56.561453] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-08T19:52:56.822612] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-08T19:52:56.930892] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:57.617603] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-08T19:52:58.383057] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T19:52:58.417498] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-08T19:52:59.217546] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-08T19:52:59.482826] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:53:00.017578] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-08T19:53:00.555066] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T19:53:00.736857] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (3.12 seconds). [2025-10-08T19:53:00.817510] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-08T19:53:00.887146] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T19:53:01.617598] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-08T19:53:01.941320] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:53:02.417608] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-08T19:53:03.217507] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-08T19:53:03.675246] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-08T19:53:03.716770] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T19:53:03.718262] [INFO ] [REMOTE ] KWR: Full fetch complete (23880 records). [2025-10-08T19:53:03.718354] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-08T19:53:04.019146] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-08T19:53:04.107409] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-08T19:53:04.107488] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-08T19:53:04.108019] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-08T19:53:04.108081] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-08T19:53:04.108741] [DEBUG] [LOCAL ] KWR: Trimmed 23880 records to 16250 (keeping 200 days of data) [2025-10-08T19:53:04.211463] [DEBUG] [LOCAL ] KWR: Primary data saved (16250 records). [2025-10-08T19:53:04.211616] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-08T19:53:04.211754] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KWR took 32.4s. Estimated remaining: 2h 39m 57s. Rate: 7.1 symbols/min [2025-10-08T19:53:04.383929] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:04.407991] [DEBUG] [LOCAL ] LAD: Loaded 23615 existing records from primary storage. [2025-10-08T19:53:04.408265] [INFO ] [MAIN ] LAD: Loaded 23615 existing records. [2025-10-08T19:53:04.534850] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:53:04.621732] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:04.621974] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-08T19:53:04.622022] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-08T19:53:04.622306] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-08T19:53:04.622364] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-08T19:53:04.823038] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-08T19:53:04.987178] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:05.617513] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-08T19:53:05.800780] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:53:06.207598] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:53:06.210930] [INFO ] [REMOTE ] KW: Full fetch complete (57086 records). [2025-10-08T19:53:06.211044] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-08T19:53:06.424078] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-08T19:53:06.604434] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-08T19:53:06.604585] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-08T19:53:06.605423] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-08T19:53:06.605486] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-08T19:53:06.606768] [DEBUG] [LOCAL ] KW: Trimmed 57086 records to 40373 (keeping 200 days of data) [2025-10-08T19:53:06.845632] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:53:06.873434] [DEBUG] [LOCAL ] KW: Primary data saved (40373 records). [2025-10-08T19:53:06.873571] [INFO ] [MAIN ] KW: Full history saved. [2025-10-08T19:53:06.873692] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KW took 37.6s. Estimated remaining: 2h 39m 43s. Rate: 7.1 symbols/min [2025-10-08T19:53:07.046054] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:07.084176] [DEBUG] [LOCAL ] LADR: Loaded 39140 existing records from primary storage. [2025-10-08T19:53:07.084486] [INFO ] [MAIN ] LADR: Loaded 39140 existing records. [2025-10-08T19:53:07.226254] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-08T19:53:07.272900] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:07.273201] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-08T19:53:07.273259] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-08T19:53:07.273779] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-08T19:53:07.273841] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-08T19:53:07.662460] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:08.017631] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-08T19:53:08.415016] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:53:08.677758] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T19:53:08.817543] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-08T19:53:09.278147] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T19:53:09.617552] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-08T19:53:10.417565] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-08T19:53:10.618693] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:53:10.765873] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T19:53:11.217542] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-08T19:53:11.647957] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:53:12.017554] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-08T19:53:12.817635] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-08T19:53:13.017108] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T19:53:13.164706] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T19:53:13.167748] [INFO ] [REMOTE ] KYN: Full fetch complete (44391 records). [2025-10-08T19:53:13.167911] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-08T19:53:13.616628] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-08T19:53:13.616771] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-08T19:53:13.617801] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-08T19:53:13.618189] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-08T19:53:13.617947] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-08T19:53:13.620961] [DEBUG] [LOCAL ] KYN: Trimmed 44391 records to 30062 (keeping 200 days of data) [2025-10-08T19:53:13.836912] [DEBUG] [LOCAL ] KYN: Primary data saved (30062 records). [2025-10-08T19:53:13.837087] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-08T19:53:13.837182] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. KYN took 40.5s. Estimated remaining: 2h 39m 33s. Rate: 7.1 symbols/min [2025-10-08T19:53:14.018008] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:14.043742] [DEBUG] [LOCAL ] LANV: Loaded 2798 existing records from primary storage. [2025-10-08T19:53:14.045712] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T19:53:14.045995] [INFO ] [MAIN ] LANV: Loaded 2798 existing records. [2025-10-08T19:53:14.248528] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:14.248886] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-08T19:53:14.248956] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-08T19:53:14.249213] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-08T19:53:14.249280] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-08T19:53:14.429989] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-08T19:53:14.628079] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:14.714362] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T19:53:15.217608] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-08T19:53:15.888528] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T19:53:16.017493] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-08T19:53:16.592804] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:53:16.817582] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-08T19:53:17.073498] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T19:53:17.557073] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-08T19:53:17.617491] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-08T19:53:18.417579] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-08T19:53:18.684707] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:53:19.217574] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-08T19:53:19.682285] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-08T19:53:20.017530] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-08T19:53:20.278235] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-08T19:53:20.817574] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-08T19:53:21.617627] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-08T19:53:21.757806] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T19:53:21.957206] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T19:53:22.039448] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T19:53:22.417538] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-08T19:53:23.217527] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-08T19:53:23.278545] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T19:53:24.017591] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-08T19:53:24.320363] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T19:53:24.360311] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T19:53:24.817556] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-08T19:53:25.617595] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-08T19:53:26.206158] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T19:53:26.417685] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-08T19:53:26.479776] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T19:53:27.217624] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-08T19:53:27.975883] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T19:53:28.017539] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-08T19:53:28.817612] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-08T19:53:29.267869] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T19:53:29.336088] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T19:53:29.416292] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T19:53:29.617563] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-08T19:53:30.417576] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-08T19:53:30.755963] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-08T19:53:31.217505] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-08T19:53:31.506839] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-08T19:53:31.539379] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T19:53:32.017537] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-08T19:53:32.817615] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-08T19:53:33.521241] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:53:33.617532] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-08T19:53:34.417584] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-08T19:53:34.742855] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T19:53:34.746438] [INFO ] [REMOTE ] LADR: Full fetch complete (55553 records). [2025-10-08T19:53:34.746554] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-08T19:53:35.153077] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-08T19:53:35.202950] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-08T19:53:35.203104] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-08T19:53:35.203994] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-08T19:53:35.204061] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-08T19:53:35.205392] [DEBUG] [LOCAL ] LADR: Trimmed 55553 records to 39156 (keeping 200 days of data) [2025-10-08T19:53:35.259545] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-08T19:53:35.455787] [DEBUG] [LOCAL ] LADR: Primary data saved (39156 records). [2025-10-08T19:53:35.456076] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-08T19:53:35.456250] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LADR took 28.6s. Estimated remaining: 2h 39m 37s. Rate: 7.1 symbols/min [2025-10-08T19:53:35.570091] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T19:53:35.616358] [INFO ] [REMOTE ] LAD: Full fetch complete (35375 records). [2025-10-08T19:53:35.626226] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-08T19:53:35.695572] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:35.733169] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-08T19:53:35.751715] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-08T19:53:35.754240] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-08T19:53:35.754671] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-08T19:53:35.760199] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-08T19:53:35.760294] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-08T19:53:36.021467] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-08T19:53:36.481075] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-08T19:53:36.487485] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:36.488478] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-08T19:53:36.492310] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-08T19:53:36.492481] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T19:53:36.492612] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-08T19:53:36.494780] [DEBUG] [LOCAL ] LAD: Trimmed 35375 records to 23558 (keeping 200 days of data) [2025-10-08T19:53:36.641927] [DEBUG] [LOCAL ] LAD: Primary data saved (23558 records). [2025-10-08T19:53:36.642065] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-08T19:53:36.642152] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LAD took 32.4s. Estimated remaining: 2h 39m 22s. Rate: 7.1 symbols/min [2025-10-08T19:53:36.817527] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:36.817713] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-08T19:53:36.838551] [DEBUG] [LOCAL ] LAW: Loaded 14260 existing records from primary storage. [2025-10-08T19:53:36.838889] [INFO ] [MAIN ] LAW: Loaded 14260 existing records. [2025-10-08T19:53:37.015546] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:37.015793] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-08T19:53:37.015850] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-08T19:53:37.016054] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-08T19:53:37.016112] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-08T19:53:37.305608] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T19:53:37.385965] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:37.556781] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-08T19:53:37.560782] [INFO ] [REMOTE ] LAC: Full fetch complete (75999 records). [2025-10-08T19:53:37.560915] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-08T19:53:37.623731] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-08T19:53:37.990359] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-08T19:53:37.990450] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-08T19:53:37.991436] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-08T19:53:37.991504] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-08T19:53:37.993181] [DEBUG] [LOCAL ] LAC: Trimmed 75999 records to 52443 (keeping 200 days of data) [2025-10-08T19:53:38.291240] [DEBUG] [LOCAL ] LAC: Primary data saved (52443 records). [2025-10-08T19:53:38.291391] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-08T19:53:38.292858] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAC took 42.2s. Estimated remaining: 2h 39m 7s. Rate: 7.1 symbols/min [2025-10-08T19:53:38.385774] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T19:53:38.417498] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-08T19:53:39.158518] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:53:39.217557] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-08T19:53:39.423518] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:53:39.423895] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-08T19:53:39.423991] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:53:39.424043] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-08T19:53:39.424103] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:53:39.424171] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-08T19:53:39.424234] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-08T19:53:39.424269] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-08T19:53:39.424306] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-08T19:53:39.424351] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAR took 4.0s. Estimated remaining: 2h 38m 52s. Rate: 7.1 symbols/min [2025-10-08T19:53:40.017581] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-08T19:53:40.416192] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-08T19:53:40.817577] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-08T19:53:41.362013] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T19:53:41.617589] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-08T19:53:42.173678] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T19:53:42.174873] [INFO ] [REMOTE ] LANV: Full fetch complete (4388 records). [2025-10-08T19:53:42.174950] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-08T19:53:42.430752] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-08T19:53:42.564957] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-08T19:53:42.565051] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-08T19:53:42.565245] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-08T19:53:42.565284] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-08T19:53:42.565690] [DEBUG] [LOCAL ] LANV: Trimmed 4388 records to 2763 (keeping 200 days of data) [2025-10-08T19:53:42.581991] [DEBUG] [LOCAL ] LANV: Primary data saved (2763 records). [2025-10-08T19:53:42.582075] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-08T19:53:42.582191] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LANV took 28.7s. Estimated remaining: 2h 38m 39s. Rate: 7.1 symbols/min [2025-10-08T19:53:43.182287] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T19:53:43.217533] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-08T19:53:44.016814] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T19:53:44.020314] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-08T19:53:44.728533] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T19:53:44.817599] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-08T19:53:45.482846] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T19:53:45.617582] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-08T19:53:46.373030] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T19:53:46.417552] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-08T19:53:47.068574] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T19:53:47.217578] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-08T19:53:48.080292] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T19:53:48.084172] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-08T19:53:49.101245] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T19:53:49.105456] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-08T19:53:49.900901] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T19:53:49.902581] [INFO ] [REMOTE ] LAW: Full fetch complete (20691 records). [2025-10-08T19:53:49.902684] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-08T19:53:50.266978] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-08T19:53:50.267086] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-08T19:53:50.267568] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-08T19:53:50.267608] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-08T19:53:50.268241] [DEBUG] [LOCAL ] LAW: Trimmed 20691 records to 14259 (keeping 200 days of data) [2025-10-08T19:53:50.346358] [DEBUG] [LOCAL ] LAW: Primary data saved (14259 records). [2025-10-08T19:53:50.346503] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-08T19:53:50.346587] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LAW took 13.7s. Estimated remaining: 2h 38m 30s. Rate: 7.1 symbols/min [2025-10-08T19:53:50.868210] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:50.966156] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:51.067260] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:51.071256] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:51.071777] [DEBUG] [LOCAL ] LC: No existing data file found in primary storage. [2025-10-08T19:53:51.071925] [WARN ] [MAIN ] LC: No existing data found, performing full refresh instead. [2025-10-08T19:53:51.072325] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-08T19:53:51.073381] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-08T19:53:51.073585] [DEBUG] [LOCAL ] LC: No primary data file found to delete. [2025-10-08T19:53:51.074032] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-08T19:53:51.229045] [DEBUG] [LOCAL ] LB: Loaded 37759 existing records from primary storage. [2025-10-08T19:53:51.269527] [INFO ] [MAIN ] LB: Loaded 37759 existing records. [2025-10-08T19:53:51.429858] [DEBUG] [LOCAL ] LAZ: Loaded 44783 existing records from primary storage. [2025-10-08T19:53:51.468881] [INFO ] [MAIN ] LAZ: Loaded 44783 existing records. [2025-10-08T19:53:51.629753] [DEBUG] [LOCAL ] LBRT: Loaded 52933 existing records from primary storage. [2025-10-08T19:53:51.740530] [INFO ] [MAIN ] LBRT: Loaded 52933 existing records. [2025-10-08T19:53:51.771903] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:51.783793] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-08T19:53:51.767810] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:51.803631] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-08T19:53:51.905071] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-08T19:53:51.975380] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-08T19:53:51.987888] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-08T19:53:52.086973] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:52.134385] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-08T19:53:52.134097] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:52.170880] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-08T19:53:52.183110] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-08T19:53:52.177916] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-08T19:53:52.204244] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-08T19:53:52.204418] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-08T19:53:52.230509] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-08T19:53:52.256272] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-08T19:53:52.953322] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:52.983145] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-08T19:53:53.174173] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:53.187926] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-08T19:53:53.213961] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:53.214689] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-08T19:53:53.637689] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T19:53:53.648899] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-08T19:53:54.288552] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:53:54.297762] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-08T19:53:54.415826] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T19:53:54.424548] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-08T19:53:54.956354] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:53:55.217704] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-08T19:53:55.449349] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T19:53:55.981084] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T19:53:56.017491] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-08T19:53:56.051739] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T19:53:56.616904] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T19:53:56.817607] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-08T19:53:57.291405] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:53:57.617515] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-08T19:53:58.376043] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T19:53:58.417520] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-08T19:53:58.771008] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:53:59.217560] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-08T19:53:59.743736] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T19:54:00.017544] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-08T19:54:00.817587] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-08T19:54:00.946442] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T19:54:01.403519] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T19:54:01.617540] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-08T19:54:02.422742] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-08T19:54:02.440671] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T19:54:03.065133] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T19:54:03.217609] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-08T19:54:04.017576] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-08T19:54:04.237865] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T19:54:04.493239] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:54:04.817686] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-08T19:54:05.573262] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:54:05.617579] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-08T19:54:06.417600] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-08T19:54:06.510130] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T19:54:07.217521] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-08T19:54:07.292501] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T19:54:07.814275] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T19:54:08.017555] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-08T19:54:08.631216] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:54:08.817692] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-08T19:54:09.359800] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T19:54:09.617619] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-08T19:54:10.417527] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-08T19:54:10.606446] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T19:54:10.740779] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T19:54:11.217595] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-08T19:54:11.914821] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:54:12.017532] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-08T19:54:12.777394] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T19:54:12.817556] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-08T19:54:13.390438] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:54:13.617577] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-08T19:54:14.261578] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:54:14.417570] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-08T19:54:15.056087] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:54:15.217563] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-08T19:54:15.835144] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:54:16.017542] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-08T19:54:16.502478] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T19:54:16.817594] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-08T19:54:17.219975] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:54:17.224492] [INFO ] [REMOTE ] LC: Full fetch complete (70502 records). [2025-10-08T19:54:17.224680] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-08T19:54:17.623282] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-08T19:54:17.622703] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-08T19:54:17.624289] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-08T19:54:17.625512] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-08T19:54:17.625738] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-08T19:54:17.627318] [DEBUG] [LOCAL ] LC: Trimmed 70502 records to 47939 (keeping 200 days of data) [2025-10-08T19:54:17.923568] [DEBUG] [LOCAL ] LC: Primary data saved (47939 records). [2025-10-08T19:54:17.923744] [INFO ] [MAIN ] LC: Full history saved. [2025-10-08T19:54:17.923835] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LC took 27.6s. Estimated remaining: 2h 38m 39s. Rate: 7.1 symbols/min [2025-10-08T19:54:18.106411] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:18.135814] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:54:18.170351] [DEBUG] [LOCAL ] LCII: Loaded 27755 existing records from primary storage. [2025-10-08T19:54:18.170688] [INFO ] [MAIN ] LCII: Loaded 27755 existing records. [2025-10-08T19:54:18.354004] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:18.354291] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-08T19:54:18.354365] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-08T19:54:18.354754] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-08T19:54:18.354837] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-08T19:54:18.422672] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-08T19:54:18.709677] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:18.978724] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:54:19.217574] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-08T19:54:20.017535] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-08T19:54:20.309805] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T19:54:20.375174] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T19:54:20.817577] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-08T19:54:21.545065] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:54:21.617517] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-08T19:54:21.959688] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T19:54:22.417563] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-08T19:54:22.748814] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T19:54:23.217716] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-08T19:54:23.833550] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:54:23.836936] [INFO ] [REMOTE ] LAZ: Full fetch complete (65808 records). [2025-10-08T19:54:23.837096] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-08T19:54:24.018922] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-08T19:54:24.251684] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-08T19:54:24.251796] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-08T19:54:24.252719] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-08T19:54:24.252788] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-08T19:54:24.254250] [DEBUG] [LOCAL ] LAZ: Trimmed 65808 records to 44782 (keeping 200 days of data) [2025-10-08T19:54:24.542416] [DEBUG] [LOCAL ] LAZ: Primary data saved (44782 records). [2025-10-08T19:54:24.542558] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-08T19:54:24.542690] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 34.2s. Estimated remaining: 2h 38m 29s. Rate: 7.1 symbols/min [2025-10-08T19:54:24.714199] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:24.761442] [DEBUG] [LOCAL ] LDI: Loaded 44391 existing records from primary storage. [2025-10-08T19:54:24.761818] [INFO ] [MAIN ] LDI: Loaded 44391 existing records. [2025-10-08T19:54:24.824752] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-08T19:54:24.954631] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:24.954941] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-08T19:54:24.955024] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-08T19:54:24.955432] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-08T19:54:24.955495] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-08T19:54:25.289897] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T19:54:25.362277] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:25.436978] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:54:25.441734] [INFO ] [REMOTE ] LB: Full fetch complete (55899 records). [2025-10-08T19:54:25.441846] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-08T19:54:25.619834] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-08T19:54:25.891599] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-08T19:54:25.892260] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-08T19:54:25.893425] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T19:54:25.894445] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-08T19:54:25.901570] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-08T19:54:25.903853] [DEBUG] [LOCAL ] LB: Trimmed 55899 records to 37667 (keeping 200 days of data) [2025-10-08T19:54:26.136128] [DEBUG] [LOCAL ] LB: Primary data saved (37667 records). [2025-10-08T19:54:26.136310] [INFO ] [MAIN ] LB: Full history saved. [2025-10-08T19:54:26.136421] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LB took 35.8s. Estimated remaining: 2h 38m 14s. Rate: 7.1 symbols/min [2025-10-08T19:54:26.305297] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:26.350538] [DEBUG] [LOCAL ] LDOS: Loaded 45428 existing records from primary storage. [2025-10-08T19:54:26.350907] [INFO ] [MAIN ] LDOS: Loaded 45428 existing records. [2025-10-08T19:54:26.423577] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-08T19:54:26.529735] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:26.530002] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-08T19:54:26.530049] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-08T19:54:26.530299] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-08T19:54:26.530356] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-08T19:54:26.889000] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:27.217561] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-08T19:54:27.460948] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T19:54:27.465006] [INFO ] [REMOTE ] LBRT: Full fetch complete (76620 records). [2025-10-08T19:54:27.465132] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-08T19:54:27.758610] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T19:54:27.888323] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-08T19:54:27.888412] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-08T19:54:27.889464] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-08T19:54:27.889527] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-08T19:54:27.891019] [DEBUG] [LOCAL ] LBRT: Trimmed 76620 records to 52937 (keeping 200 days of data) [2025-10-08T19:54:28.018362] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-08T19:54:28.226332] [DEBUG] [LOCAL ] LBRT: Primary data saved (52937 records). [2025-10-08T19:54:28.226555] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-08T19:54:28.226687] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LBRT took 37.9s. Estimated remaining: 2h 38m 0s. Rate: 7.1 symbols/min [2025-10-08T19:54:28.429815] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:28.445942] [DEBUG] [LOCAL ] LDP: Loaded 12973 existing records from primary storage. [2025-10-08T19:54:28.446142] [INFO ] [MAIN ] LDP: Loaded 12973 existing records. [2025-10-08T19:54:28.626546] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:28.627079] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-08T19:54:28.627161] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-08T19:54:28.627463] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-08T19:54:28.627747] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-08T19:54:28.734603] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T19:54:28.820588] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-08T19:54:29.026454] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:29.483345] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:54:29.617556] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-08T19:54:30.235026] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:54:30.417690] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-08T19:54:31.217578] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-08T19:54:31.355247] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:54:31.412450] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T19:54:32.017504] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-08T19:54:32.128946] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T19:54:32.817581] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-08T19:54:33.365200] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T19:54:33.569733] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T19:54:33.617511] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-08T19:54:34.417579] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-08T19:54:34.871860] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T19:54:35.217579] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-08T19:54:35.939998] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:54:36.013866] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T19:54:36.017483] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-08T19:54:36.817565] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-08T19:54:36.910428] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T19:54:37.617569] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-08T19:54:37.997514] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:54:38.417569] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-08T19:54:38.911288] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:54:39.217559] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-08T19:54:40.004113] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T19:54:40.017499] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-08T19:54:40.328206] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:54:40.817561] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-08T19:54:41.419236] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:54:41.617581] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-08T19:54:42.095228] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T19:54:42.417548] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-08T19:54:43.088547] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T19:54:43.217541] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-08T19:54:43.355686] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T19:54:44.017563] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-08T19:54:44.702721] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T19:54:44.817573] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-08T19:54:45.420332] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:54:45.617574] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-08T19:54:46.011256] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T19:54:46.417549] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-08T19:54:46.555297] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:54:47.217559] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-08T19:54:47.720280] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T19:54:48.017541] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-08T19:54:48.193407] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T19:54:48.817583] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-08T19:54:48.953180] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T19:54:49.617529] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-08T19:54:50.351235] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:54:50.417575] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-08T19:54:50.546860] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T19:54:51.217595] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-08T19:54:51.335713] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T19:54:52.017592] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-08T19:54:52.275906] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T19:54:52.278018] [INFO ] [REMOTE ] LCII: Full fetch complete (39148 records). [2025-10-08T19:54:52.278157] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-08T19:54:52.673476] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-08T19:54:52.673568] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-08T19:54:52.674368] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-08T19:54:52.674451] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-08T19:54:52.675521] [DEBUG] [LOCAL ] LCII: Trimmed 39148 records to 27674 (keeping 200 days of data) [2025-10-08T19:54:52.830420] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-08T19:54:52.862313] [DEBUG] [LOCAL ] LCII: Primary data saved (27674 records). [2025-10-08T19:54:52.862481] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-08T19:54:52.862714] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LCII took 34.9s. Estimated remaining: 2h 38m 6s. Rate: 7.1 symbols/min [2025-10-08T19:54:53.068826] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:53.110874] [DEBUG] [LOCAL ] LEA: Loaded 41646 existing records from primary storage. [2025-10-08T19:54:53.111203] [INFO ] [MAIN ] LEA: Loaded 41646 existing records. [2025-10-08T19:54:53.293937] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:53.294175] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-08T19:54:53.294226] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-08T19:54:53.294567] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-08T19:54:53.294685] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-08T19:54:53.620929] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-08T19:54:53.750913] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:53.778325] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:54:54.417570] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-08T19:54:54.481942] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T19:54:55.058928] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-08T19:54:55.217592] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-08T19:54:56.000954] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:54:56.017626] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-08T19:54:56.744870] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T19:54:56.817688] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-08T19:54:57.119973] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T19:54:57.126949] [INFO ] [REMOTE ] LDI: Full fetch complete (61077 records). [2025-10-08T19:54:57.127355] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-08T19:54:57.622761] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-08T19:54:57.712713] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-08T19:54:57.712832] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-08T19:54:57.713793] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-08T19:54:57.713858] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-08T19:54:57.715479] [DEBUG] [LOCAL ] LDI: Trimmed 61077 records to 44485 (keeping 200 days of data) [2025-10-08T19:54:57.973253] [DEBUG] [LOCAL ] LDI: Primary data saved (44485 records). [2025-10-08T19:54:57.973392] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-08T19:54:57.974431] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LDI took 33.4s. Estimated remaining: 2h 37m 55s. Rate: 7.1 symbols/min [2025-10-08T19:54:58.149442] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:58.199631] [DEBUG] [LOCAL ] LEG: Loaded 50216 existing records from primary storage. [2025-10-08T19:54:58.221720] [INFO ] [MAIN ] LEG: Loaded 50216 existing records. [2025-10-08T19:54:58.301551] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:54:58.412968] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:58.413181] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-08T19:54:58.413242] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-08T19:54:58.413627] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-08T19:54:58.413720] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-08T19:54:58.424867] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-08T19:54:58.763833] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:59.176253] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T19:54:59.217512] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-08T19:54:59.286669] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T19:54:59.288081] [INFO ] [REMOTE ] LDP: Full fetch complete (19141 records). [2025-10-08T19:54:59.288153] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-08T19:54:59.655757] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-08T19:54:59.655843] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-08T19:54:59.656305] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-08T19:54:59.656362] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-08T19:54:59.656928] [DEBUG] [LOCAL ] LDP: Trimmed 19141 records to 12929 (keeping 200 days of data) [2025-10-08T19:54:59.736364] [DEBUG] [LOCAL ] LDP: Primary data saved (12929 records). [2025-10-08T19:54:59.736525] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-08T19:54:59.736671] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDP took 31.5s. Estimated remaining: 2h 37m 41s. Rate: 7.1 symbols/min [2025-10-08T19:54:59.902514] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:59.958049] [DEBUG] [LOCAL ] LEN: Loaded 53171 existing records from primary storage. [2025-10-08T19:54:59.958370] [INFO ] [MAIN ] LEN: Loaded 53171 existing records. [2025-10-08T19:55:00.022775] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-08T19:55:00.141417] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:00.141660] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-08T19:55:00.141723] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-08T19:55:00.142126] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-08T19:55:00.142190] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-08T19:55:00.489980] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:00.701874] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:55:00.817702] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-08T19:55:01.318056] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T19:55:01.617606] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-08T19:55:02.414862] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T19:55:02.423558] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-08T19:55:02.996259] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T19:55:03.217560] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-08T19:55:04.017539] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-08T19:55:04.342282] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T19:55:04.637463] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T19:55:04.817548] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-08T19:55:05.617529] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-08T19:55:05.841555] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T19:55:06.357157] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:55:06.417625] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-08T19:55:07.030606] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:55:07.034398] [INFO ] [REMOTE ] LDOS: Full fetch complete (67440 records). [2025-10-08T19:55:07.034569] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-08T19:55:07.223481] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-08T19:55:07.450404] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-08T19:55:07.450496] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-08T19:55:07.451593] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-08T19:55:07.451689] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-08T19:55:07.453106] [DEBUG] [LOCAL ] LDOS: Trimmed 67440 records to 45346 (keeping 200 days of data) [2025-10-08T19:55:07.750306] [DEBUG] [LOCAL ] LDOS: Primary data saved (45346 records). [2025-10-08T19:55:07.750491] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-08T19:55:07.751574] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 41.6s. Estimated remaining: 2h 37m 32s. Rate: 7.1 symbols/min [2025-10-08T19:55:07.928410] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:07.950042] [DEBUG] [LOCAL ] LEO: Loaded 16872 existing records from primary storage. [2025-10-08T19:55:07.950364] [INFO ] [MAIN ] LEO: Loaded 16872 existing records. [2025-10-08T19:55:08.020534] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-08T19:55:08.175897] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:08.179406] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-08T19:55:08.181044] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T19:55:08.179953] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-08T19:55:08.191138] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-08T19:55:08.191358] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-08T19:55:08.548440] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:08.817579] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-08T19:55:09.109052] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T19:55:09.336354] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T19:55:09.617583] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-08T19:55:10.217416] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:55:10.417582] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-08T19:55:10.823036] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T19:55:11.217545] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-08T19:55:12.017607] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-08T19:55:12.324756] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T19:55:12.348122] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T19:55:12.817554] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-08T19:55:13.435361] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T19:55:13.617503] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-08T19:55:13.851767] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T19:55:14.417557] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-08T19:55:14.978033] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T19:55:15.217604] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-08T19:55:16.017535] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-08T19:55:16.405546] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T19:55:16.428792] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T19:55:16.817537] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-08T19:55:17.199329] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:55:17.617545] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-08T19:55:18.372572] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:55:18.417504] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-08T19:55:19.095612] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T19:55:19.217567] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-08T19:55:19.824481] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T19:55:20.017559] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-08T19:55:20.349118] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T19:55:20.817631] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-08T19:55:21.617522] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-08T19:55:21.687062] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T19:55:21.827086] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T19:55:22.417539] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-08T19:55:22.767916] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T19:55:23.217617] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-08T19:55:23.678797] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T19:55:24.017559] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-08T19:55:24.551223] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:55:24.817570] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-08T19:55:25.617601] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-08T19:55:25.767758] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T19:55:26.332109] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T19:55:26.361980] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T19:55:26.365705] [INFO ] [REMOTE ] LEG: Full fetch complete (73008 records). [2025-10-08T19:55:26.365824] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-08T19:55:26.426675] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-08T19:55:26.756636] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-08T19:55:26.756759] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-08T19:55:26.757730] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-08T19:55:26.757794] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-08T19:55:26.759249] [DEBUG] [LOCAL ] LEG: Trimmed 73008 records to 50168 (keeping 200 days of data) [2025-10-08T19:55:27.078589] [DEBUG] [LOCAL ] LEG: Primary data saved (50168 records). [2025-10-08T19:55:27.078801] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-08T19:55:27.080250] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LEG took 29.1s. Estimated remaining: 2h 37m 33s. Rate: 7.1 symbols/min [2025-10-08T19:55:27.226617] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-08T19:55:27.252826] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:27.305722] [DEBUG] [LOCAL ] LEVI: Loaded 51650 existing records from primary storage. [2025-10-08T19:55:27.306053] [INFO ] [MAIN ] LEVI: Loaded 51650 existing records. [2025-10-08T19:55:27.485217] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:27.485471] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-08T19:55:27.485527] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-08T19:55:27.485806] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-08T19:55:27.485867] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-08T19:55:27.881826] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:28.017530] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-08T19:55:28.443613] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T19:55:28.782260] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T19:55:28.817490] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-08T19:55:29.408782] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T19:55:29.617508] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-08T19:55:29.949880] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T19:55:29.953056] [INFO ] [REMOTE ] LEA: Full fetch complete (60677 records). [2025-10-08T19:55:29.953157] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-08T19:55:30.323340] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-08T19:55:30.323419] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-08T19:55:30.324265] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-08T19:55:30.324327] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-08T19:55:30.325558] [DEBUG] [LOCAL ] LEA: Trimmed 60677 records to 41557 (keeping 200 days of data) [2025-10-08T19:55:30.417533] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-08T19:55:30.585894] [DEBUG] [LOCAL ] LEA: Primary data saved (41557 records). [2025-10-08T19:55:30.586058] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-08T19:55:30.586154] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 37.7s. Estimated remaining: 2h 37m 20s. Rate: 7.1 symbols/min [2025-10-08T19:55:30.750001] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:30.768944] [DEBUG] [LOCAL ] LFT: Loaded 18415 existing records from primary storage. [2025-10-08T19:55:30.769207] [INFO ] [MAIN ] LFT: Loaded 18415 existing records. [2025-10-08T19:55:30.940314] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:30.940552] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-08T19:55:30.940598] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-08T19:55:30.940913] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-08T19:55:30.940971] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-08T19:55:31.222589] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-08T19:55:31.296633] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:31.409899] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T19:55:32.017520] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-08T19:55:32.127698] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T19:55:32.181194] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T19:55:32.817585] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-08T19:55:33.617595] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-08T19:55:33.874150] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T19:55:34.055551] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T19:55:34.417585] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-08T19:55:34.936323] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T19:55:35.004431] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T19:55:35.217595] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-08T19:55:36.017524] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-08T19:55:36.175923] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:55:36.672409] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T19:55:36.817574] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-08T19:55:37.617586] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-08T19:55:38.264748] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:55:38.417505] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-08T19:55:39.217636] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-08T19:55:39.576449] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-08T19:55:39.580918] [INFO ] [REMOTE ] LEN: Full fetch complete (77045 records). [2025-10-08T19:55:39.581081] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-08T19:55:39.933908] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T19:55:40.032763] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-08T19:55:40.032408] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-08T19:55:40.033957] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-08T19:55:40.034996] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-08T19:55:40.035164] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-08T19:55:40.036716] [DEBUG] [LOCAL ] LEN: Trimmed 77045 records to 53170 (keeping 200 days of data) [2025-10-08T19:55:40.302218] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T19:55:40.421622] [DEBUG] [LOCAL ] LEN: Primary data saved (53170 records). [2025-10-08T19:55:40.421807] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-08T19:55:40.421908] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEN took 40.7s. Estimated remaining: 2h 37m 13s. Rate: 7.1 symbols/min [2025-10-08T19:55:40.594766] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:40.606245] [DEBUG] [LOCAL ] LGI: Loaded 9857 existing records from primary storage. [2025-10-08T19:55:40.606447] [INFO ] [MAIN ] LGI: Loaded 9857 existing records. [2025-10-08T19:55:40.790222] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:40.790478] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-08T19:55:40.790530] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-08T19:55:40.790793] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-08T19:55:40.790851] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-08T19:55:40.822774] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-08T19:55:41.095256] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T19:55:41.177933] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:41.617528] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-08T19:55:41.775871] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T19:55:42.278523] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T19:55:42.280070] [INFO ] [REMOTE ] LEO: Full fetch complete (26640 records). [2025-10-08T19:55:42.280146] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-08T19:55:42.422677] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-08T19:55:42.649925] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-08T19:55:42.650003] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-08T19:55:42.650554] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-08T19:55:42.650597] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-08T19:55:42.651241] [DEBUG] [LOCAL ] LEO: Trimmed 26640 records to 16882 (keeping 200 days of data) [2025-10-08T19:55:42.754409] [DEBUG] [LOCAL ] LEO: Primary data saved (16882 records). [2025-10-08T19:55:42.754582] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-08T19:55:42.754723] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 35.0s. Estimated remaining: 2h 36m 59s. Rate: 7.1 symbols/min [2025-10-08T19:55:42.928073] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:42.971616] [DEBUG] [LOCAL ] LH: Loaded 37744 existing records from primary storage. [2025-10-08T19:55:42.971967] [INFO ] [MAIN ] LH: Loaded 37744 existing records. [2025-10-08T19:55:43.146303] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:43.146521] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-08T19:55:43.146567] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-08T19:55:43.146915] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-08T19:55:43.146974] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-08T19:55:43.220949] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-08T19:55:43.518290] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:43.533638] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T19:55:43.984596] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T19:55:44.017510] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-08T19:55:44.760483] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:55:44.817520] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-08T19:55:45.617568] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-08T19:55:46.260791] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T19:55:46.417518] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-08T19:55:46.464298] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T19:55:47.217594] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-08T19:55:47.774869] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T19:55:47.897819] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T19:55:48.017553] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-08T19:55:48.784315] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T19:55:48.817498] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-08T19:55:49.454681] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T19:55:49.617543] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-08T19:55:50.417563] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-08T19:55:51.109121] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:55:51.217542] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-08T19:55:51.644972] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T19:55:52.017604] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-08T19:55:52.133826] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T19:55:52.817624] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-08T19:55:53.378286] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T19:55:53.617524] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-08T19:55:53.818142] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T19:55:54.354107] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T19:55:54.417592] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-08T19:55:55.217569] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-08T19:55:55.341831] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:55:56.017594] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-08T19:55:56.713429] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T19:55:56.817585] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-08T19:55:57.626536] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-08T19:55:57.659923] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T19:55:57.686502] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T19:55:58.417599] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-08T19:55:59.230207] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-08T19:55:59.255571] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T19:56:00.017527] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-08T19:56:00.070173] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T19:56:00.096839] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T19:56:00.817569] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-08T19:56:01.622707] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-08T19:56:01.638214] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T19:56:02.336904] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T19:56:02.341045] [INFO ] [REMOTE ] LEVI: Full fetch complete (74548 records). [2025-10-08T19:56:02.341176] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-08T19:56:02.422690] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-08T19:56:02.762029] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-08T19:56:02.762160] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-08T19:56:02.763177] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-08T19:56:02.763262] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-08T19:56:02.764853] [DEBUG] [LOCAL ] LEVI: Trimmed 74548 records to 51674 (keeping 200 days of data) [2025-10-08T19:56:02.869146] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T19:56:03.120794] [DEBUG] [LOCAL ] LEVI: Primary data saved (51674 records). [2025-10-08T19:56:03.121000] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-08T19:56:03.122009] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEVI took 36.0s. Estimated remaining: 2h 37m 2s. Rate: 7.1 symbols/min [2025-10-08T19:56:03.222840] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-08T19:56:03.322681] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:03.372369] [DEBUG] [LOCAL ] LHX: Loaded 48596 existing records from primary storage. [2025-10-08T19:56:03.372745] [INFO ] [MAIN ] LHX: Loaded 48596 existing records. [2025-10-08T19:56:03.549764] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:03.550029] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-08T19:56:03.550075] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-08T19:56:03.550355] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-08T19:56:03.550415] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-08T19:56:03.914222] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:03.947086] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T19:56:04.017507] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-08T19:56:04.080598] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T19:56:04.817705] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-08T19:56:05.465127] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:56:05.617558] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-08T19:56:06.359035] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:56:06.417560] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-08T19:56:07.209326] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T19:56:07.228019] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-08T19:56:07.256754] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T19:56:07.916295] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T19:56:07.918841] [INFO ] [REMOTE ] LGI: Full fetch complete (14345 records). [2025-10-08T19:56:07.918984] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-08T19:56:08.022757] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-08T19:56:08.436404] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-08T19:56:08.436526] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-08T19:56:08.437111] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-08T19:56:08.437212] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-08T19:56:08.438281] [DEBUG] [LOCAL ] LGI: Trimmed 14345 records to 9878 (keeping 200 days of data) [2025-10-08T19:56:08.521382] [DEBUG] [LOCAL ] LGI: Primary data saved (9878 records). [2025-10-08T19:56:08.521566] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-08T19:56:08.521697] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LGI took 28.1s. Estimated remaining: 2h 36m 50s. Rate: 7.1 symbols/min [2025-10-08T19:56:08.738072] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:08.766613] [DEBUG] [LOCAL ] LII: Loaded 28025 existing records from primary storage. [2025-10-08T19:56:08.766949] [INFO ] [MAIN ] LII: Loaded 28025 existing records. [2025-10-08T19:56:08.829421] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-08T19:56:08.949172] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:08.949454] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-08T19:56:08.949512] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-08T19:56:08.949924] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-08T19:56:08.949983] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-08T19:56:09.374431] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:09.544033] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:56:09.617586] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-08T19:56:09.860989] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:56:09.862624] [INFO ] [REMOTE ] LFT: Full fetch complete (24058 records). [2025-10-08T19:56:09.862736] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-08T19:56:10.270477] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-08T19:56:10.270561] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-08T19:56:10.271157] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-08T19:56:10.271222] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-08T19:56:10.271943] [DEBUG] [LOCAL ] LFT: Trimmed 24058 records to 18400 (keeping 200 days of data) [2025-10-08T19:56:10.383616] [DEBUG] [LOCAL ] LFT: Primary data saved (18400 records). [2025-10-08T19:56:10.383802] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-08T19:56:10.383892] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LFT took 39.8s. Estimated remaining: 2h 36m 36s. Rate: 7.1 symbols/min [2025-10-08T19:56:10.422749] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-08T19:56:10.560374] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:10.604222] [DEBUG] [LOCAL ] LION: Loaded 45160 existing records from primary storage. [2025-10-08T19:56:10.604565] [INFO ] [MAIN ] LION: Loaded 45160 existing records. [2025-10-08T19:56:10.785722] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:10.785962] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-08T19:56:10.786007] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-08T19:56:10.786390] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-08T19:56:10.786449] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-08T19:56:11.150279] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:11.217526] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-08T19:56:11.328072] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T19:56:11.557294] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T19:56:12.017589] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-08T19:56:12.111741] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T19:56:12.817574] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-08T19:56:13.085504] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:56:13.611052] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T19:56:13.617486] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-08T19:56:14.417604] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-08T19:56:14.685579] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T19:56:15.217613] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-08T19:56:15.758474] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T19:56:15.762305] [INFO ] [REMOTE ] LH: Full fetch complete (55040 records). [2025-10-08T19:56:15.762415] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-08T19:56:16.028010] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-08T19:56:16.185870] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-08T19:56:16.185977] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-08T19:56:16.186830] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-08T19:56:16.186894] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-08T19:56:16.188393] [DEBUG] [LOCAL ] LH: Trimmed 55040 records to 37766 (keeping 200 days of data) [2025-10-08T19:56:16.433926] [DEBUG] [LOCAL ] LH: Primary data saved (37766 records). [2025-10-08T19:56:16.434087] [INFO ] [MAIN ] LH: Full history saved. [2025-10-08T19:56:16.435153] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LH took 33.7s. Estimated remaining: 2h 36m 26s. Rate: 7.1 symbols/min [2025-10-08T19:56:16.616727] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:16.625350] [DEBUG] [LOCAL ] LITB: Loaded 4268 existing records from primary storage. [2025-10-08T19:56:16.625602] [INFO ] [MAIN ] LITB: Loaded 4268 existing records. [2025-10-08T19:56:16.816399] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:16.816900] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-08T19:56:16.817091] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-08T19:56:16.817386] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-08T19:56:16.817447] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-08T19:56:16.822637] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-08T19:56:17.200871] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:17.231743] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-08T19:56:17.393744] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:56:17.617522] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-08T19:56:17.671172] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T19:56:18.417566] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-08T19:56:18.899357] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-08T19:56:19.217538] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-08T19:56:19.423320] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T19:56:20.017593] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-08T19:56:20.416801] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-08T19:56:20.603609] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:56:20.817577] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-08T19:56:21.617562] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-08T19:56:22.074592] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:56:22.417694] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-08T19:56:22.573120] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T19:56:22.744985] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T19:56:23.217610] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-08T19:56:24.017567] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-08T19:56:24.659558] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:56:24.674707] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-08T19:56:24.817541] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-08T19:56:25.471986] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T19:56:25.617568] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-08T19:56:26.004023] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-08T19:56:26.417568] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-08T19:56:27.217615] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-08T19:56:28.017570] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-08T19:56:28.182859] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:56:28.470394] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T19:56:28.535298] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T19:56:28.817515] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-08T19:56:29.617599] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-08T19:56:29.848314] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:56:30.417572] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-08T19:56:31.217533] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-08T19:56:31.509513] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T19:56:32.008359] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T19:56:32.017857] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-08T19:56:32.340612] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-08T19:56:32.437141] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T19:56:32.817603] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-08T19:56:33.617625] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-08T19:56:33.996612] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T19:56:34.417571] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-08T19:56:34.884002] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T19:56:35.217566] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-08T19:56:35.333592] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:56:36.017556] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-08T19:56:36.460615] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T19:56:36.817551] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-08T19:56:36.906429] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T19:56:37.498987] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T19:56:37.617540] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-08T19:56:38.166941] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T19:56:38.167883] [INFO ] [REMOTE ] LITB: Full fetch complete (5643 records). [2025-10-08T19:56:38.167958] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-08T19:56:38.427474] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-08T19:56:38.569232] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-08T19:56:38.569322] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-08T19:56:38.569522] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-08T19:56:38.569585] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-08T19:56:38.570110] [DEBUG] [LOCAL ] LITB: Trimmed 5643 records to 4249 (keeping 200 days of data) [2025-10-08T19:56:38.595853] [DEBUG] [LOCAL ] LITB: Primary data saved (4249 records). [2025-10-08T19:56:38.596008] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-08T19:56:38.596097] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LITB took 22.2s. Estimated remaining: 2h 36m 29s. Rate: 7.1 symbols/min [2025-10-08T19:56:38.777252] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:38.846278] [DEBUG] [LOCAL ] LLY: Loaded 53301 existing records from primary storage. [2025-10-08T19:56:38.846750] [INFO ] [MAIN ] LLY: Loaded 53301 existing records. [2025-10-08T19:56:39.032483] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:39.032769] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-08T19:56:39.032821] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-08T19:56:39.033055] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-08T19:56:39.033111] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-08T19:56:39.222996] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-08T19:56:39.405676] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:39.838522] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:56:40.017557] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-08T19:56:40.818826] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-08T19:56:40.824745] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:56:41.249901] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:56:41.617518] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-08T19:56:42.070488] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T19:56:42.417562] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-08T19:56:43.217552] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-08T19:56:43.360359] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:56:44.017590] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-08T19:56:44.597292] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:56:44.601061] [INFO ] [REMOTE ] LION: Full fetch complete (56046 records). [2025-10-08T19:56:44.601182] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-08T19:56:44.825901] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-08T19:56:45.001315] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-08T19:56:45.001531] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-08T19:56:45.002470] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-08T19:56:45.002583] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-08T19:56:45.019884] [DEBUG] [LOCAL ] LION: Trimmed 56046 records to 45437 (keeping 200 days of data) [2025-10-08T19:56:45.034546] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-08T19:56:45.308589] [DEBUG] [LOCAL ] LION: Primary data saved (45437 records). [2025-10-08T19:56:45.308846] [INFO ] [MAIN ] LION: Full history saved. [2025-10-08T19:56:45.309031] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LION took 34.9s. Estimated remaining: 2h 36m 20s. Rate: 7.1 symbols/min [2025-10-08T19:56:45.502174] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:45.507135] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:56:45.563326] [DEBUG] [LOCAL ] LMND: Loaded 51976 existing records from primary storage. [2025-10-08T19:56:45.563728] [INFO ] [MAIN ] LMND: Loaded 51976 existing records. [2025-10-08T19:56:45.625045] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-08T19:56:45.740636] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:45.740878] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-08T19:56:45.740926] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-08T19:56:45.741978] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-08T19:56:45.742039] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-08T19:56:46.094964] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:46.203433] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:56:46.206036] [INFO ] [REMOTE ] LII: Full fetch complete (41490 records). [2025-10-08T19:56:46.206141] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-08T19:56:46.425274] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-08T19:56:46.585042] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-08T19:56:46.585125] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-08T19:56:46.585835] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-08T19:56:46.585896] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-08T19:56:46.586838] [DEBUG] [LOCAL ] LII: Trimmed 41490 records to 28016 (keeping 200 days of data) [2025-10-08T19:56:46.770933] [DEBUG] [LOCAL ] LII: Primary data saved (28016 records). [2025-10-08T19:56:46.771079] [INFO ] [MAIN ] LII: Full history saved. [2025-10-08T19:56:46.771178] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LII took 38.2s. Estimated remaining: 2h 36m 5s. Rate: 7.1 symbols/min [2025-10-08T19:56:46.950566] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:47.004340] [DEBUG] [LOCAL ] LMT: Loaded 49815 existing records from primary storage. [2025-10-08T19:56:47.004779] [INFO ] [MAIN ] LMT: Loaded 49815 existing records. [2025-10-08T19:56:47.186746] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:47.186992] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-08T19:56:47.187048] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-08T19:56:47.188042] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-08T19:56:47.188102] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-08T19:56:47.229782] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-08T19:56:47.536137] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:47.870317] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-08T19:56:48.022286] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-08T19:56:48.027436] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T19:56:48.033104] [INFO ] [REMOTE ] LHX: Full fetch complete (70607 records). [2025-10-08T19:56:48.033289] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-08T19:56:48.421088] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-08T19:56:48.421177] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-08T19:56:48.422092] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-08T19:56:48.422155] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-08T19:56:48.423836] [DEBUG] [LOCAL ] LHX: Trimmed 70607 records to 48559 (keeping 200 days of data) [2025-10-08T19:56:48.734159] [DEBUG] [LOCAL ] LHX: Primary data saved (48559 records). [2025-10-08T19:56:48.734296] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-08T19:56:48.735109] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LHX took 45.6s. Estimated remaining: 2h 35m 51s. Rate: 7.1 symbols/min [2025-10-08T19:56:48.830934] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-08T19:56:48.914115] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:48.970635] [DEBUG] [LOCAL ] LNC: Loaded 51640 existing records from primary storage. [2025-10-08T19:56:48.971065] [INFO ] [MAIN ] LNC: Loaded 51640 existing records. [2025-10-08T19:56:49.149917] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:49.150182] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-08T19:56:49.150255] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-08T19:56:49.151323] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-08T19:56:49.151384] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-08T19:56:49.517169] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:49.546719] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-08T19:56:49.617527] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-08T19:56:50.418421] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-08T19:56:50.418337] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-08T19:56:50.510732] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T19:56:51.217535] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-08T19:56:51.289976] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:56:51.974196] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T19:56:52.017498] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-08T19:56:52.817544] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-08T19:56:53.138899] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T19:56:53.604976] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T19:56:53.617489] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-08T19:56:54.291154] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T19:56:54.417562] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-08T19:56:55.029508] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:56:55.217548] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-08T19:56:56.017528] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-08T19:56:56.203034] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:56:56.668399] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:56:56.817520] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-08T19:56:57.295215] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T19:56:57.617559] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-08T19:56:58.417592] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-08T19:56:58.628792] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T19:56:59.037591] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T19:56:59.217633] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-08T19:57:00.017621] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-08T19:57:00.612595] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-08T19:57:00.817572] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-08T19:57:01.617593] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-08T19:57:01.688808] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-08T19:57:01.730234] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T19:57:02.417553] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-08T19:57:02.839635] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T19:57:03.217514] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-08T19:57:03.307020] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:57:04.017574] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-08T19:57:04.506048] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T19:57:04.822070] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-08T19:57:04.827914] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:57:05.617519] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-08T19:57:06.114076] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T19:57:06.417714] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-08T19:57:07.184225] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-08T19:57:07.217505] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-08T19:57:07.378130] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:57:08.017611] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-08T19:57:08.610139] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-08T19:57:08.817559] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-08T19:57:09.528733] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-08T19:57:09.617546] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-08T19:57:09.799496] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T19:57:10.203541] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:57:10.417569] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-08T19:57:11.217547] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-08T19:57:12.017548] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-08T19:57:12.247737] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-08T19:57:12.583913] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-08T19:57:12.638032] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T19:57:12.817580] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-08T19:57:13.617579] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-08T19:57:14.103620] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T19:57:14.255114] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:57:14.417602] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-08T19:57:15.217524] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-08T19:57:15.708953] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-08T19:57:15.838461] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:57:15.842371] [INFO ] [REMOTE ] LNC: Full fetch complete (74366 records). [2025-10-08T19:57:15.842487] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-08T19:57:16.020356] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-08T19:57:16.238947] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-08T19:57:16.239049] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-08T19:57:16.240066] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-08T19:57:16.240149] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-08T19:57:16.241793] [DEBUG] [LOCAL ] LNC: Trimmed 74366 records to 51610 (keeping 200 days of data) [2025-10-08T19:57:16.561398] [DEBUG] [LOCAL ] LNC: Primary data saved (51610 records). [2025-10-08T19:57:16.561661] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-08T19:57:16.562878] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LNC took 27.8s. Estimated remaining: 2h 35m 60s. Rate: 7.1 symbols/min [2025-10-08T19:57:16.777530] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:16.785627] [DEBUG] [LOCAL ] LND: Loaded 4946 existing records from primary storage. [2025-10-08T19:57:16.785919] [INFO ] [MAIN ] LND: Loaded 4946 existing records. [2025-10-08T19:57:16.827470] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-08T19:57:16.964560] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:16.964843] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-08T19:57:16.964892] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-08T19:57:16.965220] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-08T19:57:16.965279] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-08T19:57:17.361240] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:17.591339] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-08T19:57:17.617544] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-08T19:57:18.417541] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-08T19:57:18.479925] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-08T19:57:18.484015] [INFO ] [REMOTE ] LMND: Full fetch complete (75328 records). [2025-10-08T19:57:18.484159] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-08T19:57:18.896525] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-08T19:57:18.896727] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-08T19:57:18.897758] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-08T19:57:18.897926] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-08T19:57:18.899513] [DEBUG] [LOCAL ] LMND: Trimmed 75328 records to 51987 (keeping 200 days of data) [2025-10-08T19:57:19.113725] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T19:57:19.151638] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-08T19:57:19.221011] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-08T19:57:19.258314] [DEBUG] [LOCAL ] LMND: Primary data saved (51987 records). [2025-10-08T19:57:19.258414] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-08T19:57:19.258490] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 33.9s. Estimated remaining: 2h 35m 46s. Rate: 7.1 symbols/min [2025-10-08T19:57:19.430361] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:19.480029] [DEBUG] [LOCAL ] LNG: Loaded 51300 existing records from primary storage. [2025-10-08T19:57:19.480391] [INFO ] [MAIN ] LNG: Loaded 51300 existing records. [2025-10-08T19:57:19.654045] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:19.654748] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-08T19:57:19.654858] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-08T19:57:19.656064] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-08T19:57:19.656123] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-08T19:57:19.929241] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T19:57:20.020798] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-08T19:57:20.020720] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:20.056995] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-08T19:57:20.817542] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-08T19:57:21.617562] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-08T19:57:21.902692] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T19:57:22.066496] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T19:57:22.070816] [INFO ] [REMOTE ] LLY: Full fetch complete (77271 records). [2025-10-08T19:57:22.070949] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-08T19:57:22.427242] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-08T19:57:22.501422] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-08T19:57:22.501824] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-08T19:57:22.502889] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-08T19:57:22.503024] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-08T19:57:22.504939] [DEBUG] [LOCAL ] LLY: Trimmed 77271 records to 53293 (keeping 200 days of data) [2025-10-08T19:57:22.633900] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T19:57:22.887412] [DEBUG] [LOCAL ] LLY: Primary data saved (53293 records). [2025-10-08T19:57:22.887577] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-08T19:57:22.888508] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LLY took 44.3s. Estimated remaining: 2h 35m 33s. Rate: 7.1 symbols/min [2025-10-08T19:57:23.056282] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:23.070242] [DEBUG] [LOCAL ] LNN: Loaded 11291 existing records from primary storage. [2025-10-08T19:57:23.070486] [INFO ] [MAIN ] LNN: Loaded 11291 existing records. [2025-10-08T19:57:23.244821] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-08T19:57:23.251131] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:23.251447] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-08T19:57:23.251495] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-08T19:57:23.252041] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-08T19:57:23.252104] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-08T19:57:23.360574] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T19:57:23.612861] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:24.017559] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-08T19:57:24.817550] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-08T19:57:24.817489] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T19:57:24.989282] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T19:57:24.992920] [INFO ] [REMOTE ] LMT: Full fetch complete (72397 records). [2025-10-08T19:57:24.993054] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-08T19:57:25.358189] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-08T19:57:25.453236] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-08T19:57:25.453343] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-08T19:57:25.454314] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-08T19:57:25.454383] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-08T19:57:25.455976] [DEBUG] [LOCAL ] LMT: Trimmed 72397 records to 49773 (keeping 200 days of data) [2025-10-08T19:57:25.649098] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-08T19:57:25.787236] [DEBUG] [LOCAL ] LMT: Primary data saved (49773 records). [2025-10-08T19:57:25.787403] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-08T19:57:25.787493] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 39.0s. Estimated remaining: 2h 35m 20s. Rate: 7.1 symbols/min [2025-10-08T19:57:25.956144] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:25.995207] [DEBUG] [LOCAL ] LOAR: Loaded 42065 existing records from primary storage. [2025-10-08T19:57:25.995515] [INFO ] [MAIN ] LOAR: Loaded 42065 existing records. [2025-10-08T19:57:26.172426] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:26.172666] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-08T19:57:26.172729] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-08T19:57:26.174079] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-08T19:57:26.174140] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-08T19:57:26.422762] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-08T19:57:26.524088] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:26.945200] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T19:57:27.217523] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-08T19:57:27.618490] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T19:57:27.702987] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T19:57:28.017570] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-08T19:57:28.817561] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-08T19:57:29.558315] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:57:29.617525] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-08T19:57:29.957528] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T19:57:30.417592] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-08T19:57:30.789566] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T19:57:31.217541] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-08T19:57:31.829903] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T19:57:31.994864] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T19:57:32.017511] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-08T19:57:32.816260] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T19:57:32.819022] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-08T19:57:33.617547] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-08T19:57:34.417582] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-08T19:57:34.647322] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T19:57:34.794376] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T19:57:35.217591] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-08T19:57:35.586366] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T19:57:35.660019] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T19:57:36.017547] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-08T19:57:36.479078] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T19:57:36.817560] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-08T19:57:37.617560] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-08T19:57:37.994536] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T19:57:38.050134] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-08T19:57:38.417555] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-08T19:57:39.217549] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-08T19:57:39.786968] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T19:57:39.832175] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T19:57:40.017555] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-08T19:57:40.817552] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-08T19:57:41.613910] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T19:57:41.622368] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-08T19:57:42.344459] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:57:42.417628] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-08T19:57:42.506797] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T19:57:43.217579] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-08T19:57:44.017585] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-08T19:57:44.157312] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T19:57:44.588005] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-08T19:57:44.817619] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-08T19:57:44.966587] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:57:45.575183] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:57:45.617496] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-08T19:57:46.237408] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T19:57:46.417571] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-08T19:57:47.217600] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-08T19:57:47.283591] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:57:47.285005] [INFO ] [REMOTE ] LNN: Full fetch complete (15600 records). [2025-10-08T19:57:47.285078] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-08T19:57:47.638843] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-08T19:57:47.638969] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-08T19:57:47.639408] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-08T19:57:47.639450] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-08T19:57:47.640030] [DEBUG] [LOCAL ] LNN: Trimmed 15600 records to 11300 (keeping 200 days of data) [2025-10-08T19:57:47.719868] [DEBUG] [LOCAL ] LNN: Primary data saved (11300 records). [2025-10-08T19:57:47.720030] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-08T19:57:47.720151] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNN took 24.8s. Estimated remaining: 2h 35m 24s. Rate: 7.1 symbols/min [2025-10-08T19:57:47.897836] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:47.925708] [DEBUG] [LOCAL ] LOB: Loaded 27203 existing records from primary storage. [2025-10-08T19:57:47.925988] [INFO ] [MAIN ] LOB: Loaded 27203 existing records. [2025-10-08T19:57:48.023255] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-08T19:57:48.102164] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:48.102375] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-08T19:57:48.102421] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-08T19:57:48.103333] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-08T19:57:48.103395] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-08T19:57:48.448097] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:48.817520] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-08T19:57:48.883264] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T19:57:49.307831] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:57:49.373348] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T19:57:49.617560] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-08T19:57:50.417577] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-08T19:57:51.217596] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-08T19:57:51.408145] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T19:57:51.448578] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T19:57:51.657835] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T19:57:51.658911] [INFO ] [REMOTE ] LND: Full fetch complete (8158 records). [2025-10-08T19:57:51.658990] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-08T19:57:52.028747] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-08T19:57:52.037991] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-08T19:57:52.039006] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-08T19:57:52.039328] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-08T19:57:52.039403] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-08T19:57:52.040152] [DEBUG] [LOCAL ] LND: Trimmed 8158 records to 4976 (keeping 200 days of data) [2025-10-08T19:57:52.074924] [DEBUG] [LOCAL ] LND: Primary data saved (4976 records). [2025-10-08T19:57:52.075114] [INFO ] [MAIN ] LND: Full history saved. [2025-10-08T19:57:52.075235] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 35.5s. Estimated remaining: 2h 35m 12s. Rate: 7.1 symbols/min [2025-10-08T19:57:52.326079] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:52.334324] [DEBUG] [LOCAL ] LOCL: Loaded 3633 existing records from primary storage. [2025-10-08T19:57:52.334637] [INFO ] [MAIN ] LOCL: Loaded 3633 existing records. [2025-10-08T19:57:52.626873] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:52.627232] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-08T19:57:52.627310] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-08T19:57:52.627557] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-08T19:57:52.627630] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-08T19:57:52.822737] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-08T19:57:53.119127] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:53.280426] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T19:57:53.617574] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-08T19:57:54.417607] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-08T19:57:54.803005] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T19:57:55.125341] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T19:57:55.217627] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-08T19:57:55.507599] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T19:57:55.670020] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-08T19:57:56.017627] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-08T19:57:56.817566] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-08T19:57:57.272036] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T19:57:57.514609] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T19:57:57.519532] [INFO ] [REMOTE ] LNG: Full fetch complete (74658 records). [2025-10-08T19:57:57.519746] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-08T19:57:57.622731] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-08T19:57:57.971303] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-08T19:57:57.971397] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-08T19:57:57.972405] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-08T19:57:57.972474] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-08T19:57:57.973994] [DEBUG] [LOCAL ] LNG: Trimmed 74658 records to 51319 (keeping 200 days of data) [2025-10-08T19:57:58.294918] [DEBUG] [LOCAL ] LNG: Primary data saved (51319 records). [2025-10-08T19:57:58.295072] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-08T19:57:58.295164] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNG took 39.0s. Estimated remaining: 2h 35m 1s. Rate: 7.1 symbols/min [2025-10-08T19:57:58.421976] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-08T19:57:58.481913] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:58.520307] [DEBUG] [LOCAL ] LOMA: Loaded 32169 existing records from primary storage. [2025-10-08T19:57:58.520748] [INFO ] [MAIN ] LOMA: Loaded 32169 existing records. [2025-10-08T19:57:58.625142] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:57:58.739569] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:58.739939] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-08T19:57:58.740008] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-08T19:57:58.740476] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-08T19:57:58.740552] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-08T19:57:59.115214] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:59.217520] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-08T19:57:59.939467] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T19:58:00.017519] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-08T19:58:00.323051] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T19:58:00.359382] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T19:58:00.817613] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-08T19:58:01.231327] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T19:58:01.617562] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-08T19:58:02.417576] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-08T19:58:02.998474] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:58:03.005074] [INFO ] [REMOTE ] LOAR: Full fetch complete (56171 records). [2025-10-08T19:58:03.005268] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-08T19:58:03.222674] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-08T19:58:03.405004] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-08T19:58:03.405092] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-08T19:58:03.406025] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-08T19:58:03.406098] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-08T19:58:03.407367] [DEBUG] [LOCAL ] LOAR: Trimmed 56171 records to 42082 (keeping 200 days of data) [2025-10-08T19:58:03.656082] [DEBUG] [LOCAL ] LOAR: Primary data saved (42082 records). [2025-10-08T19:58:03.656268] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-08T19:58:03.656361] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOAR took 37.9s. Estimated remaining: 2h 34m 50s. Rate: 7.1 symbols/min [2025-10-08T19:58:03.835795] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:03.854318] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:58:03.912226] [DEBUG] [LOCAL ] LOW: Loaded 52967 existing records from primary storage. [2025-10-08T19:58:03.912662] [INFO ] [MAIN ] LOW: Loaded 52967 existing records. [2025-10-08T19:58:04.022739] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-08T19:58:04.098638] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:04.098943] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-08T19:58:04.098992] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-08T19:58:04.099293] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-08T19:58:04.099363] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-08T19:58:04.462137] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:04.743853] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:58:04.817509] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-08T19:58:05.598359] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T19:58:05.617504] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-08T19:58:06.143959] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T19:58:06.330534] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T19:58:06.417530] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-08T19:58:07.217521] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-08T19:58:07.266205] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T19:58:08.013665] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T19:58:08.017484] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-08T19:58:08.448020] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T19:58:08.817570] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-08T19:58:09.617560] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-08T19:58:10.417529] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-08T19:58:10.601511] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T19:58:10.657073] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T19:58:10.852144] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-08T19:58:11.217567] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-08T19:58:12.017585] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-08T19:58:12.354424] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T19:58:12.817560] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-08T19:58:13.336594] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:58:13.617589] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-08T19:58:14.046855] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:58:14.417568] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-08T19:58:15.217565] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-08T19:58:15.504021] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T19:58:15.530277] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:58:15.532786] [INFO ] [REMOTE ] LOB: Full fetch complete (38049 records). [2025-10-08T19:58:15.532867] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-08T19:58:15.628893] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-08T19:58:15.912419] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-08T19:58:15.912506] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-08T19:58:15.913300] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-08T19:58:15.913363] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-08T19:58:15.914250] [DEBUG] [LOCAL ] LOB: Trimmed 38049 records to 27185 (keeping 200 days of data) [2025-10-08T19:58:16.017832] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-08T19:58:16.087166] [DEBUG] [LOCAL ] LOB: Primary data saved (27185 records). [2025-10-08T19:58:16.087316] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-08T19:58:16.087404] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LOB took 28.4s. Estimated remaining: 2h 34m 45s. Rate: 7.1 symbols/min [2025-10-08T19:58:16.256707] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:16.304248] [DEBUG] [LOCAL ] LPG: Loaded 39729 existing records from primary storage. [2025-10-08T19:58:16.304596] [INFO ] [MAIN ] LPG: Loaded 39729 existing records. [2025-10-08T19:58:16.409969] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-08T19:58:16.493822] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:16.494099] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-08T19:58:16.494159] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-08T19:58:16.494540] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-08T19:58:16.494598] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-08T19:58:16.821329] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-08T19:58:16.851793] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:17.383033] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T19:58:17.617557] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-08T19:58:18.417571] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-08T19:58:18.942498] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T19:58:18.943300] [INFO ] [REMOTE ] LOCL: Full fetch complete (4511 records). [2025-10-08T19:58:18.943371] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-08T19:58:19.220724] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-08T19:58:19.318619] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-08T19:58:19.318861] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-08T19:58:19.319073] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-08T19:58:19.319149] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-08T19:58:19.329573] [DEBUG] [LOCAL ] LOCL: Trimmed 4511 records to 3627 (keeping 200 days of data) [2025-10-08T19:58:19.356962] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:58:19.379281] [DEBUG] [LOCAL ] LOCL: Primary data saved (3627 records). [2025-10-08T19:58:19.379397] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-08T19:58:19.379474] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOCL took 27.3s. Estimated remaining: 2h 34m 32s. Rate: 7.1 symbols/min [2025-10-08T19:58:19.551525] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:19.579288] [DEBUG] [LOCAL ] LPL: Loaded 27148 existing records from primary storage. [2025-10-08T19:58:19.579597] [INFO ] [MAIN ] LPL: Loaded 27148 existing records. [2025-10-08T19:58:19.759954] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:19.760260] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-08T19:58:19.760320] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-08T19:58:19.760552] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-08T19:58:19.760625] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-08T19:58:20.025854] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-08T19:58:20.119571] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:20.249846] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T19:58:20.817550] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-08T19:58:21.617597] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-08T19:58:21.850534] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T19:58:21.927362] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T19:58:22.417609] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-08T19:58:22.636072] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T19:58:23.217554] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-08T19:58:24.028074] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-08T19:58:24.033439] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T19:58:24.102557] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T19:58:24.817606] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-08T19:58:25.617524] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-08T19:58:25.934568] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T19:58:25.980626] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T19:58:26.417560] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-08T19:58:26.916701] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T19:58:27.217530] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-08T19:58:28.017544] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-08T19:58:28.345496] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T19:58:28.402696] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T19:58:28.817602] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-08T19:58:28.896171] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:58:29.617550] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-08T19:58:30.417538] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-08T19:58:30.586520] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:58:31.120946] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T19:58:31.217525] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-08T19:58:31.309298] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T19:58:32.012199] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T19:58:32.017490] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-08T19:58:32.769575] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:58:32.817529] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-08T19:58:33.617548] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-08T19:58:33.939437] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T19:58:34.417573] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-08T19:58:34.797864] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:58:35.217540] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-08T19:58:35.645963] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T19:58:36.017546] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-08T19:58:36.817521] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-08T19:58:36.974318] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:58:37.561516] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:58:37.617566] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-08T19:58:37.901196] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:58:37.903964] [INFO ] [REMOTE ] LOMA: Full fetch complete (47706 records). [2025-10-08T19:58:37.904070] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-08T19:58:38.299161] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-08T19:58:38.299253] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-08T19:58:38.300086] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-08T19:58:38.300151] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-08T19:58:38.301219] [DEBUG] [LOCAL ] LOMA: Trimmed 47706 records to 32180 (keeping 200 days of data) [2025-10-08T19:58:38.418441] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-08T19:58:38.494172] [DEBUG] [LOCAL ] LOMA: Primary data saved (32180 records). [2025-10-08T19:58:38.494347] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-08T19:58:38.494457] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOMA took 40.2s. Estimated remaining: 2h 34m 33s. Rate: 7.1 symbols/min [2025-10-08T19:58:38.682812] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:38.699229] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T19:58:38.743411] [DEBUG] [LOCAL ] LPX: Loaded 39780 existing records from primary storage. [2025-10-08T19:58:38.743806] [INFO ] [MAIN ] LPX: Loaded 39780 existing records. [2025-10-08T19:58:38.973490] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:38.973774] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-08T19:58:38.973827] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-08T19:58:38.974051] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-08T19:58:38.974108] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-08T19:58:39.222820] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-08T19:58:39.334430] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:40.017496] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-08T19:58:40.253858] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:58:40.459235] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T19:58:40.817615] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-08T19:58:41.478264] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T19:58:41.572076] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:58:41.617565] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-08T19:58:42.417613] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-08T19:58:43.160014] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:58:43.217499] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-08T19:58:43.646624] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T19:58:44.017565] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-08T19:58:44.831045] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-08T19:58:44.862318] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T19:58:45.543631] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:58:45.617509] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-08T19:58:46.039539] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T19:58:46.417551] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-08T19:58:47.080030] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T19:58:47.217560] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-08T19:58:47.702047] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:58:48.017580] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-08T19:58:48.817549] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-08T19:58:49.160372] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T19:58:49.227816] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T19:58:49.617587] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-08T19:58:50.116935] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T19:58:50.120205] [INFO ] [REMOTE ] LPL: Full fetch complete (36156 records). [2025-10-08T19:58:50.120335] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-08T19:58:50.422670] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-08T19:58:50.495886] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-08T19:58:50.495970] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-08T19:58:50.496620] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-08T19:58:50.496718] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-08T19:58:50.497706] [DEBUG] [LOCAL ] LPL: Trimmed 36156 records to 27378 (keeping 200 days of data) [2025-10-08T19:58:50.654945] [DEBUG] [LOCAL ] LPL: Primary data saved (27378 records). [2025-10-08T19:58:50.655082] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-08T19:58:50.655171] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPL took 31.3s. Estimated remaining: 2h 34m 28s. Rate: 7.1 symbols/min [2025-10-08T19:58:50.823887] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:50.865961] [DEBUG] [LOCAL ] LRN: Loaded 39718 existing records from primary storage. [2025-10-08T19:58:50.866289] [INFO ] [MAIN ] LRN: Loaded 39718 existing records. [2025-10-08T19:58:51.052965] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:51.053382] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-08T19:58:51.053522] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-08T19:58:51.053980] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-08T19:58:51.054111] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-08T19:58:51.224066] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-08T19:58:51.458955] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:51.492099] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T19:58:51.513776] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T19:58:51.517713] [INFO ] [REMOTE ] LPG: Full fetch complete (59357 records). [2025-10-08T19:58:51.517896] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-08T19:58:51.951423] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-08T19:58:51.951521] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-08T19:58:51.952386] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-08T19:58:51.952451] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-08T19:58:51.955570] [DEBUG] [LOCAL ] LPG: Trimmed 59357 records to 39690 (keeping 200 days of data) [2025-10-08T19:58:52.022598] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-08T19:58:52.208336] [DEBUG] [LOCAL ] LPG: Primary data saved (39690 records). [2025-10-08T19:58:52.208496] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-08T19:58:52.208597] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPG took 36.1s. Estimated remaining: 2h 34m 14s. Rate: 7.1 symbols/min [2025-10-08T19:58:52.420050] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:52.466173] [DEBUG] [LOCAL ] LSPD: Loaded 42822 existing records from primary storage. [2025-10-08T19:58:52.466583] [INFO ] [MAIN ] LSPD: Loaded 42822 existing records. [2025-10-08T19:58:52.653936] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:52.654245] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-08T19:58:52.654348] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-08T19:58:52.654684] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-08T19:58:52.654783] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-08T19:58:52.828706] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-08T19:58:52.941822] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T19:58:53.061936] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:53.576745] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T19:58:53.581504] [INFO ] [REMOTE ] LOW: Full fetch complete (76525 records). [2025-10-08T19:58:53.581771] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-08T19:58:53.623282] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-08T19:58:54.050085] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-08T19:58:54.050243] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-08T19:58:54.051827] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-08T19:58:54.051903] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-08T19:58:54.054147] [DEBUG] [LOCAL ] LOW: Trimmed 76525 records to 52977 (keeping 200 days of data) [2025-10-08T19:58:54.338959] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T19:58:54.422167] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-08T19:58:54.481682] [DEBUG] [LOCAL ] LOW: Primary data saved (52977 records). [2025-10-08T19:58:54.481929] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-08T19:58:54.482067] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LOW took 50.8s. Estimated remaining: 2h 33m 60s. Rate: 7.1 symbols/min [2025-10-08T19:58:54.689291] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:54.726087] [DEBUG] [LOCAL ] LTC: Loaded 30225 existing records from primary storage. [2025-10-08T19:58:54.726595] [INFO ] [MAIN ] LTC: Loaded 30225 existing records. [2025-10-08T19:58:54.925079] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:54.925476] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-08T19:58:54.925554] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-08T19:58:54.925916] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-08T19:58:54.925982] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-08T19:58:55.228278] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-08T19:58:55.385993] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:55.411442] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T19:58:55.736312] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:58:5